PseudoAnonymizedFakerpseudo-anonymizes private or sensitive data. When transforming the column, it converts the original data to numerical values. When reversing the transform, it pseudo-anonymizes the column by mapping each value to a completely new, fake data using the Python Faker library. Note that the mapping is consistent so the real, sensitive values can be recovered.
from rdt.transformers.pii import PseudoAnonymizedFaker
transformer = PseudoAnonymizedFaker()
You can specify the exact faker method to use for more realistic data.
provider_name: The name of the provider to use from the Faker library.
function_name: The name of the function to use within the Faker provider.
function_nameparameters specify exactly how to create fake data. Some common values are:
function_kwargs: Optional parameters to pass into the function that you're specifying to create Fake data.
locales: An optional list of locales to use when generating the Fake data.
Setting a locale might leak information about the original data. Anyone with access to the anonymized data will be able to tell which countries and locales are included in the original data .
from rdttransformers.pii import PseudoAnonymizedFaker
# create more realistic-looking data by specifying a provider and function
transformer = PseudoAnonymizedFaker(
PseudoAnonymizedFakerwhenever you have sensitive data that should not be part of your data science project. By default, the transformer reverses the transform into fake, 4-character strings such as
"UaNJ"in place of the original, sensitive data.
Use this transformer as-is if the values in your sensitive data do not matter. Alternatively, supply a provider and function name to create fake data that looks more realistic.
PseudoAnonymizedFakergenerates data randomly without looking at the real values. So there is a small chance that a real value may show up in the real data by complete coincidence. For example, if your real data had a phone number
"(617)123-4567", there's a small probability that the exact same phone number will be created by random chance. It may or may not map to a different number.
This behavior actually protects your sensitive data! Otherwise, anyone with access to the fake data would be able to deduce the real values by noting down what's missing.
Pseudo-anonymization indicates that the scheme can be reversed while anonymization indicates that it's permanent.
This transformer pseudo-anonymizes data in a reversible way using consistent mapping between the original and fake data. This behavior allows you to add protection to your original data while also providing the option to recover the sensitive values. Note that anyone with access to the transformer will be able to lookup the mapping and uncover the real values.
Yes. This transformer has a
get_mapping()function that will return the mapping.
If you are using a HyperTransformer access the transformer through the config.
# assume ht is a HyperTransformer that is already fit
paf = ht.get_config()['transformers']['person']
'Tim Berners-Lee': 'Amber Lee',
'Ada Lovelace': 'Christopher Brown',
'Grace Hopper': 'Amanda Jackson'