Metadata Spec
Last updated
Last updated
Metadata is a description of the dataset you want to synthesize. This could be one or multiple data tables. Metadata includes the names of tables, columns, data types in each of the columns, and relationships.
For example, your data may look like this:
Click below to see the metadata description for this dataset:
All SDV synthesizers frequently refer to metadata as the ground truth whenever they are creating or evaluating synthetic data. For high quality synthetic data generation, it's vital that your metadata accurately describes the data.
See metadata in action! Your data may have a column containing values such as 94102
, 94130
and 94702
. What should SDV learn about this data in order to create synthetic data?
If the metadata specifies the data is numerical, SDV learns these values on a sliding number scale. But if the metadata specifies the data actually represents concepts such as postal codes, SDV can better ensure your synthetic data will be valid.
SDV allows you to auto-detect metadata based on your data. Please spend some time inspecting and updating your metadata to ensure it accurately describes your data.
Click the links below to get started with metadata.
Learn SDV's system for keeping track of data types for each column.
Use Python to auto-detect, inspect, and update metadata.
This is the final format that your metadata will be saved as.