Specification
Imported metadata
Dataedo reads following metadata from Google BigQuery databases.
| Imported | Editable | |
|---|---|---|
| Tables, External tables | ✅ | ✅ |
| Columns | ✅ | ✅ |
| Primitive columns | ✅ | ✅ |
| Nested columns (Records) | ✅ | ✅ |
| Repated columns | ✅ | ✅ |
| Data types with length | ✅ | ✅ |
| Nullability | ✅ | |
| Column comments | ✅ | ✅ |
| Table comments | ✅ | ✅ |
| Foreign keys | ✅ | |
| Primary keys | ✅ | |
| Unique keys | ✅ | |
| Views | ✅ | ✅ |
| Script | ✅ | ✅ |
| Columns | ✅ | ✅ |
| Primitive columns | ✅ | ✅ |
| Nested columns (Records) | ✅ | ✅ |
| Repated columns | ✅ | ✅ |
| Data types with length | ✅ | ✅ |
| Nullability | ✅ | |
| Column comments | ✅ | ✅ |
| View comments | ✅ | ✅ |
| Stored procedures | ✅ | ✅ |
| Script | ✅ | ✅ |
| Parameters | ✅ | ✅ |
| Procedures comments | ✅ | ✅ |
| User-defined Functions | ✅ | ✅ |
| Script | ✅ | ✅ |
| Input arguments | ✅ | ✅ |
| Output results | ✅ | ✅ |
| Languages | ✅ | ✅ |
| Function comments | ✅ | ✅ |
| Shared metadata | ||
| Dependencies | ✅ | ✅ |
| Created time | ✅ | |
| Last updated time | ✅ |
Supported features
| Feature | Imported |
|---|---|
| Import comments | ✅ |
| Write comments back | |
| Data profiling | ✅ |
| Reference data (import lookups) | ✅ |
| Generating DDL | ✅ |
| FK relationship tester |
Comments
Dataedo reads comments from following Google BigQuery objects:
| Object | Read | Write back |
|---|---|---|
| Table comments | ✅ | |
| Column comments | ✅ | |
| View comments | ✅ | |
| Columns | ✅ | |
| Function comments | ✅ | |
| Stored procedures | ✅ |
Data profiling
Datedo supports following data profiling in Google BigQuery:
| Profile | Support |
|---|---|
| Table row count | ✅ |
| Table sample data | ✅ |
| Column distribution (unique, non-unique, null, empty values) | ✅ |
| Min, max values | ✅ |
| Average | ✅ |
| Variance | ✅ |
| Standard deviation | ✅ |
| Min-max span | ✅ |
| Number of distinct values | ✅ |
| Top 10/100/1000 values | ✅ |
| 10 random values | ✅ |
Read more about profiling in a Data Profliling documentation.
Limitations
Following schema elements currently are not supported:
- Labels
- Friendly names
- Table partitions
- Jobs
- User-defined temp Function