All Use Cases
Connection requirements
To connect to Snowflake you need to install ODBC connector:
https://docs.snowflake.net/manuals/user-guide/odbc-download.html
Connecting to Snowflake
To connect to Snowflake create new documentation by clicking Add documentation and choosing Database connection.
On the connection screen choose Snowflake as DBMS.
Select authentication mode:
- Password - you will need to provide username and password.
- SSO (browser) - Dataedo will open web browser to let you authenticate with Okta.
- JWT (private key) - authentication with a private key. Learn more
Provide database connection details:
- Host - provide a host name or address where a database is on. E.g. server17, server17.ourdomain.com or 192.168.0.37.
- Port - change the default port of Amazon Redshift instance if required
- User and password - provide your username and password
- Database - type in schema name
Here is a comparison with connection details in DBeaver.
Saving password
You can save password for later connections by checking Save password option. Password are saved in the repository database.
Importing schema
When connection was successful Dataedo will read objects and show a list of objects found. You can choose which objects to import. You can also use advanced filter to narrow down list of objects.
Confirm list of objects to import by clicking Next.
Next screen with allow you to change default name of the documentation under with your schema will be visible in Dataedo repository.
Click Import to start the import.
When done close import window with Finish button.
Your database schema has been imported to new documentation in the repository.
Importing changes
To sync any changes in the schema in Snowflake and reimport any technical metadata simply choose Import changes option. You will be asked to connect to Snowflake again and changes will be synced from the source.
Specification
Imported metadata
| Imported | Editable | |
|---|---|---|
| Tables, External tables | ✅ | ✅ |
| Columns | ✅ | ✅ |
| Data types | ✅ | ✅ |
| Nullability | ✅ | |
| Column comments | ✅ | ✅ |
| Table comments | ✅ | ✅ |
| Foreign keys | ✅ | ✅ |
| Primary keys | ✅ | ✅ |
| Unique keys | ✅ | ✅ |
| Views | ✅ | ✅ |
| Script | ✅ | ✅ |
| Columns | ✅ | ✅ |
| Data types | ✅ | ✅ |
| Column comments | ✅ | ✅ |
| View comments | ✅ | ✅ |
| Stored procedures | ✅ | ✅ |
| Script | ✅ | ✅ |
| Parameters | ✅ | ✅ |
| User-defined Functions | ✅ | ✅ |
| Script | ✅ | ✅ |
| Input arguments (all as a single field) | ✅ | ✅ |
| Output results (as a single field) | ✅ | ✅ |
| Function comments | ✅ | ✅ |
| Stages | ✅ | ✅ |
| Location | ✅ | ✅ |
| Stage comments | ✅ | ✅ |
| Pipelines | ✅ | ✅ |
| Script | ✅ | ✅ |
| Pipeline comments | ✅ | ✅ |
| Shared metadata | ||
| Dependencies | ✅ | ✅ |
| Created time | ✅ | |
| Last updated time | ✅ |
Comments
Dataedo reads comments from following Snowflake objects:
| Object | Read | Write back |
|---|---|---|
| Table comments | ✅ | |
| Column comments | ✅ | |
| View comments | ✅ | |
| Columns | ✅ | |
| Function comments | ✅ |
Data profiling
Datedo supports following data profiling in Snowflake:
| Profile | Support |
|---|---|
| Table row count | ✅ |
| Table sample data | ✅ |
| Column distribution (unique, non-unique, null, empty values) | ✅ |
| Min, max values | ✅ |
| Average | ✅ |
| Variance | ✅ |
| Standard deviation | ✅ |
| Min-max span | ✅ |
| Number of distinct values | ✅ |
| Top 10/100/1000 values | ✅ |
| 10 random values | ✅ |
Data Lineage
| Source | Method | Status |
|---|---|---|
| Views - object level | From dependencies | ✅ |
| Views - object level | From SQL parsing | TBD |
| Views - column level | From SQL parsing | TBD |
| External tables (Azure, AWS) | TBD | TBD |
| External tables (Azure, AWS) - Stages | From SQL parsing | ✅ |
| Stages - Pipelines | From SQL parsing | ✅ |
| Tables - Pipelines | From SQL parsing | ✅ |
| Tables - COPY INTO | TBD | TBD |
| Tables - from Kafka | TBD | TBD |
| dbt | dbt connector | ✅ |
Known limitations
- Snowflake’s
INFORMATION_SCHEMAcurrently doesn’t contain data on object dependencies. Information about dependencies is retrieved from theSNOWFLAKE.ACCOUNT_USAGE.OBJECT_DEPENDENCIESview. By default, theSNOWFLAKEdatabase is available only to theACCOUNTADMINrole. Read more about Enabling Snowflake Database Usage for Other Roles.
Due to Snowflake Connector for .NET limitations:
- Username and password
- Cannot contain ; and = characters
- Database, role and warehouse name
- Cannot contain ; and ‘ or \ characters