Delta Lake
Dataedo 9.3 added support for Delta Lake files. Dataedo scans Delta Lake file and builds a structure that includes:
- Primitive data type fields
- Nested structs
- Arrays
- Maps
Each field contains:
- Name
- Data type
- Nullability
To add Delta Lake file:
- Right-click on any database or Structures folder, choose Add Object, then Add/Import Structure, or
- On the main ribbon select Add Object then Structure/File, or
- Select Structures folder and on the main ribbon select Add Structure/File.
Then select Import from file and Delta Lake format. To read the file, point to a Delta Lake catalog on the disk and click Next. This will scan the content and open Structure designer with a parsed structure. You can use this window to edit names, data types and field types and save with Save button.
If Delta Lake catalog contains partitions Dataedo will select the partition with the last modification date and show the name of the partition in the Location box. Name of the documentation will remain the name of the Delta Lake catalog.
If there are no partitions, Location will point to the selected Delta Lake:
