Apache Parquet support

31st August, 2021
Applies to: 9.x (current) versions, Article available also for: 10.x

Dataedo 9.3 added support for Parquet files. Dataedo scans Parquet file and builds a structure that includes:

  • Primitive data type fields,
  • Nested structs,
  • Arrays,
  • Maps

Each field contains:

  • Name,
  • Data type,
  • Nullability.

To add Parquet file:

  • right click on any database or Structures folder, choose Add Object, then Add/Import Structure, or
  • on main ribbon select Add Object then Structure/File, or
  • select Structures folder and on main ribbon select Add Structure/File.

Then select Import from file and PARQUET format. To read the file, point to a PARQUET file on the disk and click Next. This will scan the content and open Structure designer with a parsed structure. You can use this window to edit names, data types and field types and save with Save button.

Parquet Structure Designer

Guide: Adding files to the catalog

Found issue with this article? Comment below
0
There are no comments. Click here to write the first comment.