Infer parquet schema to create table in SQL pool

Question

hi,

I am evaluating Synapse analytics (in preview) and need to create tables in Synapse sql pool from parquet files, stored in ADLS gen2.

I would like to avoid creating tables manually in sql pool as my parquet files already have a schema with column names and data types.

SQL-on-demand does a great job by inferring parquet schema but I do not see how i can use this feature to create a table in Synapse as OPENROWSET command is only supported by SQL-on-demand.

I also tried new COPY INTO command but it does require me to create a target table upfront and provide DDL for all column names and data types (which is exactly what I am trying to avoid).

What is the best way to infer parquet schema from ADLS files and to create a table in sql pool without defining table upfront?

Thanks!

Answer 1

Hello @Boris Tyukin ,

Thanks for the question and using the forum .

At this time the copy command does not have a feature to auto create the the table , internal team is working on that and it should be out in near future .

I suggest you to use the and create a pipeline , in the pipeline we do have an option of "Auto create table" and it should help you .

Thanks & stay safe
Himanshu
Please do consider to click on "Accept Answer" and "Up-vote" on the post that helps you, as it can be beneficial to other community members