Note
Access to this page requires authorization. You can try signing in or changing directories.
Access to this page requires authorization. You can try changing directories.
The data pipeline copy activity fails when copying data from Azure Blob Storage to a Data Warehouse with staging enabled. Since staging is enabled, the copy activity uses parquet as the staging format; however, the parquet string type can't be copied into a decimal type in the data warehouse.
Status: Open
Product Experience: Data Factory
Symptoms
The pipeline copy activity fails with and error similar to: ErrorCode=DWCopyCommandOperationFailed,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message='DataWarehouse' Copy Command operation failed with error ''Column '' of type 'DECIMAL(32, 6)' is not compatible with external data type 'Parquet physical type: BYTE_ARRAY, logical type: UTF8', please try with 'VARCHAR(8000)'.
Solutions and workarounds
To work around this issue: First, copy the data into the lakehouse table with decimal type. Then, copy the data from the lakehouse table into to the data warehouse.