dataflow detailed log

Question

Hi,

one of the Azure data factory pipeline failed with this error. where can we find the more detailed information like in which rows of the source file we have issues.

{"message":"at Source 'source1': Column 'int_col has incompatible types( Found: StringType, Required: IntegerType). Details:at Source 'source1': Column 'int_col has incompatible types( Found: StringType, Required: IntegerType)","failureType":"UserError","target":"df_all_types_poc","errorCode":"DFExecutorUserError"}

Thanks,
Saikumar

Answer 1

Hi @saikumarellendula-8111, | Could you please tell us what is your source file type? What data type schema indicate in dataflow for Column 'int_col'?

At the moment there is no other way to find more detailed information of the exact row where the issue is. But internal source confirmed that ADF engineering team is working on some improvements that may address this requirement.

I would also suggest you to please share your feedback in ADF user voice forum and share the suggestion link here: https://feedback.azure.com/forums/270578-data-factory/

Or you could also provide a feedback directly from ADF portal as shown below to improve ADF product better.

---

Thank you

Please do consider to click on "Accept Answer" and "Up-vote" on the post that helps you, as it can be beneficial to other community members.