RowsWritten from data flow in log analytics

Adeleke Abimbola 231 Reputation points
2021-09-28T07:13:57.18+00:00

I was recently able to get the rowsCopied and rowsRead from a pipeline copy activity in log analytics....I'm trying to get the rowsWritten from the pipeline dataflow activity but I'm not getting any input.
Is this even logged in log analytics? and if it is, how can I get it?

Azure Monitor
Azure Monitor
An Azure service that is used to collect, analyze, and act on telemetry data from Azure and on-premises environments.
3,331 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,896 questions
Azure Data Lake Analytics
0 comments No comments
{count} votes

Accepted answer
  1. HimanshuSinha-msft 19,476 Reputation points Microsoft Employee
    2021-09-28T21:52:27.853+00:00

    Hello @Adeleke Abimbola ,
    Thanks for the ask and using Microsoft Q&A platform .
    Thanks for correcting me on the other thread , which kind of motivated me to dig more .

    Yes it is logged , I used a MDF to copy data from blob to blob . amd the below query helped me out to get the rowcount .

    ADFActivityRun
    |extend d=parse_json(Output)
    |extend rowsWritten=d.runStatus.metrics.sink1.rowsWritten
    |extend duration_value=d.runStatus.metrics.sink1.sources.Blob.rowsRead
    |where OperationName in ('Data flow1 - Succeeded')

    136016-image.png

    Please do let me know how it goes .
    Thanks
    Himanshu

    -------------------------------------------------------------------------------------------------------------------------

    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
    • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators
    1 person found this answer helpful.

1 additional answer

Sort by: Most helpful
  1. Adeleke Abimbola 231 Reputation points
    2021-09-29T07:21:57.903+00:00

    Thank you @HimanshuSinha-msft , this worked for me. I was able to get the information I needed from the DataFlow activity. Thank you very much.

    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.