Model Performance Signal (Preview) | Model Monitor - Data Joiner | error:" join column 'correlationid is not present in left_input data.

Question

Greetings,

I am working on my MLOps project and have been trying to use the Azure ML "model performance" monitoring function to detect the model's degradation.

Left_input_data is the deployed model's inference output data, which were collected as data assets in the AML blob by enabling the data collector, as shown below.

The right_input_data is the ground truth data uploaded from my local. The format can be seen below.

The image below is the configuration of the monitoring signal.

After the error ("join column 'correlationid is not present in left_input data.") occurred, I tried to troubleshoot it and found out that the output of the preprocessing job between the left and right side was different. The correlationid column was somehow missing. As shown in the image below. (column name 0)

How could I solve this issue, because the left_input_data that are currently having the problem was collected and recorded automatically by the data collector. I got it from testing the endpoint of the model.

And if the error was caused by the wrong format or wrong signal config, would the error not occurred since the preprocessing job?

PS. The correlationid between the left and right input are matched as the right input were made up by me.

Thank you for your time and every effort in helping me,
Boon Hawaree