In Azure ML Pipeline, unable to train the model with large dataset

Question

I want to train the model with binary logistic regression model,with a dataset of 3000 data points. while creating the pipeline , it fails at the training model step.

Please help me to train the model with large datasets or retrain the model continously.

Answer 1

Hi,

I haven't seen there is a limitation for training dataset size. May I know how you do the pipeline? If you are using Azure Machine Learning Designer, could you please try the enterprise version? https://learn.microsoft.com/en-us/azure/machine-learning/concept-ml-pipelines#building-pipelines-with-the-designer

Also, I have attached a tutorial here for large data pipeline: https://learn.microsoft.com/en-us/azure/machine-learning/tutorial-pipeline-batch-scoring-classification

Please let me know more details (like the error message )about your issue if above not solved your problem.

Regards,
Yutong