Parallel run example fail when executing with deserialization error

[suparno89]

I am trying to run a python script on multiple data inputs parallel, for this i am using the batch processing examples provided in this repo. Specifically I am looking at this one: https://github.com/Azure/MachineLearningNotebooks/blob/master/how-to-use-azureml/machine-learning-pipelines/parallel-run/file-dataset-partition-per-folder.ipynb

Running the exact same script initially generates a lot of value error saying "This pipeline didn't have the RawDeserializer policy; can't deserialize" (screenshot 1) and finally raises the Image build failed error (screenshot 2). I cannot find anything at the logfile mentioned in the error code. I have tried using the same environment from my azureml vm but that also didn't help.

Can someone kindly help?

[suparno89]

I believe this is similar to the issue: Azure/azure-sdk-for-python#34915

Only one curated environment works here which is: AzureML-ACPT-pytorch-1.13-py38-cuda11.7-gpu