sagemaker-python-sdk icon indicating copy to clipboard operation
sagemaker-python-sdk copied to clipboard

TensorFlow with Pipe mode example code might be wrong

Open mchoi8739 opened this issue 3 years ago • 1 comments

What did you find confusing? Please describe. I'm documenting file mode and storage options for SageMaker training. https://sagemaker.readthedocs.io/en/stable/frameworks/tensorflow/using_tf.html?highlight=input%20mode#training-with-pipe-mode-using-pipemodedataset This page provides an example of Pipe mode, and I see PipeModeDataset is used in the training script. However, I cannot find this class in the doc and source code. I also it's imported from sagemaker_tensorflow, which seems not existing either.

Can some clarify if this class does not exist, and if so, would you remove the related portion from the page?

mchoi8739 avatar Jun 04 '22 00:06 mchoi8739

Hi, the class definitely exists I'm using it in all my training jobs. Don't know where the docs are but it's definitely working because my 'training data download' stage is <1 mins for gigs of data

jonathanhillwebsite avatar Jun 07 '22 16:06 jonathanhillwebsite