Chris Crutchfield
Chris Crutchfield
A typical data loading pipeline in TensorFlow using tf.data.Dataset might look something like this: ```python dataset = tf.data.Dataset.from_tensor_slices(filenames) dataset = dataset.interleave( tf.data.TFRecordDataset, num_parallel_calls=reader_num_threads) dataset = dataset.batch(batch_size, drop_remainder=True) dataset = dataset.map(...
I am using TFDV 1.2.0 and have a problem where I am consistently getting workers OOMing on Dataflow even with very large instance types (e.g. `n2-highmem-16` and `n2-highmem-32`). I've tried...
It would be good if tensorflow_io.arrow could support a [broader variety of data types](https://arrow.apache.org/docs/python/api/datatypes.html#type-classes). It seems that there is currently no support for the Binary arrow type yet. Reproducible example:...
It would be great if the `unmarshall` method propagated the message that it failed to parse in the exception, so that it can be logged upstream.
It would be good if `tensorflow_io.arrow` could support a [broader variety of data types](https://arrow.apache.org/docs/python/api/datatypes.html#type-classes). It seems that there is currently no support for the LargeList arrow type yet. Reproducible example:...
It seems `django-uuidfield==0.4.0` on PyPI is an older version of the code here.