knit

knit copied to clipboard

Permission Denied when writing to HDFS

12

I am trying out a basic 'distributed "Hello World" ' job using Dask on a YARN cluster. Basically I am reading some data from HDFS, mapping some columns and then...

yuriy-davygora

Always set KNIT_LANG, even if envvars passed in

2

jcrist

bypass java

5

The YARN [REST API](https://hadoop.apache.org/docs/stable/hadoop-yarn/hadoop-yarn-site/ResourceManagerRest.html) appears complete enough that, if we can use hdfs3 to manage file-based resources (i.e., a minimal python) and create tokens, the client and AM could both...

martindurant