hdfs
hdfs copied to clipboard
mtth
API and command line interface for HDFS
I wanted to authenticate myself as an other user with a keytab on Windows, but the requests-kerberos package cannot use the krb5 credential cache (and it's using SSPI, not GSSAPI)...
my client can use namenode(like mkdir or ls), but cannot use datanode,(like download or upload), my network work right this python code run right in centos and ubuntu，but failed with...
Hello. The three links given [here](https://hdfscli.readthedocs.io/en/latest/api.html#hdfs.client.Client.set_acl) lead to nothing. These links are: https://hdfscli.readthedocs.io/en/latest/api.html#id4 https://hdfscli.readthedocs.io/en/latest/api.html#id7 https://hdfscli.readthedocs.io/en/latest/api.html#id9
``` def hdfs_copy_stream(src, dst, namenode=None): try: md5 = hashlib.md5() offset = 0 clt = get_client(src, namenode) with clt.read(src, offset=offset, chunk_size=2 ** 16) as reader: with clt.write(dst, overwrite=True) as writer: for...
``` Traceback (most recent call last): File "test2.py", line 56, in self.client.download("/user/sample/report_file/group1/M00/00/D3/上线测试_1638327036000.zip", "222333.zip", overwrite=True) File "/home/jesse/workspace/py2env/lib/python2.7/site-packages/hdfs/client.py", line 786, in download remote_paths = list(self.walk(hdfs_path, depth=0, status=False)) File "/home/jesse/workspace/py2env/lib/python2.7/site-packages/hdfs/client.py", line 1154, in...
Hi @mtth, is there any plan to support parquet data format? parquet data has schema by self . so can read parquet to pandas directly, write is same . python...
Solves the issue reported in #172 Another solution was to bound the queue, however that would be very unbalanced if the size writes were not equal. The downside of this...
Just adding an ability to pass a replication count for upload, default is preserved.
Hello fellow developers, I am a new user of the library who is in no way proficient in understanding of the intrinsics of the protocols and methods of exchanging the...
