Elly.jl
Elly.jl copied to clipboard
JuliaParallel
Hadoop HDFS and Yarn client
This allows to get updates for GitHub actions automatically. I have used this for my own packages, the [Trixi.jl framework](https://github.com/trixi-framework), and the [SciML organization](https://github.com/SciML). After merging this, you could also...
Elly tries to access the internal Base method Base.write_sub in rpc.jl:861 This leads to an UndefVarError in julia 1.7.2: ``` ERROR: UndefVarError: write_sub not defined Stacktrace: [1] getproperty @ ./Base.jl:35...
Great package! the tutorial on hdfs just mentions that you can work with it distributedly, however the example stays a bit cryptic ``` julia> hdfs_blocks(huge_file) 1-element Array{Tuple{UInt64,Array},1}: (0x0000000000000000, AbstractString["node1"]) (0x0000000007d00000,...
I can see the files using `hadoop fs -ls` but not using `readdir`. Trying to create a file reference for a file I know to exist using `HDSFFile` and then...
In the example for the yarn cluster manager, I get a timeout when launching the workers. How can I find out why they are failing to launch in order to...
When trying to start the Julia cluster manager on a MapR Yarn cluster I get the following error: ERROR: Elly.HadoopRpcException(2,"DIGEST-MD5: digest response format violation. Mismatched URI: default/; expecting: null/default") in...
Hi there, I'm running a hadoop cluster (v3.2.1) using https://github.com/big-data-europe/docker-hadoop I can run a **Java** program to test the existence of an file on the hdfs of the cluster. But...
