James Aley

Yeah, the issue is that I can't tell whether the job exited (successfully or not) and therefore the correct client action is to shutdown the cluster, or whether there was...

Hmm OK, so if it's deliberate it might just be worth flagging on release for other users. We can probably work around it until we redeploy with the next release.

Hmm... so I ran a profiler over cloc and I'm not seeing any obvious explanations. Here's what happens: Cloc runs two subprocesses. The first is configured to use exactly your...

I've had a look through the above suggestions and analysis. My 2c: * It looks like there's some low-hanging fruit in Simon's suggestions above, which may deliver as much of...

What version was this observed in? I contributed a patch that was merged back in April to make `spark-avro` observe the same property that the underling Hadoop InputFormat checks for:...

@JoshRosen Sorry, nope, no test that I'm aware of. My patch didn't add one at least. @mkanchwala Perhaps try building a snapshot from master to see if you get the...

I just found that the remaining confusion I was having was coming from the AvroInputFormat itself, so thought I'd add a comment here in case anyone else has the same...