spark-csv icon indicating copy to clipboard operation
spark-csv copied to clipboard

report the error as well as the line that caused it

Open abridgett opened this issue 9 years ago • 3 comments

I don't know Scala (at all!) so there's almost certainly cleaner ways - my apologies. The logging at the moment is sometimes unhelpful as it's hard to see the real issue - with DROPMALFORMED you see the line, with another parsing mode you get the error but not the line.

abridgett avatar Feb 09 '16 17:02 abridgett

For me I think this is reasonable because I sometimes see some users have some difficulties to find out why it was dropped or malformed.

HyukjinKwon avatar Feb 11 '16 03:02 HyukjinKwon

Current coverage is 85.86%

Merging #258 into master will decrease coverage by -0.21% as of 26a1447

@@            master    #258   diff @@
======================================
  Files           12      12       
  Stmts          517     552    +35
  Branches       149     160    +11
  Methods          0       0       
======================================
+ Hit            445     474    +29
  Partial          0       0       
- Missed          72      78     +6

Review entire Coverage Diff as of 26a1447

Powered by Codecov. Updated on successful CI builds.

codecov-io avatar Feb 11 '16 08:02 codecov-io

Thanks Hyukjin, I've fixed that overlong line

abridgett avatar Feb 11 '16 09:02 abridgett