Yifan Yang
Yifan Yang
# Environment ## AUT - Spark 3.0.0 - Scala 2.12.10 - OpenJDK 64-Bit Server VM, Java 11.0.7 ## ArchiveSpark - Spark 2.4.6 - Scala 2.11.12 - OpenJDK 64-Bit Server VM,...
@lintool I think that should mute the issue but going forward we might want better payload handling per described https://github.com/archivesunleashed/aut/issues/494 ArchiveSpark's `sparkling` lib dodges this issue by having the [`payload`](https://github.com/helgeho/ArchiveSpark/blob/master/src/main/scala/org/archive/archivespark/sparkling/warc/WarcRecord.scala#L52)...
@lintool Would love to! Working on one now. Looking back at the original issue though, it appears to me that https://github.com/archivesunleashed/aut/issues/317#issuecomment-648574293 and the original issue https://github.com/archivesunleashed/aut/issues/317 could be two distinct...