How to make existed snappy compressed file compatible with hadoop?
I have output some snappy compressed file, and I need to read them via Spark. It seems the snappy file made by SnappyFramedOutputStream cannot be read by hadoop. So can I convert them to satisfied with the hadoop snappy codec?
See the compatibility note here: https://github.com/xerial/snappy-java#compatibility-notes
We can use SnappyHadoopCompatibleOutputStream to generate Hadoop Snappy compatible compressed stream.
Hi, thanks. But for existed snappy file generated by SnappyFramedOutputStream, how can I make it available for haddop?
And I found another question, I cannot find isOpen() method in SnappyFramedOutputStream. Even though I can implement it in other ways, but it is better to include it in the SnappyFramedOutputStream itself.