chunjun icon indicating copy to clipboard operation
chunjun copied to clipboard

[Question][kafka to hive] kafka读取数据写入hive,什么时候临时文件写到表目录

Open chenghb606 opened this issue 3 years ago • 0 comments

Search before asking

  • [x] I had searched in the issues and found no similar question.

  • [x] I had googled my question but i didn't get any help.

  • [x] I had read the documentation: ChunJun doc but it didn't help me.

Description

kafka stream to hive, modify maxFileSize=3M, many tmp files are created in pt=date/.data directory, when the process move these tmp file from tmp directory (pt=date/.data) to real (pt=date) directory

Code of Conduct

chenghb606 avatar Sep 21 '22 08:09 chenghb606