chunjun
chunjun copied to clipboard
[Question][kafka to hive] kafka读取数据写入hive,什么时候临时文件写到表目录
Search before asking
-
[x] I had searched in the issues and found no similar question.
-
[x] I had googled my question but i didn't get any help.
-
[x] I had read the documentation: ChunJun doc but it didn't help me.
Description
kafka stream to hive, modify maxFileSize=3M, many tmp files are created in pt=date/.data directory, when the process move these tmp file from tmp directory (pt=date/.data) to real (pt=date) directory
Code of Conduct
- [X] I agree to follow this project's Code of Conduct