Need to add ignore null or empty text during korean text process

[Taekyoon]

Agenda

• Some raw datasets can have empty or null text.
• Using filter method in RDD or DF, text like "" need to be ignored during this process.

How to solve this problem?

• Add filter method after load the data
• Add condition if the text data is null or empty in filter method