Ying Chen

Thanks @B-Step62! I renamed the existing variables / file names to be `llm_inference_xxx` and moved the utility function and constants to the `llm_inference_utils.py` file.

Thank you @B-Step62! I'll make sure to address those in follow-ups. 1. Absolutely, we haven't implemented any of the input preprocessing yet, including several main items which I will add...

If you would like to pass in a Spark dataframe, `dataset = Dataset.from_spark(df)` looks good to me. Regarding the `PySparkRuntimeError`, are you running the code in Databricks? It shall set...