Shanmugavel comments

Repositories
Issues
Comments

Results 3 comments of


                                            Shanmugavel

Facing when trying to import SparkAI from pyspark

@gengliangwang - is it `%sh pip install **pyspark-ai** %python from **pyspark_ai** import SparkAI` attached the stack trace. [english_sdk_dataclass_transform.txt](https://github.com/databrickslabs/pyspark-ai/files/11918903/english_sdk_dataclass_transform.txt)

Chapter 7 Wrong code in the window function example

@xuewei4d ===> I ran the below command - dfWithDate.printSchema() resulted in Quantity as an IntegerType root |-- InvoiceNo: string (nullable = true) |-- StockCode: string (nullable = true) |-- Description:...

Ch9 - Writing to SQL database - SQLException: [SQLITE_ERROR] SQL error or missing database (no such table: flight_info)

I think SQLite will not necessarily work well in a distributed setting because of its requirement to lock the entire database on write. could you please confirm my understanding?