sparkOptics

sparkOptics copied to clipboard

Execution slows down after 3 modifications of complex structure.

2

I am trying to modify multiple values in a complex DF. I have copied the relevant parts below. df.printSchema root ..|--eventData ........|--stringVals ............|--idNumber ............|--firstName ............|--secondName ............|--email ............|--phone ............|--age ............|--dob ..|--idNumber...

chethan1212