Arthur Clerc-Gherardi

Hello, running into the same problem too: pyspark==3.2.1 pytest==7.1.1 pytest-cov==3.0.0

Hi Ned, sorry for the lack of info. I fastly made a repo to reproduce the lack of coverage on UDFs. https://github.com/RaccoonForever/py-cov-potential-issue Don't look at code, it was just to...

Does someone have a workaround ? :'(

I totally understand :) ! I thought it could be useful for some people. Nevertheless, I totally agree that there are more important features for now :D If you want,...

Hey @SkalskiP I did a tool in python to do what I asked you in this issue :). It doesn't handle VGG for now, but single CSV file and VOC...

Hey guys, have the same problem. If we install it directly on the cluster we have another error due to arguments wrong that are applied to python and not pytest....

It might be a misunderstanding from me that when specifying a policy name or id it is not inheriting from the policy the configuration. We have to make it compliant...

I made it work using the following parameter: `apply_policy_default_values: true` Like this: ``` sp-basic-cluster-props: &sp-basic-cluster-props policy_id: "cluster-policy://XXXX" spark_version: "10.4.x-scala2.12" num_workers: 0 node_type_id: "m5a.large" aws_attributes: zone_id: "auto" availability: "ON_DEMAND" spark_conf: spark.master:...

I'll try to write the specific failing execution next week ! My trouble was specifically about spark_conf as you said @copdips and not init_scripts :) I'll do my best to...

Hello, I managed to install everything but got the same problem :) Did you find any solution ?