Erich Wellinger

Would this involve refactoring the documentation to coincide with PySpark conventions _within_ this repo, or is this more closely related to issue #14 and creating this documentation in a Sphinx...

Gotcha. Yeah, that looks good to me! At first I thought this was related to redesigning the README as opposed to bringing the docstrings inline with the PySpark public interface.

This might need to be tweaked somewhat, but I created this helper function that roughly follows the logic you're suggesting here: ```python import json from pathlib import Path from altair...

Dropping a comment in case anyone else happens to stumble across this thread. ~~The suggestion to use `asyncify` unfortunately didn't work.~~ It appeared to be functional under low concurrency loads,...

Turns out that may not have been correct. After a lot of frustration it appears that the errors that were getting generated were actually coming from the Sagemaker endpoint (which...

I haven't, I only realized what was happening pretty late last night. We're hitting these endpoints for LLM predictions so the latency is already pretty high and I'd imagine the...

Just a really quick and dirty comparison between the two implementations. This was hitting a LLM with 20 total requests, running 5 requests concurrently at a time. This was leveraging...

I'm not terribly hopeful that this will be implemented in a timely manner. My company has priority support and I raised a support ticket to have them respond to this...