Hagen Hoferichter

Interesting. I actually never tried to use the `localhost:8888/proxy/4040/` variant in the container assuming it just makes sense on the hub. I just used port forwarding to check whether the...

Looks like the Url can be changed with [`SPARK_PUBLIC_DNS`](https://github.com/apache/spark/blob/5264164a67df498b73facae207eda12ee133be7d/core/src/main/scala/org/apache/spark/ui/WebUI.scala#L54). I tried it and changed it to `/hub/user//proxy/4040/jobs/`. This changes the `sc.uiWebUrl` to `/hub/user//proxy/4040/jobs/:4040` resulting in a link that is actally...

On my Jupyterhub deployment I have to configure it as `conf.set('spark.ui.proxyBase', '/user//proxy/4040')` but then it works as well!

@consideRatio Yes, the overview sums it up pretty good. Using the pre_spawn_hook is what I currently do to use a specific image per user. So the users are free to...

@dswah I highly recommend focusing on joblib for parallelism! IT is supported by the whole pydata stack and Dask ist able to provide a backend for joblib. Ergo using joblib...

@dswah It should not be necessary as far as I understand it. The usage of Parallel and delayed from joblib should be sufficient when dask is used as backend. Dask...

Poetry as package manager: `from modAL.models import ActiveLearner` -> `ModuleNotFoundError: No module named 'modAL'` `from modal.models import ActiveFeedback` -> ``` 3 import numpy as np ----> 4 from modAL.acquisition import...

I think the problem is that Bert is not really good at making sense of numbers in general. We have quite a similar use case and use the search just...

If scaling is unclear you can just use Reciprocal Rank Fusion. This only takes the generated ranking into account so there is no need for some kind of normalization. Convex...

@ian-andrich https://reflex.dev/docs/ works