Ben Steel

Results 26 comments of Ben Steel

Thanks for the clarification! Could it maybe be indicated to new users in the Analytics-Zoo readme that this is taking place? Might avoid new users committing to Analytics-Zoo rather than...

Doesn't seem like these scores are currently used for Optuna optimization: https://github.com/stanfordnlp/dspy/blob/a102f3aba3aa02ed7db5d468ef1c3d463c97710b/dspy/teleprompt/teleprompt_optuna.py#L43 I would also love to see entire devset metrics be defineable for optimization, so that for example I...

That there's an issue in HFModel. If that's the case I can accept that! Will maybe make a PR with my local changes to get it usable.

Both of these examples are currently working for me! Unfortunately due to the nature of this library, errors will heavily vary by location and network conditions. I would encourage you...

This is happening because there are not enough checks on the video method to ensure the number of videos returned is at or below the count number. I don't have...

Hi, so sorry I didn't see this for a while! I'll have to take a look into this, when I last set the dependency versions Python 3.7 was a required...

Hey, I've seen this happen occasionally before but generally it's not a persistent issue for me, i.e. sometimes I get a login prompt, but only for the occasional request, and...

Thanks for the extra info! What country are you making these requests from? I ask because it may help me reproduce the issue.