anshmn

Extras not always returned . ( in case of floodit_basic).

1

I tried to print The extras using logging.info('***********Extras*********: %r ', env.task_extras()) in thr run_human_agent.py and found out that sometimes , it does print the corrent extras whereas quite often it...

Tensor Object not moved to GPU during Temperature sensitive decoding leading to much higher latency

1

In the guidance/models/_models.py , ```python if current_temp == 0: sampling_order = np.argsort(-logits) # we need numpy so the enumerate below does not get really slow... else: # assert top_p ==...