Saaketh Ch

Beautiful Repo! AI at its finest ! (Enchancement) pydantic support for plugins

1

Could we have pydantic support for a plugin to support custom object types? returns: - name: df type: DataFrame description: >- This DataFrame extends the input DataFrame with a newly-added...

GPU Inferencing using GGML

1

**Is your feature request related to a problem? Please describe.** No problems, Would be much better if we have a gpu inference run time as it will be much much...

Keep getting this error on local docker run for a local mistral model

7

 using this CHECKPOINT = "mistralaiprivate\Mistral-7B-Instruct-v0.1" class Model: def __init__(self, **kwargs): self._model = None def load(self): self._model = pipeline( "text-generation", model=CHECKPOINT, torch_dtype=torch.bfloat16, device_map="auto", ) where mistralaiprivate is the...