Chris Fregly
Chris Fregly
@Euraxluo Can you share how you solved the cross-domain problem in this case, specifically?
Cool. we ended up hacking it here: https://github.com/data-science-on-aws/workshop/blob/a7c5603/10_pipeline/01_Create_Pipeline_Train_and_Deploy_Reviews_BERT_TensorFlow.ipynb (search for `TrainingPipelineWithDifferentDeployInstanceType`)
``` root@jetson:/# ls -al /opt/local_llm/local_llm/ ``` ``` total 84 drwxr-xr-x 1 root root 4096 Mar 15 14:52 . drwxr-xr-x 1 root root 4096 Mar 14 00:01 .. -rw-rw-r-- 1 root...
i manually copied from here: https://github.com/dusty-nv/jetson-containers/tree/7bf8827/packages/llm/local_llm and now it works. does this image need to be rebuilt? or should I switch to a different image? concerned that other stuff might...
@ALIRAZA17 would you mind generalizing this to any binary content? ie. PDF's, etc?
* Are you running this locally or is it a hosted version ? "locally" on an EC2 instance server: http://X.X.X.X * What browser/OS combination are you using ? Chrome/MacOS (client),...
for now, i just had to hard-code as follows: ``` $ git diff src/lib/types/Settings.ts diff --git a/src/lib/types/Settings.ts b/src/lib/types/Settings.ts index 86915ee..b04fdb1 100644 --- a/src/lib/types/Settings.ts +++ b/src/lib/types/Settings.ts @@ -19,5 +19,7 @@ export...
```InferenceOutputError: Invalid inference output: Expected Array. Use the 'request' method with the same parameters to do a custom call with no type checking. at Proxy.textGeneration (file:///home/ubuntu/chat/node_modules/@huggingface/inference/dist/index.mjs:460:11) at process.processTicksAndRejections (node:internal/process/task_queues:95:5) at...
* Did you setup your own SERPAPI_KEY env variable in your .env.local ? yes, and i restarted Are you using a custom MODELS env variable ? yes: ``` MODELS=`[ {...