Jay
Jay
Run ``` rm -fr target Cargo.lock cargo check ``` and then `cargo run --release`
Getting two separate issues on dual 5090. One without tensor parallelism ``` from vllm import LLM, SamplingParams # Sample prompts prompts = [ "The future of AI is"] # Configure...
@shahizat do you think that's what's causing my errors?
thanks @shahizat! Turns out that they released the python library as well so no need to compile. Which model are you using it with? I'm still getting an illegal memory...
Thanks! I'll try it out. To elaborate on my application: 1. I have a computer that has AP that is receiving pings from ESP32-S3 for CSI 2. ESP32-S3 is also...
use the tag 0.1.9
Thanks for clarifying @mlourencoeb, I read that these databases were open-source in the training instructions and just assumed they are good for commercial use Do you know of any commercial-use...