Matthew Kwiatkowski
Matthew Kwiatkowski
I noticed there is an unnecessary duplicate declaration of `loss_fct` [here](https://github.com/microsoft/LLMLingua/blob/bf6723c3eca3569d23c4ec367c588660dc2e65e7/llmlingua/prompt_compressor.py#L113-L120). **Relevant code:** ```python loss_fct = torch.nn.CrossEntropyLoss(reduction="none") shift_logits = response.logits[..., :-1, :].contiguous() shift_labels = input_ids[..., past_length + 1 : end].contiguous()...
## Current Behavior When running npm i on a project with nx >= 15.9.0: ``` Failed to patch Nx dep-graph for Vue support. Error: Could not find Nx's dep-graph builder...
Would it be possible to get the API to respond with CORS headers so we can use it in browser-based demos?