CopilotChat.nvim icon indicating copy to clipboard operation
CopilotChat.nvim copied to clipboard

perplexityai agent not working well

Open xuyangyuio opened this issue 11 months ago • 4 comments

The perplexityai agent can't search the internet.

It uses only the pre-trained info: Image

It can help with local code: Image

It can not search the internet:

Image

xuyangyuio avatar Mar 25 '25 10:03 xuyangyuio

I dont think this is plugin issue but I can double check if its using correct endpoint. Have you tried using empty system prompt? Because otherwise the perplexity agent lives elsewhere and has its implementation elsewhere

deathbeam avatar Mar 25 '25 10:03 deathbeam

Thanks for the quick reply. I tried with empty system prompt, then, instead of "I can't assist with that", perplexityai still reponded with something like "I currently don't have information about GitHub features introduced in 2025, as my knowledge cutoff is October 2023. To stay updated on GitHub's latest features, you can check their official blog or release notes:"

Can it be authentication problem? I am asking because even if I revoke the perplexityai authorization in GitHub, perplexityai agent still "works", i.e. give response related to local code, but has a knowledge cutoff of 2023. Comparing to vscode which will ask me to authorize if I revoke the perplexityai app authorization in GitHub.

xuyangyuio avatar Mar 25 '25 11:03 xuyangyuio

There is delay between you unregister perplexity and before it actually stops working so that part doesnt matter. I just tested perplexity and im definitely getting at least correct response, e.g

[CopilotChat] [DEBUG 15:43:48] /home/deathbeam/.config/nvim/pack/bundle/start/CopilotChat.nvim/lua/CopilotChat/client.lua:574: Response line: {"choices":null,"copilot_references":[{"type":"github.agent","data":{"type":"github.agent","id":603,"login":"perplexityai","avatarURL":"https://avatars.githubusercontent.com/in/1026421?s=60\u0026u=dc3f91fbb805eab67f66223e98477f2a63961d82\u0026v=4","url":"https://github.com/marketplace/perplexityai"},"id":"603","is_implicit":false,"metadata":{"display_name":"perplexityai","display_icon":"https://avatars.githubusercontent.com/in/1026421?s=60\u0026u=dc3f91fbb805eab67f66223e98477f2a63961d82\u0026v=4","display_url":"https://github.com/marketplace/perplexityai"}}],"id":null}

can you try enabling debug logs and check if you see something similar? e.g in copilot_references there should be perplexity mentioned

deathbeam avatar Mar 25 '25 14:03 deathbeam

After updating the plugin, I do get the similar logs.

[DEBUG Tue Mar 25 18:23:55 2025] /Users/xuyangy/.local/share/nvim-lazy/lazy/CopilotChat.nvim/lua/CopilotChat/client.lua:574: Response line: {"choices":null,"copilot_references":[{"type":"github.agent","data":{"type":"github.agent","id":603,"login":"perplexityai","avatarURL":"https://avatars.githubusercontent.com/in/1026421?s=60\u0026u=dc3f91fbb805eab67f66223e98477f2a63961d82\u0026v=4","url":"https://github.com/marketplace/perplexityai"},"id":"603","is_implicit":false,"metadata":{"display_name":"perplexityai","display_icon":"https://avatars.githubusercontent.com/in/1026421?s=60\u0026u=dc3f91fbb805eab67f66223e98477f2a63961d82\u0026v=4","display_url":"https://github.com/marketplace/perplexityai"}}],"id":null}

but also empty response [ERROR Tue Mar 25 18:23:55 2025] /Users/xuyangy/.local/share/nvim-lazy/lazy/CopilotChat.nvim/lua/CopilotChat/init.lua:911: ...im-lazy/lazy/CopilotChat.nvim/lua/CopilotChat/client.lua:733: Failed to get response: empty response

xuyangyuio avatar Mar 25 '25 15:03 xuyangyuio