iOS icon indicating copy to clipboard operation
iOS copied to clipboard

iOS assist shortcuts/intent not working with Google GenAI Conversation

Open danielfrg opened this issue 1 year ago • 5 comments

I have integrated the Google Generative AI Conversation into "Assist" and it all works great on the web and iOS app.

Except when trying to run it from a shortcut when I always get "Sorry, I couldn't understand that".

I believe this is because of the language selection.

I only have one Voice Assistant. When look at the "Debug Assistant" on the HA app/web I see the requests that I send from the web but not the ones i send from shortcuts.

Those requests have language set as "*". But thats not an option from the shortcuts app.

I should also mention that other shortcuts work just fine. It's only the "Assist" one that is failing.

Model Name: Software Version: 2024.3.1 App version: latests

danielfrg avatar Mar 19 '24 21:03 danielfrg

Can confirm this problem also happens with Open AI Conversation agent. Not possible to use it with iOS shortcuts

paull27 avatar May 16 '24 09:05 paull27

I installed the Assist shortcut and set up multiple voice assistant pipelines with ChatGPT and Google AI. However, I can’t change the conversation agent on the shortcut; it always defaults to the limited Home Assistant agent.

earlyXbirdNG avatar Sep 12 '24 09:09 earlyXbirdNG

Same issue here. Can't change conversation agent More or less comparable: https://github.com/home-assistant/core/issues/97214

henry4711lp avatar Sep 12 '24 09:09 henry4711lp

I am having the same issue. It does what expected from within the ios application but not with the Assist shortcut.

jfromaniello avatar Oct 17 '24 20:10 jfromaniello

Any solution for this?

sabaatworld avatar Oct 20 '24 08:10 sabaatworld

This is still an issue with the iOS HA app. If you select "Assist in app" in Shortcuts you can select a pipeline to use but if you select "Assist" so it can be used/triggered through Siri or HomePods then it uses the default limited Home Assistant agent and you cannot change this.

Please resolve by adding this functionality into the iOS app with Shortcuts. Thanks!

The-Croz avatar Dec 05 '24 03:12 The-Croz

Also, I just added this to Month of WTH on the Home Assistant Community. Go comment and vote!

https://community.home-assistant.io/t/wth-cant-we-choose-a-voice-pipeline-on-ios-siri-shortcuts/805035

The-Croz avatar Dec 05 '24 04:12 The-Croz

https://github.com/home-assistant/iOS/pull/3242

bgoncal avatar Dec 06 '24 12:12 bgoncal