[Writing Assistance APIs] "Foundational model state: Not Eligible" despite "Device performance class: Very High"
What happened?
https://microsoftedge.github.io/Demos/built-in-ai/playgrounds/summarizer-api/ has a console warning that "The device is not eligible for running on-device model.", and the Summarize button doesn't work.
Device performance class
Device performance class: Very High
Is device capable?
device capable false
Edge channel and version
139.0.3358.0 (Official build) canary (64-bit)
Device information
Please provide the following information about your device: Operating system, version, and architecture. For example: Windows 11, version 24H2, x64
Windows 11 Pro 24H2 10.0.26100 Build 26100, x64
GPU information
ANGLE (AMD, AMD Radeon(TM) 760M (0x000015BF) Direct3D11 vs_5_0 ps_5_0, D3D11-31.0.24018.2001)
Thanks for bringing this up. You are seeing the text Device performance class: Very High, in edge://on-device-internals/ and in the Model Status tab see device capable as false - instead of true?
One theory we have is that this happened because when the perf estimation ran your device was on battery power, and this should fix itself on the next browser version update. The value that is shown against the "Device performance class:" is the current instantaneous value and not the actual value used to determine model download eligibility.
If you are okay with losing your edge canary profile state, you can try closing Edge with "... > Close Microsoft Edge." deleting "%localappdata%\Microsoft\Edge SxS\User Data\Local State" - this will reset your canary profile. and restart Edge Canary when on AC power to run perf estimation again.
Another solution to try out these APIs is to Bypass the perf requirements. edge://flags/#edge-llm-on-device-model-performance-param > Enable ByPassPerfRequirement.
Thanks! That is the screen I'm seeing. Plugging in and setting edge://flags/#edge-llm-on-device-model-performance-param to 'Enable ByPassPerfRequirement' let the model start downloading.
I then turned off that flag, closed Edge, deleted the Local State file, and reopened it but forgot to re-enable the edge://flags/#edge-llm-summarization-api-for-phi-mini flag, and it gave me device capable==false again.
Now that I've set the *-for-phi-mini flags, it says 'device capable'==true and 'is already installing'==true, but https://microsoftedge.github.io/Demos/built-in-ai/playgrounds/summarizer-api/ says "On-device API and model downloadable" instead of showing me the download progress like when I started it with edge://flags/#edge-llm-on-device-model-performance-param. I haven't waited long enough to distinguish the possibilities that the download is still in progress, vs it being confused by the partial download from before I deleted Local State.