midscene icon indicating copy to clipboard operation
midscene copied to clipboard

Can we support the content within iframe?

Open tdhanjun opened this issue 1 year ago • 2 comments

I tried the page with the iframe and found that its image analysis could not cover the contents of the iframe, as shown in the following figure:

Image

Image

I'm not sure how this feature works in our tool, but I think it has similar capabilities to Microsoft's OmniParse.

tdhanjun avatar Dec 19 '24 02:12 tdhanjun

oh, i just see the limitation in FAQs, do we have other solutions to support IFrames? Or is this in our roadmap?

tdhanjun avatar Dec 19 '24 03:12 tdhanjun

Currently, we are inspecting the page elements using JavaScript, so iframes are not applicable.

We are still trying to find a way to implement automation using an image-only approach. If we can achieve this, then iframes and canvas components will not pose any difficulties. It may take several weeks, or it might take longer than that.

yuyutaotao avatar Dec 19 '24 06:12 yuyutaotao