jwm icon indicating copy to clipboard operation
jwm copied to clipboard

JWM voice assisted ?

Open fredvs opened this issue 9 years ago • 8 comments

Does JWM have voice assisted features ?

If no, very few things could be added to make JWM assisted (and become the first and unique voice-assisted window manager).

  • OnClick is ready for assisting (developer can use exec:)

The only thing missing is OnMouseMove. But this could be done by the hint-window. --> Would it be a enormous work to add something like hintexec: that gives the possibility to run something when the hint-window appear ?

Many thanks.

Fre;D

fredvs avatar Sep 15 '16 14:09 fredvs

I can't say I've put much thought into voice control, so I'm not completely sure what would be necessary to support it. However, it seems to me that EWMH could be used for most things, with the advantage of supporting multiple window managers.

joewing avatar Sep 17 '16 00:09 joewing

Hello Joe.

I have developed a voice-assisted pluggin for fpc (free pascal compiler): sak [https://github.com/fredvs/sak]

It uses eSpeak Speech Synthesizer. [(http://espeak.sourceforge.net)]

It would be extremely easy to make JWM assisted with espeak.

In FreeBSD-polYdev distro next release, JWM will be assisted that way. But only OnCick is assisted (via exec:).

It would be great if OnMouseMove was assisted too. But because there is a "popup" feature in JWM, the trick will be to add a exec for popup too. That exec: will be executed when the hint is showed.

Something like this:

<TrayButton popup="This is a button" icon="button.png" popupexec="espeak this is a button"> exec:MyAppAssisted>/TrayButton>

Hum, I do not know EWMH, I have look at the official site but I do not see (or understand) how EWMH could help for assistive, Could you give me some light ?

Many thanks.

Fre;D

fredvs avatar Sep 19 '16 15:09 fredvs

Actually it could just be a global setting. So you could just add something like this to showpopup if (popupexec) runpopupexec(popupexec, popuptext);

technosaurus avatar Sep 20 '16 01:09 technosaurus

Hello technosaurus.

Sorry, I did not understood.

Where to add this command, in JWM config-file ?

(Or maybe you are talking to Joe, then sorry for the noise.)

Fre;D

fredvs avatar Sep 20 '16 10:09 fredvs

I like the idea of adding an exec option for popup windows. That would be fairly easy and probably provide the desired result.

I think @technosaurus was pointing out that the behaviour could be a global configuration option (not that it is currently), and I agree. Probably just a setting stored via a setter in popup.c that the popup code would execute when a popup is initially displayed. Something along the lines of <PopupCommand>...</PopupCommand> for the configuration file I guess.

joewing avatar Sep 28 '16 12:09 joewing

Wow, finally it will exist a assisted window manager.

If you do it, JWM will be the first and only one.

Many thanks.

fredvs avatar Sep 29 '16 10:09 fredvs

@joewing That is basically what I was thinking at the moment, but after additional consideration it occurred to me that users may want to use the popupexec in lieu of the built-in one (instead of in addition to) which may require passing additional parameters such as x, y (for visual replacements) and the label of the thing that passes it (for audio) , in addition to the tooltip text of course ... otherwise it could cause things to be taken out of context.

technosaurus avatar Sep 29 '16 20:09 technosaurus

Hello. Some news ? Thanks.

Fre;D

fredvs avatar Nov 24 '17 11:11 fredvs