Page 1 of 1

Better support for voice control

Posted: 16 Feb 2018 21:26
by kkkwj
Hi, in the simplest case when apps do not support voice control, some voice control software allows users to say "show numbers" to assign a number to every clickable user interface element. I have attached a screenshot for you to show you what it looks like. With the numbers, people who use voice can speak a sequence of "show numbers","32","show numbers","54", etc to slowly work their way through a process. It's still a much faster way than other ways for people with RSI or other limitations.

The xyplorer screen is odd because none of the toolbar buttons are numbered and none of the filename choices are numbered. In contrast, Windows Explorer does a fair job of file searching by voice (although crude compared to xyplorer) and provides numbers for all results to make them easily selectable and clickable.

It would be helpful if xyplorer became more voice-friendly one day. Right now it's very difficult to switch to by voice, and it's impossible to click on the filenames (which is kind of the main purpose...:-). Thank you

Here's a screenshot showing the output of a "show numbers" command. Sorry for the bad quality. XYplorer must be active to show the numbers and so my screenshot app can't take a high-res picture of the numbers. This was done with my iphone. But you can see that the tree elements, toolbar buttons, all top tabs, file find tabs, and file items in the main window are not clickable.
File 2018-02-16, 12 15 04_mini.jpeg

Re: Better support for voice control

Posted: 16 Feb 2018 21:35
by highend
These elements are declared as private inside the app. Chance of changing that? 0 - 5%...

Re: Better support for voice control

Posted: 26 Feb 2018 12:06
by admin
So all these reddish colored controls can be triggered by voice? Interesting. My current machine does not even have a mic, but I'm getting one soon that should have one.

How do you turn this on in Windows?

Re: Better support for voice control

Posted: 26 Feb 2018 12:22
by jupe
I think, if you notice in the taskbar, this is 3rd party Dragon Naturally speaking, not part of Windows.

Image

Re: Better support for voice control

Posted: 27 Feb 2018 10:10
by admin
Aha! Well, that makes it even less likely that I will support this in the near future. Looks like this would be an incredible amount of work, I just don't have the time for. Sorry.