Using voice control

Does anyone have experience with Mac's built-in voice control?


I'm stuck in High Sierra using Dragon Professional for Individuals 4.2. This is the latest version of OS X that will run the Dragon software.


I rely on voice control to be a truly "hands-free system" due to paralysis. I was very little luck with recognition and commands just not working when testing on a very slow Catalina machine. Eventually I would like to update my operating system to fit within my Apple environment.


Any advice would be so greatly appreciated.

Posted on Nov 10, 2020 11:15 PM

Reply
14 replies

Nov 15, 2020 8:15 AM in response to garyp127

Hi garyp127


I have been monitoring Apples voice control development for a while. When I first tried it was not very accurate and there were a lot of things that did not seem to work as they should. From what you said, this seems to have been your experience too. There does appear to me to have been steady improvement although I do think you need up to date hardware and latest OS to get the best from it. It will be interesting to hear other peoples experience.


I have just loaded Big Sur and first impressions are positive although I need more time see how it performs. When I have had more time using it I will try and post an update.


Since Nuance dropped Dragon for Mac I think it is essential Voice Control steps up - it is the only option available for the mac - and for those who rely on it like yourself it is essential it continues to improve. There is no other choice!


btw the built in head tracker in Big Sur looks good too. Not sure if this is something you would use alongside voice control, but it looks like it could be a very useful tool for those with paralysis.






Nov 23, 2020 2:09 AM in response to garyp127

I tried using Keyboard commands as a way to cause mouse movement. I used Mouse Keys - the feature that converts the keyboard into buttons that move the mouse - and then used an Applescript to press the keyboard keys, which I then linked to a voice command. I can get the mouse to move a specified distance, but cannot set the mouse moving and then stop it with a "Stop mouse" command. Looking around the web it does not appear this is possible with Applescript. An experienced programmer, which I am not, might be able to come up with something, but so far I have not found anything that works.


I have used Applescript to create my own very simple but useful tools and linked them to voice commands and most of these worked OK.

Nov 24, 2020 8:30 AM in response to garyp127

Not sure I have any magic that makes Applescripts triggered by Voice Control. work. I just set them up in the voice control section - see screenshot. I did notice that if you make changes to the script you need to "reattach" the script to the voice command - when running it does not seem to reference the file in the location you have stored it.


I have noticed that some things just don't work - e.g. Some keyboard commands that work using the keyboard keys do not run when used in a voice command. There seems no reason why this happens for some keys and not others.

Nov 23, 2020 5:16 PM in response to ak1956

I've read about using the number keys to initiate mouse movements but never actually tried them.


Also, in regards to AppleScript, I use it extensively with Dragon with scripting keyboard shortcuts and key combinations but have had no luck with it in Apple Voice Control. I am not an advanced scripter either, but find simple scripts very useful. Any advice on how to get them to work with Apple voice control?

Nov 21, 2020 9:56 PM in response to halpy

Thank you so much for your reply. Interesting that voice control still runs slow with all that hardware behind it.


I was concerned about effective mouse movements because the Dragon mouse movements are so robust. I was looking at apps like Keymou and Keyboard Maestro to fill in the gaps left by Apple's subpar voice control mouse movements.


Also, I'm interested to know if I can effectively use Automator and or AppleScript to script commands to be executed by voice.


Again, many thanks for your reply!

Dec 4, 2020 11:24 AM in response to ak1956

Thanks again for your quick response. I've always used whatever microphone Dragon recommend. One good thing, a friend of mine just scored a new MacBook Air with the M1 chip and Big Sur preinstalled. It has a USB C port. I have a headset that can connect directly to it and do some real testing. Once she gets it, I will post here with some results. Thanks again for all of your help!

Nov 21, 2020 7:52 AM in response to garyp127

I was exactly in your situation. And I was thrilled when Apple released Voice Control as part of the operating system of Mack OS Catalina. So I promptly upgraded to Catalina starting with 15.1. I was using a mid 2015 15 inch MacBook Pro. Although there were fewer of glitches and crashes compared to Dragon, a major problem seem to be let the more I used the navigation features of" Show Numbers" and" Show Grid" the slower my Computer became. I had to restart my computer almost every hour so the voice control would become responses again. And finally when I upgraded to Catalina 15.4, Voice Control became so unresponsive that I couldn't use it anymore. Being paralyzed, like you, this was a big problem. Even though my computer was otherwise totally functional, I decided upgrading my hardware to a newer a MacBook Pro. I bought the new 16 inch MacBook Pro with the 2.3 GHz 8 Core I9 CPU. Even after upgrading Catalina to 15.7 on this new machine, all that to was bring me to the level of proficiency of my old Mac using Catalina 15.3. I felt like I wasted my money. Beyond that, dictation does not work with microsoft Excel and there are no continuous motion commands for cursor movements. I have posted these issues many times on the forum and have found Apple to be unresponsive to my input. Maybe the new M1 machines will be an improvement.

Nov 21, 2020 9:00 AM in response to halpy

It is very disappointing to hear of these negative experience with voice control on Mac, especially as there are no other options available. I hope things improve. I would take every opportunity you can to feedback to Apple otherwise they will never hear just how important this functionality is, and that despite developments it is still not hitting the user experience levels we all expect.

Nov 24, 2020 9:20 PM in response to ak1956

YES, I've had the issue of AppleScript not being able to find prewritten scripts, thank you for addressing/clarifying that.


I will certainly look into this type of approach moving forward. I too have found problems with some command just not working. It's frustrating. I certainly don't understand this.


Thank you for the screen shot and all of your help! I will be following this thread trying to help others as you do, I'm sure we will come across each other again soon. Look forward speaking again! Be well

Dec 1, 2020 1:00 AM in response to garyp127

I tend to use the internal microphone (I have a mac book pro) on the basis that Mac microphones tend to be "good" quality. I also have logitech C920 webcam which has a built in microphone. I don't tend to use this for voice control, but it works well for calls etc.


I don't have any evidence of what works best. Generally I would not use a 3.5mm jack device, using bluetooth or USB in preference (as you are). Any "good quality" microphone should be OK - the problem is specifying good quality.


If there are any audio engineers out there that could specify what a good quality mic would be, that would be helpful!

This thread has been closed by the system or the community team. You may vote for any posts you find helpful, or search the Community for additional answers.

Using voice control

Welcome to Apple Support Community
A forum where Apple customers help each other with their products. Get started with your Apple Account.