*** A special note for Dragon for Mac Forum Users ***

Nuance is pleased to announce our new Product Forum User Community - the new Dragon Dictate community will replace these existing Dragon for Mac Forums.

To access the new Online Forums, you must first sign up for an account through our Support Portal here. After activating your new account, or if you already have an account, you may use THIS LINK to log into the Community.

Please note that as of June 18, 2012 this Dragon for Mac Forum has been set to read-only in order to retain all historical information and post details. Any new content or updates to existing content will no longer be permitted at this time. Please visit the new community link listed above to post new content and start new topics of discussion.

Dragon for Mac Forums and Discussion » Special Topics » Feature Requests

Hands-Free Mousing

(24 posts)
  • Started 4 years ago by cactustweeter
  • Latest reply from AMeit
  1. cactustweeter
    Member

    The next version of MacSpeech Dictate needs to have the ability to control the mouse by voice. Things that should be included but not limited to are:

    • Mouse clicking (left-click, right-click, double-click,command-click, etc.)
    • Mouse dragging (drag <direction> 1-N)
    • Mouse movement. Something like you say Mouse Matrix and a numbered grid comes up on the screen. You speak a number in the grid, and focus changes to the particular cell, and a new numbered matrix appears within the cell. You keep speaking cell numbers until focus appears over whatever you're interested in clicking or dragging.
    Posted 4 years ago #
  2. jayg
    Member

    Thank you for providing detail on the feature request. Left/right click is not Mac standard, but I understand the specification of mouse click modifiers (and their utility).

    Posted 4 years ago #
  3. Ricky Buchanan
    Member

    "right click" and "middle click" might not be official Mac terminology, but there should at least be aliases using these terms for the mousing commands because they're the terms used by 99% of Mac users.

    Using either "button 2" or "command click" is much less widely understood.

    r

    Posted 4 years ago #
  4. Anchan
    Member

    I have to agree. I miss the MouseGrid commands from Dragon very much. MouseGrid + select/drag/click mouse commands and scrolling functions make editing very much more efficient. It's also fantastic for surfing the web.

    MouseGrid works just like Cactustweeter noted. I don't use mouse movement much at all surfing, I just zoom through the Grid locations. I'm very good at guessing exactly what combination of numbers in the shrinking 9x9 grid will be needed to get where I want to go. I rattle off the commands and *poof*, my mouse is there. "MouseGrid On, 8, 4, 8, 5, MouseClick" would, on my screen, hit the "Affiliate Program" link on this page. :)

    Posted 4 years ago #
  5. skepticus
    Member

    I would like to add my voice to this discussion. I use Dragon NaturallySpeaking on my PC at work, which is a terrific help to me as I suffer from severe hand problems that prevent me from using a mouse click or drag without experiencing pain. Dragon NaturallySpeaking has extensive abilities to simulate mouse movements and mouse clicking. Now, I understand that dictate is a relatively recent application, and therefore, does not have all the bells and whistles that one might like it to have. (I might add that I am dictating this using the application. And, obviously, it is very accurate. Kudos.) But the lack of simulation of mouse events is a severe disadvantage for me. I would like for MacSpeech to remedy this as soon as is feasible.
    I might also add that I have tried to find scripting additions which might add this ability to dictate. So far, it appears that there aren't any compatible with my Intel iMac. (There was one from about four years ago, but it is a PowerPC only application.)

    Posted 4 years ago #
  6. hughw36
    Member

    MAc OS 10.4.11 supports both right and left click and the scroll wheel of my Microsoft Comfort Optical Mouse 3000

    right click is the equivalance of a long left click to get a contextual menu

    Cntrl plus wheel gives a truly useful zoom in function

    Posted 4 years ago #
  7. cedar
    Member

    count me in as one who feels this feature is critical for me at the computer. I'm sure there are many more out there like us who just aren't visiting these forums, so I'm putting in votes for them -- just can't tell you exactly how many there are!

    Posted 4 years ago #
  8. skepticus
    Member

    Platform: 2.2 gHz iMac using Mac OS X 10.5.5; Dictate v. 1.2.1 Build

    Okay, so, here, after a great deal of research, is a procedure for implementing a single mouse click anywhere on the screen. Since it’s a procedure, I’m detailing each step.

    !. Download the scripting addition (sometimes known as an OSAX) xTool.sax from: http://lestang.org/osax/XTool/XTool-2.0.dmg.tgz. You will have to decompress the file (StuffIt) and double-click it to get it to unfold into a .dmg (disk image) file. In this file you will find the file Xtool.osax. Drag it into your MacHD (or whatever the name of your topmost volume is)/library/ScriptingAdditions (no spaces in the name) folder. The purpose of this is to place it into a folder where Applescript is expecting to find scripting additions. In other words, it’s hard-coded and you can’t just drop it anywhere because Applescript may not find it. Also, there may be more than one Library folder in other directories. Under 10.5.5. which I’m running, I can tell you it works where I placed it.

    The effect all of this has is that when you create your script in Dictate’s New Commands window (Script Editor), Dictate will know what the commands “click mouse’ and “position of the mouse” mean. These are not standard Applsecript commands but are additions, hence the name Scripting Additions.

    2. Start Dictate and in the File drop-down select New Command. This will take you to a window with a pane on the left with names such as Applications, Global, and several others. Click on Global (so that the command will be recognized no matter what application your are in). To the right of the pane you will see a number of commands listed by name and, underneath, a (very small) “+” (and a minus sign and a small icon). Ignore everything but the “+”. Click on the “+”.

    Below several boxes will appear: Command, Description, Context, Type.
    In Command Name type in the name you want Dictate to recognize to do the click. (I call mine Mouse click.) In Description you can type something like Single-clciks the mouse. In the Context drop-down make sure to select Global. In the Type drop-down, select Applescript.

    Paste the following into Text Edit (orTexEdit Plus,if you have that):
    click mouse {(position of the mouse), [1]}

    For reasons unknown to me, you can’t just select that text, copy, and paste it into Dictate’s Script Editor winodw. You will have to select it in Text Edit and drag it into the Source text box.

    Click on the Compile button at the left bottom. After it finishes compiling (a matter of seconds if everything is normal), click on the Run button with your mouse. If all has gone well, you will very likely see the Run button get pressed repeatedly. Take your mouse off the button so it stops blinking like mad. (The Mouse click Appplescript is repeatedly looking at the position it find itself and clicking again, and again.)

    While your mileage may vary, I have been able to simulate single mouse-click using this workaround.

    So far, I have not been able to simulate a double-click reliably. There is, I believe, an issue with the amount of time between the two clicks (a parameter of the click mouse command above which I did not go into here). For anyone out there who wants to work on that, I would be glad to hear your results. I’ve tried values up to 2000 in the DELAY parameter after the TIMES parm. Here is what the dictionary shows for this command.

    click mouse?v
    click mouse [point] : where to do the mouse click
    [times integer] : how many times you want to clik the mouse
    [delay integer] : delay between two mouse clicks
    [using primary button/secondary button/middle button] : which mouse button.

    I'm also posting this on Apple's Discussion Board.

    Posted 4 years ago #
  9. skepticus
    Member

    CORRECTION TO PREVIOUS POST:

    You only need to paste the command click mouse into the text edit and then drag and drop that command into the source window. You do not need the additional parameters.
    In other words, copy this into Text Edit:
    click mouse
    You do NOT need to copy
    click mouse {(position of the mouse), [1]}
    Everything else should be OK. Thanks to Hiroto for pointing this out.

    Posted 4 years ago #
  10. skepticus
    Member

    DOUBLE-CLICKING (HOW TO)

    Using the xTool Scripting Addition mentioned above, I've found a simple solution. Just drag-and-drop this onto the source text box in Dictate's Script Editor (the place where you create New Commands, as described above):

    click mouse
    click mouse

    So far, it's worked every time in launching an app from an open Finder window.

    I would be interested in knowing other folks' results on their machines. Please give it a shot if you are so inclined.

    Posted 4 years ago #
  11. skepticus
    Member

    DOUBLE-CLICKING (HOW TO)

    Additional note:
    you can also use, with the xTool Scripting Addition:

    click mouse times 2

    Posted 4 years ago #
  12. Ricky Buchanan
    Member

    Skepticus, this is fantastic! It's working perfectly for left click, right click, and double click, on my machine.

    Also, I'm amazed that you found it. I spent *ages* googling to find an osax which could click the mouse and totally failed. I even started with writing one up myself, but it's not quite finished yet (works fine for me, fails for others - no idea why). So this is very very very cool. I'd love to let more people be able to use it.

    Would you mind if I wrote this up for ATMac with screen caps to make it easy to follow for folks who aren't so technically inclined? I'll give you full credit to whatever name/website/email you prefer.

    To make it easier for others to replicate, we could also export the trio of commands from MacSpeech Dictate then other people just have to import them. That should simplify things a touch, at least.

    Posted 4 years ago #
  13. skepticus
    Member

    Ricky,

    Knock yourself out. Please mention the author of the Osax, which, even though it's not too recent, works great.

    I can't take credit for finding it; Hiroto, a frequent contributor on Apple's Discussion forums, brought it my attention. He wasn't sure that it would work but pointed me to a website where I was able to get the current URL I put out for everyone's use. He even pointed me to the right syntax, after I wrote something superfluous.

    I might add that the performance is pretty close to that of Dragon Naturally Speaking 10 on the PC platform, which I use at work, in clicking and double-clicking. I'll have to get the right and left-click thing going now that you mention you've gotten it working. (I hadn't tried that yet.)

    And, yes, please share this with whoever you can get it to. Anything to help other people out who have this problem. I like your idea about exporting the commands, the ATMac thing too.

    The only thing I can really take credit for is follow-through with all the leads I got.

    To be honest, I was surprised such an elementary thing should be so hard to get a hold of. I tried several different options first, including use of Apple's built-in Speakable Items in the Speech System Preferences. I got it to work, but there was an apparent conflict between it and Dictate.

    But it looks as though we have something usable now so I feel pretty good about it. I'm glad someone else is as enthused about it as I am.

    Cheers.

    (The Apple forum discussion is at http://discussions.apple.com/thread.jspa?threadID=1784654&tstart=0)

    Posted 4 years ago #
  14. Ricky Buchanan
    Member

    Skepticus, I'll put something together ASAP hopefully to post on Monday. If you're comfortable emailing me my email address is ricky@notdoneliving.net and we can back and forth to test that the exported commands work. I'm fairly sure they do, but it's always good to test first! I'll certainly credit the people you suggest also.

    Thanks!

    Posted 4 years ago #
  15. Ricky Buchanan
    Member

    Blog post with streamlined process for setting up MacSpeech Dictate to be able to trigger mouse clicks with your voice:

    Voice-Activated Mouse Clicks with MacSpeech Dictate

    Please spread the word :)

    Posted 4 years ago #
  16. jayg
    Member

    Thanks for letting everyone know about this. I'm following the results on the atmac.org web site article on "Voice-Activated Mouse Clicks".

    Please feel free to repost to the Extending Dictate section of the forums.

    Posted 4 years ago #
  17. lepus
    Member

    I believe that a mouse grid is the most important thing that can be added to this software. It would make the difference between a helpful piece of software and an essential piece of software.

    Posted 4 years ago #
  18. cactustweeter
    Member

    lepus you are correct. For people that need to use a computer hands-free, mouse grid would suddenly make MacSpeech Dictate essential, and would diminish many of the other shortcomings of the software. Come on MacSpeech give us a mouse grid. If WSR and Dragon can do it, I have confidence you can do it. Please make it a priority.

    Posted 4 years ago #
  19. asully
    Member

    Sadly, the mouse grid is a patented invention, that would have to be licensed from Nuance. I have no idea if that's going to happen anytime soon.

    Posted 4 years ago #
  20. fortunesfavorite
    Member

    I am in total agreement. My physical situation mandates that I must have a hands free solution to using the mouse. My old iListen version had MouseAnywhere which has always worked beautifully. That allows for up to pixel by pixel movement, if need be, and the ability to click, double click or, triple click the mouse as well as the ability to toggle the control, option, shift and command keys. It allows for locking the mouse button and dragging. This was one of it's big selling points for me.

    I was fully expecting this to be soon available in MacDictate and have inquired about it on several occasions without reply from MacSpeech support. Why this step backwards is beyond me.

    This is so essential to me that I continue to use iListen in spite of its inadequacies. My concern now has to do with the release of Apple's new operating system (OS 10.6). If I update, iListen may be incompatible.

    For a company that prides itself on catering specifically to a Macintosh community (and especially since Apple has gone out of its way to not only make their operating system user-friendly but, accessible to the disabled and physically challenged) this lack of forethought and responsiveness in a dictation program is incomprehensible.

    Personally, I simply have no use for a program that basically allows me to dictate and nothing more.

    I would really like to hear back from MacSpeech one way or another as to whether they plan on providing this necessary accessibility or not so I can decide on whether to move to a different product.

    fff

    Posted 3 years ago #
  21. jayg
    Member

    Thanks for your feedback on hands-free mousing. MacSpeech Dictate 1.5 (and the Legal and Medical products) is not completely hands-free solutions. MacSpeech Dictate 1.5 functions as a "third hand" to reduce your use of mouse and keyboard, by enabling dictation and control of Mac applications through voice commands.

    Although there are no additional announcements about future developments at this time (other than Snow Leopard compatibility), we are working to add compatibility, functionality and value to MacSpeech products.

    Posted 3 years ago #
  22. endymion
    Member

    How can you say that MacSpeech acts as a "third hand" when the "Golden Rule" of MacSpeech is to not use your hands when you dictate? The documentation specifically instructs us to depend MacSpeech totally and not use our hands when we're dictating. If we dare to touch the keyboard or reposition the cursor with our hands while we use MacSpeech then it malfunctions due to the cache getting out of sync.

    Posted 3 years ago #
  23. fortunesfavorite
    Member

    I agree. Unfortunately, this is the same response (or lack of response) I have been receiving to this inquiry for the past year. As the disabled professional (I am an attorney) I would really like use the "legal" version of Dictate, however, this lack of true hands free functionality simply won't allowed that. I need a straight answer from MacSpeech. Why can't you provide MouseAnywhere with Dictate? If that isn't possible, say so. I don't want to make a decision to move from this product if I don't have to, however, repeated ambiguous assurances of future improvements is not enough. At this point, I cannot recommend this product to anyone in the disabled community and that is too bad because, except for this glaring deficiency, this is a system with a great deal promise.

    fff

    Posted 3 years ago #
  24. AMeit
    Member

    Look here MacSpeech, full mouse control is long, long over due. Its command/control basics. Just do it. Now that your part of Nuance, the grid mouse should be part of MSD 1.6, now.

    Posted 3 years ago #

RSS feed for this topic