How do you make an applescript mouse clicker?

When I run this code snippet I see the following error message

System Events got an error: Can’t make {699, 242} into type list.

Trying to send a click to Chrome.

Actually, Red, that's not true. the following code will supposedly click at x=100 y=200 in a given app:

tell application "System Events"

tell process "X"

click at {100, 200}

end tell

end tell

I've never actually used this feature - it says it will click at {x,y} in global (assumedly desktop) coordinates, but it might take some poking around to to get it clicking in the right place.

You are correct in that the click will send the {x,y} location to a process object (UI element), but I haven't had much luck using System Events to just click at some random location (especially if you want to use something like a right-click) - hence my qualifier.

In this context System Events is used to script an application's user interface, so "X" would be the application that you tell to click the mouse - change it as needed (the application also needs to be activated to bring it to the front).

It might help to know exactly what you are wanting to do - trying to do something like making a hack for World of Warcraft isn't quite what AppleScript is good at.

You can use python wrapped in Applescript:

set x to 30

set y to 5

do shell script "

/usr/bin/python <<END

import sys

import time

from Quartz.CoreGraphics import *

def mouseEvent(type, posx, posy):

theEvent = CGEventCreateMouseEvent(None, type, (posx,posy), kCGMouseButtonLeft)

CGEventPost(kCGHIDEventTap, theEvent)

def mousemove(posx,posy):

mouseEvent(kCGEventMouseMoved, posx,posy);

def mouseclick(posx,posy):

mouseEvent(kCGEventLeftMouseDown, posx,posy);

mouseEvent(kCGEventLeftMouseUp, posx,posy);

ourEvent = CGEventCreate(None);

currentpos=CGEventGetLocation(ourEvent); # Save current mouse position

mouseclick(" & x & "," & y & ");

mousemove(int(currentpos.x),int(currentpos.y)); # Restore mouse position

END"

This will the same location 50 times:

set x to 30

set y to 5

set l to 50 -- click same location 50 times

do shell script "

/usr/bin/python <<END

import sys

import time

from Quartz.CoreGraphics import *

def mouseEvent(type, posx, posy):

theEvent = CGEventCreateMouseEvent(None, type, (posx,posy), kCGMouseButtonLeft)

CGEventPost(kCGHIDEventTap, theEvent)

def mousemove(posx,posy):

mouseEvent(kCGEventMouseMoved, posx,posy);

def mouseclick(posx,posy):

mouseEvent(kCGEventLeftMouseDown, posx,posy);

mouseEvent(kCGEventLeftMouseUp, posx,posy);

ourEvent = CGEventCreate(None);

currentpos=CGEventGetLocation(ourEvent); # Save current mouse position

for x in range(0, " & l & "):

mouseclick(" & x & "," & y & ");

mousemove(int(currentpos.x),int(currentpos.y)); # Restore mouse position

END"

richardfromcascais weymouth wrote:

thankyou for the script it works great! If you composed it well done.

Credit goes to: http://www.geekorgy.com/index.php/2010/06/python-mouse-click-and-move-mouse-in-a pple-mac-osx-snow-leopard-10-6-x/

Is there a way to modify this script to terminate early when a particular key is pressed? I don't really care if the key is option, fn1, esc, or Z, so long as it works. =p

I tried to find a solution for this via Google, but the closest answer that I found was https://docs.python.org/2/faq/library.html#how-do-i-get-a-single-keypress-at-a-t ime, which I couldn't figure out how to modify for my purposes. (since I have 0 experience with coding, except for a little dabbling in XML)

I have the same almost exact question..except I need to perform a mouse click on a field in Filemaker Pro. The coordinates could be anywhere at anytime...but it would be the field currently highlighted.

Why is it so hard to say on Mac OS...just perform a mouse click now...and ignore coordinates?

If you download Carsten Blüm's Cliclick @ https://www.bluem.net/en/mac/cliclick/ and install it into /usr/local/bin you can run this command in Script Editor to left click the current position of the mouse cursor:

do shell script "usr/local/bin/cliclick c:."

The "c" is the command identifier for clicking, the "." or period is the command argument, and the ":" or colon separates the two. The following command is equivalent and uses relative zero values instead:

do shell script "usr/local/bin/cliclick c:+0,+0"

Since Cliclick is a command-line tool, you can use this command in Terminal to do the same thing:

cliclick c:+0,+0

Another tool you can use is PyMouse, now a part of PyUserInput. You can download it from GitHub @ https://github.com/SavinaRoja/PyUserInput. Install instructions @ https://github.com/SavinaRoja/PyUserInput/wiki/Installation. To use in Script Editor, you can use this command to left click the current position of the mouse cursor:

do shell script "

/usr/bin/python <<END

from pymouse import PyMouse

m = PyMouse()

pos = m.position()

m.click(pos[0], pos[1])

END"

This is easy to implement and understand

on ChromeButtonsEasy(TheTargetURL, TheTargetButtonId)

(*below to be duplicated and placed before "my ChromeButtonsEasy(TheTargetURL, TheTargetButtonId)"*)

(*set TheTargetURL to "Blank_1"

set TheTargetButtonId to "Blank_2"*)

(* Replace Blank_1 with url of your target page by copeying the address bar

Replace Blank_2 by using right click in chrome on the button and copying snippett after id *)

tell application "Google Chrome"

if not (existswindow 1) then reopen

activate

tell window 1 to tell active tab

set its URL to TheTargetURL

delay 3

executejavascript "document.getElementById(" & quoted form of TheTargetButtonId & ").childNodes[0].click()" --find the id by using inspect element

end tell

end tell

end ChromeButtonsEasy

Hello - hoping you can help. I'm using this Applescript in an attempt to click at a specific coordinate in FileMaker Pro, but very little experience here and it's not working. It will bring up the application, but not click at the coordinates. Any suggestions? I'm using FM 9 and El Capitan OS.

tell application "System Events"

tell process "FileMaker Pro"

click at {308, 355}

end tell

end tell

Thank you.

I wanted to do the same thing and came across this discussion thread 🙂

Thank you everyone who inspired me:

The applescript "click at" method always returns "missing value" error for me. I have read somewhere that this is due to new version of OS X. I'm using OS X 10.10.5 at the moment.

I wanted an applescript to open Safari and then repeatedly click on certain point of the screen, and then scroll down.

I found that Cliclick (you can download with the link in above) is easier to use for me, and it can also do the "arrow-down" keypress that scroll down the screen which is what i needed.

I finally did an applescript like this:

tell application "Safari" to activate

delay 5

do shell script "

PATH=$PATH:/Applications/cliclick/

posY=725

for i in {1..20}

do

echo \"$i times... Y is $posY \"

cliclick c:581,$posY w:500 m:+295,+0 c:. w:500 m:+295,+0 c:. w:2000

cliclick kp:arrow-down w:500 kp:arrow-down w:500 kp:arrow-down w:500 kp:arrow-down w:500 kp:arrow-down w:500

cliclick kp:arrow-down w:500 kp:arrow-down w:500 kp:arrow-down w:500 kp:arrow-down w:500 kp:arrow-down w:2000

posY=$(($posY-1))

"

done

"

"

dowload https://github.com/BlueM/cliclick

unzip cliclick-master.zip

in a Terminal

cd /Users/yourname/Downloads/cliclick-master

make

now you have in /Users/yourname/Downloads/cliclick-master/

cliclick , command tool for using a mouse in applescript with do shell script

copy cliclick in /usr/local/bin folder

in a Terminal

cp -f /Users/yourname/Downloads/cliclick-master/cliclick /usr/local/bin/

in applescript for example

do shell script "/usr/local/bin/cliclick " & quoted form of "c:12,34"

will click at the point with x coordinate

12 and y coordinate 34.

in a Terminal for LIST OF COMMANDS

cliclick -h

other way in Applescript

set x to 30

set y to 5

set l to 50 -- click same location 50 times

do shell script "

/usr/bin/python <<END

import sys

import time

from Quartz.CoreGraphics import *

def mouseEvent(type, posx, posy):

theEvent = CGEventCreateMouseEvent(None, type, (posx,posy), kCGMouseButtonLeft)

CGEventPost(kCGHIDEventTap, theEvent)

def mousemove(posx,posy):

mouseEvent(kCGEventMouseMoved, posx,posy);

def mouseclick(posx,posy):

mouseEvent(kCGEventLeftMouseDown, posx,posy);

mouseEvent(kCGEventLeftMouseUp, posx,posy);

ourEvent = CGEventCreate(None);

currentpos=CGEventGetLocation(ourEvent); # Save current mouse position

for x in range(0, " & l & "):

mouseclick(" & x & "," & y & ");

mousemove(int(currentpos.x),int(currentpos.y)); # Restore mouse position

END

"

There's a scripting addition called "AppleScript Toolbox" (it's an osax). Get it at https://astoolbox.wordpress.com/. With that, you can simply write:

AST clickat {10, 20}

That clicks into the menu bar, for instance, and opens the Apple menu.