A commandline recorder for Sikulix
Sikulix (http://sikulix.com/) automates anything you see on the screen of your desktop computer running Windows, Mac or some Linux/Unix. It uses image recognition powered by OpenCV to identify GUI components. This is handy in cases when there is no easy access to a GUI's internals or the source code of the application or web page you want to act on.
But you have to code what you want in Sikulix. The coding is easy, but still... I decided to put some code together to see if I could make a simple recorder that monitors the mouse and keyboard and converts it to code that can be played back with Sikulix. This recorder is still very basic and not very well tested, but I decided to share it anyway in the hope it would be useful to someone. So drop me a line in the Discussions if you use it.
This is a command line Python program. So you will need Python (www.python.org) and some Python modules.
The modules are:
- pynput
- pillow
These can be installed with python -m pip install <insert name of module here> after Python is installed.
This program should work on Windows, Linux, and possibly MacOS (I don't have access to a Mac, but the pynput module should work if you run it as super user)
Open a command line, go to the folder of sikulix-recorder and run:
python sikulix_recorder.py <name>
A folder named name.sikulix will be created to store the Sikulix script and any captured images. Play back the script with Sikulix to automatically repeat all keys pressed and mouse button/movements that were recorded.
To capture an image, move the mouse to the top left corner, and press and hold the left shift button. Then move the mouse to the bottom right corner of the image and release shift. Now left click on the spot you want Silulix to click on (or beside) the image.
If you don't need this functionality you can comment out the following lines in code_events.py to eliminate the need of Python's pillow module:
screenshot = ImageGrab.grab(bbox=(old_x, old_y, x, y))
screenshot.save(fname, format="png")
To see all available options, enter:
python sikulix_recorder.py --help
Kind regards,
Tom