Control the Linux desktop GUI using xdotool, wmctrl, and dogtail. Use when you need to interact with non-browser applications, simulate mouse/keyboard input, manage windows, or inspect the UI hierarch
Real data. Real impact.
Emerging
Developers
Per week
Open source
Skills give you superpowers. Install in 30 seconds.
This skill provides tools and procedures for automating interactions with the Linux desktop environment.
Use
wmctrlwmctrl -l
For apps supporting accessibility (GNOME apps, Electron apps with
--force-renderer-accessibilitypython3 scripts/inspect_ui.py "<app_name>"
Use
xdotool# Activate window ./scripts/gui_action.sh activate "<window_name>"Click coordinates
./scripts/gui_action.sh click 500 500
Type text
./scripts/gui_action.sh type "Hello World"
Press a key
./scripts/gui_action.sh key "Return"
wmctrl -lscripts/inspect_ui.pyxdotool key TabReturnclickMany modern apps (VS Code, Discord, Cider, Chrome) need a flag to expose their UI tree:
pkill <app> nohup <app> --force-renderer-accessibility > /dev/null 2>&1 &
No automatic installation available. Please visit the source repository for installation instructions.
View Installation Instructions
1,500+ AI skills, agents & workflows. Install in 30 seconds. Part of the Torly.ai family.
© 2026 Torly.ai. All rights reserved.