I continue to fall into the pit named Application Services
MacUse is an experimental project in early development that aims to provide a different approach to macOS automation by combining the power of Claude Sonnet with Apple's Application Services Framework.
Unlike traditional macOS automation tools that rely on cursor manipulation, screenshots, or window focus changes, MacUse takes a more elegant approach:
- No Cursor Hijacking: Your mouse cursor stays exactly where you left it
- No Screenshots Required: All decisions are made by analyzing the accessibility tree
- Pure Accessibility: Leverages macOS Accessibility Tree for navigation and control
This project is in very early development stages and should be considered experimental. It's an exploration of how we can create more reliable and less intrusive macOS automation by strictly using the accessibility framework.
MacUse operates by:
- Building a semantic understanding of application state through accessibility trees
- Executing actions via Application Services Framework
- Using Claude Sonnet for intelligent decision-making
- Performing operations without relying on screen coordinates or visual elements
This is a raw, experimental project. Expect frequent changes and potential instability as the codebase evolves.
As this project is in its early stages, feedback and contributions are welcome but expect significant changes in approach and architecture.