OS Computer Use Grounding & Automation Sandbox

Benchmark Synthesis: macOS AXUIElement & Quartz CGEvent offer deterministic pixel injection (0.4px jitter, 97.4% reliability). Omarchy Linux Wayland enforces strict compositor isolation via xdg-desktop-portal and uinput, introducing fractional coordinate jitter (3.8px) & AT-SPI2 IPC tree overhead.

macOS Sequoia (Retina 2x)

Idle

Coordinate Target:[840.0, 420.0]

Subpixel Jitter:0.4 px

A11y Tree Latency (AXUIElement):

Vision Pipeline (Quartz Capture):180 ms

Injection Success Rate:97.4%

TCC A11y

ScreenCaptureKit

Quartz EventTap

Omarchy Linux (Wayland Fractional)

Idle

Coordinate Target:[836.2, 423.8]

Subpixel Jitter:3.8 px

A11y Tree Latency (AT-SPI2 DBus):

Vision Pipeline (PipeWire Portal):145 ms

Injection Success Rate:81.2%

xdg-desktop-portal

InputCapture Daemon

uinput Kernel

Step 1 / 3 1. find_anchor [export_button]

Vision Capture Rate30 FPS

A11y Tree Node Depth6 levels

Linux Fractional Scaling1.25x

Deterministic Audit Protocol: Grounding pipeline metrics ready for export.