
AGENTERACT
Let your agents interact...The SDK that connects AI agents to running apps.
Getting Started with Agenteract
For the complete installation guide, see the full documentation
Package manager:
Installation
Agent Based
The easiest way to get started is to let your coding agent do the work. First, create an AGENTS.md file:
npx @agenteract/agents md
You can also specify the name:
npx @agenteract/agents md CLAUDE.md
This appends the Agenteract instructions to your agents markdown.
Next, restart your coding CLI or open a new chat tab (Cursor), then ask it to complete the setup:
"Please add Agenteract support and make sure it works."
Manual
First, you'll need to install the Agenteract CLI. This tool manages the communication between the AI agent and your local development servers.
npm install -g @agenteract/cli
Next, install the appropriate package for your project.
For React Native (Expo):
npm install @react-native-async-storage/async-storage expo-linking
For React (Vite):
npm install @agenteract/react
React Native, Expo, React all use the same import @agenteract/react. Previously Expo and Vite specific packages were used to provide dev server wrappers, but this is now generalized.
For Flutter:
Add to your pubspec.yaml:
dependencies:...
Demo Video
Check out this amazing demo that highlights the core of our developer experience — sleek, fast, and visually stunning.
Trusted by companies around the world.
Agents That Actually Understand Your App
Most "AI agents" rely on vision or accessibility APIs to understand an app's UI. That approach is heavy, slow, and unreliable.
Agenteract flips the model — apps self-report their structure and controls in a simple, semantic format. Agents no longer guess what's on screen; they can query the actual component tree and call meaningful actions.
Direct State Access
Skip vision APIs and accessibility layers. Agenteract exposes your app's component tree, state, and controls directly over WebSocket.
No guessing, just pure structureREQUEST
{ "action": "getViewHierarchy" }RESPONSE
{ "root": "App", "children": [...] }Semantic Actions
Agents don't simulate clicks — they call real handlers. Map onPress, onChangeText, or custom actions to meaningful commands.
100%
Direct calls
✓
Type-safe
Lightweight Bridge
A simple WebSocket endpoint that sends UI snapshots and receives commands. No heavy dependencies, no performance overhead.
<5KB
Bundle size
~0ms
Overhead
Multi-Platform
React Native, Expo, React web, Vite, Flutter, Swift. One protocol, multiple platforms. Build agents that work across your entire stack.
One protocol, everywhereDirect State Access
Skip vision APIs and accessibility layers. Agenteract exposes your app's component tree, state, and controls directly over WebSocket.
No guessing, just pure structureREQUEST
{ "action": "getViewHierarchy" }RESPONSE
{ "root": "App", "children": [...] }Semantic Actions
Agents don't simulate clicks — they call real handlers. Map onPress, onChangeText, or custom actions to meaningful commands.
100%
Direct calls
✓
Type-safe
Lightweight Bridge
A simple WebSocket endpoint that sends UI snapshots and receives commands. No heavy dependencies, no performance overhead.
<5KB
Bundle size
~0ms
Overhead
Multi-Platform
React Native, Expo, React web, Vite, Flutter, Swift. One protocol, multiple platforms. Build agents that work across your entire stack.
One protocol, everywhereThe Ecosystem
@agenteract/coreCore protocol & utilities
@agenteract/reactReact/RN bindings
@agenteract/expoExpo bridge & CLI
@agenteract/viteVite integration
@agenteract/flutter-cliFlutter bridge & CLI
@agenteract/cliUnified CLI
@agenteract/serverAgent runtime
@agenteract/agentsAGENTS.md installer
@agenteract/domWeb DOM utilities
agenteract (Flutter)Flutter bindings
agenteract-swiftiOS/Swift package
Build with your favorite frameworks
Your agents can interact with multiple app frameworks. More coming soon.