Skip to content
HardwareLab
Local LLM Rigs & Edge AgentsIntermediate

Esp32 Iphone Agent

A $7 ESP32 lets an AI drive a real iPhone via AirPlay and USB HID.

By onehumanbeing

View original on GitHub
Est. cost
Cost unknown
Posted
GitHub stars
1.4K (GitHub)
Esp32 Iphone Agent: GitHub repository card
No photo in the source; showing the GitHub repository card.

Overview

Lets an AI model operate a real iPhone using a $7 ESP32, with no Mac, developer account or jailbreak. Demos show it drawing a smiley face in a whiteboard app and setting a repeating alarm.

How it works

The agent sees the phone through AirPlay screen mirroring. An ESP32-S3 plugged into the phone's USB port acts as a mouse and keyboard to tap, type and swipe. Any OpenAI-compatible vision model, cloud or self-hosted, decides each step, and a web UI shows every screenshot with its action drawn on top.

Hardware

  • ESP32 (USB HID)
  • iPhone

This page is a short summary written by HardwareLab. Build steps, code and photos belong to the creator; follow “View original” for the full project.

More in Local LLM Rigs & Edge Agents

See all 17