Skip to content
HardwareLab

ESP32 AI projects

Last updated · 78 projects

The ESP32 is the most common board on HardwareLab: 78 builds list it in their parts. Most use it as the device end of an AI system. The board captures audio, images or button presses, connects over Wi-Fi, and hands the heavy work to a model running in the cloud or on a computer at home. Voice assistants are the biggest group (21 builds), led by XiaoZhi, an open-source voice bot that talks to cloud language models and speech services, and Willow, whose README says: "Willow users can now self-host the Willow Inference Server for lightning-fast language inference tasks with Willow and other applications (even WebRTC) including STT, TTS, LLM, and more!"

A smaller group runs models on the chip itself, and those models are tiny by design. esp32-28m-llm generates text with a 28.9M-parameter model, needle-2-esp32 runs a 45M-parameter model offline on an ESP32-S3, and pfor-esp32-p4 fits a 180.9M-parameter mixture-of-experts model on an ESP32-P4. Narrow jobs work well on the board: esp-vision-detection does real-time object detection with no cloud, and esp32-ha-satellite-15 runs its wake word on the device and sends the rest to a home server.

So pick an ESP32 for small, cheap, always-connected devices: voice satellites, e-ink dashboards (6 builds), smart glasses (6) and desk robots (9). If you want a chatbot that runs fully offline, the builds here that do it use a Raspberry Pi or bigger hardware. Single-chip builds go further than you might expect: mimiclaw runs a personal agent on one ESP32-S3, and esp32-iphone-agent uses an ESP32-S3 board to let an AI model use a real iPhone.

Start here: 5 best picks

  1. XiaoZhi ESP32: An X post calls it the hottest open-source AI project in the whole ESP32 ecosystem (30.8k GitHub stars at the time). (Voice Assistants & Companions, 30,911 GitHub stars)
  2. MimiClaw: A personal AI agent on one ESP32-S3 chip: no Linux, no Mac mini. (Local LLM Rigs & Edge Agents, 5,794 GitHub stars)
  3. OpenCat / Petoi: OpenCatESP32 runs the OpenCat quadruped robotics framework on BiBoard, an ESP32-based development board for legged robots with up to 12 servos. (Robots & Rovers, 5,453 GitHub stars)
  4. OpenGlass: Turn any glasses into hackable smart glasses with off-the-shelf components. (Smart Glasses, 4,187 GitHub stars)
  5. Trmnl Firmware: Open firmware for the TRMNL e-paper display. (Digital Picture Frames & E-Ink, 1,192 GitHub stars)

How we picked: buildable projects only, most GitHub stars first, one per category.

Which variant to buy

The ESP32-S3 is the safe default: 39 of the 78 builds name it, far ahead of any other variant. Most of the rest list a plain "ESP32" or a specific dev board without naming the chip variant. Check each build's parts list before you buy, because voice and camera builds often need a particular board with a microphone, speaker or camera already on it.

  • ESP32-S3 39
  • ESP32-C3 3
  • ESP32-C6 1
  • ESP32-P4 1

All 78 ESP32 projects

Get five new builds every Thursday

Five hardware builds every Thursday. Email only, no tracking cookies, unsubscribe in one click. We never share your address.

Built something? Submit a build