ESP32-S3 voice frontend
An ESP32-S3 voice frontend that keeps GPIO and network actions local.
By Roman Zolotarev
- Posted
Build sheet
- Board
- ESP32-S3
- Other parts
- INMP441 I2S mic, MAX98357A amp/speaker (Gerbers optional)
- AI model or service
- On-device wake word, Local VAD on the proxy server, cloud/enterprise or Google AI Studio LLM for intent, local function-calling agent
- Difficulty
- Intermediate
Overview
DIY ESP32-S3 + INMP441 + MAX98357A captures wake-word audio; a proxy server compresses the stream and runs local VAD, and a local voice-assistant binary runs webhooks, MQTT, GPIO, and shell exec while keeping network/GPIO away from the cloud model.
How it works
An ESP32-S3 with an INMP441 mic and MAX98357A amp handles the wake word and audio; a proxy server compresses the stream and runs local VAD before the model, and a local binary runs webhooks, MQTT, GPIO and shell actions while the model only sees intents.
Hardware
- ESP32-S3
- INMP441 I2S mic
- MAX98357A amp/speaker (Gerbers optional)
Like this build? Get the weekly builds
Get the best new AI hardware builds every Thursday. One email a week, free.
Built something? Submit a build
This page is a short summary written by HardwareLab. Build steps, code and photos belong to the creator; follow “View original” for the full project.
Featured? Add this badge
Built this? Paste the badge into your README. It links back to this page.
Markdown
[](https://hardwarelab.dev/projects/esp32s3-voice-frontend/?utm_source=badge&utm_medium=referral&utm_campaign=launch_2w)HTML
<a href="https://hardwarelab.dev/projects/esp32s3-voice-frontend/?utm_source=badge&utm_medium=referral&utm_campaign=launch_2w"><img src="https://hardwarelab.dev/badge.svg" alt="Featured on HardwareLab" width="188" height="20"></a>Related builds
All 43 in Voice Assistants & CompanionsXiaoZhi ESP32
An X post calls it the hottest open-source AI project in the whole ESP32 ecosystem (30.8k GitHub stars at the time).
- ESP32-S3
- I2S mic
- speaker
- +1 more
Intermediate30.9K
Local Xiaozhi on a Waveshare ESP32-S3 audio board
A Xiaozhi voice assistant that only talks to your own LAN server.
- Waveshare ESP32-S3-AUDIO-Board (ES8311/ES7210, dual mic AEC, amp, RGB LEDs)
Intermediate