Skip to content
HardwareLab

Sienna

Push-to-talk ESP32-S3 companion backed by Claude.

By keysforthewin

Est. cost
Cost unknown
Posted
GitHub stars
1 (GitHub)
Sienna: GitHub repository card
No photo in the source; showing the GitHub repository card.

Overview

Sienna is a push-to-talk desk companion: an ESP32-S3 with a microphone, speaker, camera, LEDs and light sensor, paired with a server-side Claude or Gemini agent that has persistent memory and an evolving personality.

How it works

Holding the button streams speech to ElevenLabs Scribe for real-time transcription. The agent's reply comes back as expressive ElevenLabs v3 speech, sent sentence by sentence. Memories and a self-editable personality live in MongoDB. The agent can look through the camera, play music from YouTube, and control LEDs and timers over a WebSocket bridge.

Hardware

  • ESP32-S3
  • mic
  • speaker
  • camera
  • LEDs

This page is a short summary written by HardwareLab. Build steps, code and photos belong to the creator; follow “View original” for the full project.

See all 32