Local LLM Rigs & Edge AgentsAdvanced
Needle
A tiny tool-calling model built for cheap hardware.
- Est. cost
- Cost unknown
- Posted
- GitHub stars
- 13.9K (GitHub)
Overview
A 2-bit automation foundation model for tiny devices (8-29 MB) that handles tool calls, ASR and structured extraction. An X post says Needle 2 runs on ESP32-class hardware.
How it works
Quantized micro-model with its own inference runtime.
Hardware
- microcontrollers / small devices
This page is a short summary written by HardwareLab. Build steps, code and photos belong to the creator; follow “View original” for the full project.
More in Local LLM Rigs & Edge Agents
See all 17Esp32 Iphone Agent
A $7 ESP32 lets an AI drive a real iPhone via AirPlay and USB HID.
- ESP32 (USB HID)
- iPhone
IntermediateCost unknown1.4KPocket Tank
A 14M-parameter LLM keeps a virtual fish tank alive on an $8 ESP32.
- ESP32-S3
AdvancedCost unknown207Needle 2 Esp32
45M-parameter LLM offline on an ESP32-S3 turning English into valid commands.
- ESP32-S3
AdvancedCost unknown193