Granitepi 4 Nano
Run IBM Granite 4.0 locally on a Pi 5.
By Jewelzufo
- Est. cost
- Cost unknown
- Posted
- GitHub stars
- 11 (GitHub)
Overview
A beginner-friendly guide and setup script for running IBM's Granite 4.0 350M model entirely on a Raspberry Pi 5 with Ollama: private, offline and free.
How it works
A one-click script installs Ollama and a GGUF-quantised build of the 350M-parameter hybrid Mamba-2 model, with thread settings tuned for the Pi 5 CPU. The download is about 366 MB and it uses about 0.8–1.2 GB of RAM while running. Everything works offline after setup.
Hardware
- Raspberry Pi 5
This page is a short summary written by HardwareLab. Build steps, code and photos belong to the creator; follow “View original” for the full project.
More in Local LLM Rigs & Edge Agents
See all 17Esp32 Iphone Agent
A $7 ESP32 lets an AI drive a real iPhone via AirPlay and USB HID.
- ESP32 (USB HID)
- iPhone
IntermediateCost unknown1.4KPocket Tank
A 14M-parameter LLM keeps a virtual fish tank alive on an $8 ESP32.
- ESP32-S3
AdvancedCost unknown207Needle 2 Esp32
45M-parameter LLM offline on an ESP32-S3 turning English into valid commands.
- ESP32-S3
AdvancedCost unknown193