Skip to content

Tag

ESP32

20 posts

ESP32 Special: Two Offline Voice-AI Builds Debut While a New Chip Powers a Display Board
Edge AI3 min read

ESP32 Special: Two Offline Voice-AI Builds Debut While a New Chip Powers a Display Board

Two fresh ESP32 voice-AI repos go fully offline, a mystery ESP32-S31 chip shows up on a display board, and an ESP32 radio hack learns to transmit.

30 views
Read
A 35B MoE Vision AI Learns to Fit a Phone While a $7 ESP32 Hijacks an iPhone
Edge AI4 min read

A 35B MoE Vision AI Learns to Fit a Phone While a $7 ESP32 Hijacks an iPhone

OpenBMB squeezes a 35B MoE vision model onto an iPhone, Google shrinks multimodal search to 191MB, and a $7 ESP32 learns to tap a real iPhone's screen.

51 views
Read
A 1-Bit AI Trick Shrinks a 70B Model to Fit on a $200 GPU
Edge AI4 min read

A 1-Bit AI Trick Shrinks a 70B Model to Fit on a $200 GPU

Samsung's sub-1-bit quantization paper gets a reality check, plus fresh research on tiny LLMs and ESP32 voice silicon.

78 views
Read
Small AI Models Steer Robots While ESP32 Boards Do the Grunt Work
Edge AI4 min read

Small AI Models Steer Robots While ESP32 Boards Do the Grunt Work

A dual-core Arduino runs robot policies on-device, a paper argues for skill-sized models over one big brain, and two ESP32 boards ship.

80 views
Read
A 14M-Parameter LLM Keeps a Virtual Fish Tank Alive on an $8 Chip
Edge AI4 min read

A 14M-Parameter LLM Keeps a Virtual Fish Tank Alive on an $8 Chip

A distilled LLM runs a fish tank on an $8 ESP32-S3, four Raspberry Pi 5s share a 30B model, and a 2B decision model lands for edge agents.

99 views
Read
ESP32 Special: Cloud Voices and an E-Ink Reader, No New On-Device LLM Yet
Edge AI3 min read

ESP32 Special: Cloud Voices and an E-Ink Reader, No New On-Device LLM Yet

Two ESP32 voice projects lean on cloud AI while a maker's e-ink reader builds the hardware the next on-device model will need.

202 views
Read
Meta Opens Muse to ESP32 Makers as a Tiny LLM Learns to Remember a Hidden Object
Edge AI5 min read

Meta Opens Muse to ESP32 Makers as a Tiny LLM Learns to Remember a Hidden Object

Meta ships ESP32 and Linux SDKs for its Muse AI, Qualcomm's next phones get 2nm NPUs, and a 68KB brain gives a cheap robot arm memory.

122 views
Read
Seven $5 Chips Learn to Share an LLM, One Bit at a Time
Edge AI5 min read

Seven $5 Chips Learn to Share an LLM, One Bit at a Time

A BitNet cluster splits an LLM across seven ESP32-S3 boards, a 2-bit tool-calling model lands on GitHub, and a quantization paper gets llama.cpp 15x faster on an M4 Pro.

237 views
Read
A 312K-Parameter LLM Learns to Flip Switches as Pi Prices Climb Again
Edge AI4 min read

A 312K-Parameter LLM Learns to Flip Switches as Pi Prices Climb Again

A tiny GPIO-control model and a Japanese TTS join the ESP32 pile-up while Raspberry Pi raises prices and a Jetson robot chases bubbles.

192 views
Read
ESP32 Special: Small LLMs Learn to Chat, Listen and Keep the Fish Alive
Edge AI4 min read

ESP32 Special: Small LLMs Learn to Chat, Listen and Keep the Fish Alive

A full day inside the ESP32 world: chatty microcontroller LLMs, a $5-chip speech model, and two new boards from Espressif's own community.

135 views
Read
Wearable AI Chips Land as an ESP32 Board Learns to Run a Full Offline Voice Loop
Edge AI4 min read

Wearable AI Chips Land as an ESP32 Board Learns to Run a Full Offline Voice Loop

From a Qualcomm earbud chip to an ESP32-S3 that hears, thinks and speaks with no cloud, edge AI keeps shrinking into pockets and ears.

179 views
Read
A $300 GPU Streams a 177B AI Model From an SSD While llama.cpp Learns to Skip Ahead
Edge AI4 min read

A $300 GPU Streams a 177B AI Model From an SSD While llama.cpp Learns to Skip Ahead

Community builders push token throughput further this week — via SSD-streamed MoE experts, prompt-lookup drafting, and a wrapper for Apple's built-in on-device LLM.

224 views
Read
A Classifier That Only Picks, a Model That Skips Tokens, and an AI Firm Bets 2.6B Parameters Can Do Agent Work
Edge AI4 min read

A Classifier That Only Picks, a Model That Skips Tokens, and an AI Firm Bets 2.6B Parameters Can Do Agent Work

Liquid AI ships a 2.6B agentic model for edge hardware, a 144M classifier skips text generation entirely, and a new paper shows byte-level LLMs can beat tokenized ones with sc

100 views
Read
A Diffusion Model and a 28.9M LLM Both Now Run on Bare Microcontrollers
Edge AI4 min read

A Diffusion Model and a 28.9M LLM Both Now Run on Bare Microcontrollers

An RP2350 draws faces from noise, an ESP32-S3 writes stories, and AI smart glasses squeeze in a 1-bit model — all without a server.

276 views
Read
The ESP32 Beat Skips the LLM Today: A Desk Companion, Drumsticks, and a JavaScript OS
Edge AI3 min read

The ESP32 Beat Skips the LLM Today: A Desk Companion, Drumsticks, and a JavaScript OS

Three ESP32 builds this week show the chip's range — a reactive desk companion, motion-sensing drumsticks, and a scripting OS — none of them running a language model.

170 views
Read
Jetson Thor Sprints Past llama.cpp While a 15M-Parameter LLM Still Fits an $8 Chip
Edge AI4 min read

Jetson Thor Sprints Past llama.cpp While a 15M-Parameter LLM Still Fits an $8 Chip

NVIDIA posts a 6.4x MLPerf edge win on Jetson AGX Thor, a dense TinyStories model skips the flash trick, and a paper splits VLA robots between cloud and a tiny local model.

226 views
Read
ESP32 Special: An $8 Chip Runs a 29-Million-Parameter LLM, and Vendors Rethink the Board Around It
Edge AI3 min read

ESP32 Special: An $8 Chip Runs a 29-Million-Parameter LLM, and Vendors Rethink the Board Around It

A one-chip LLM, a Wi-Fi upgrade to Seeed's tiny displays, and Tuya's push to make ESP32 an AI-agent target, not just a Wi-Fi one.

156 views
Read
Edge Dispatch: The $8 AI Chip Grows a Coffee Habit: ESP32 Tiny-LLM Trick Gets a Second Model
Edge AI4 min read

Edge Dispatch: The $8 AI Chip Grows a Coffee Habit: ESP32 Tiny-LLM Trick Gets a Second Model

A new 'Barista' model and a closer look at Google's Per-Layer Embeddings trick show what running an LLM on a microcontroller can and can't do.

145 views
Read
The 180M-Parameter LLM Running on a $10 Microcontroller — and Almost Nobody Noticed
Edge AI7 min read

The 180M-Parameter LLM Running on a $10 Microcontroller — and Almost Nobody Noticed

On August 5, 2026 a 180.9M-parameter mixture-of-experts LLM ran on a $6-10 ESP32-P4 — and got two Hacker News points. The undercovered microcontroller AI story of the year.

198 views
Read
Running an LLM on an $8 Microcontroller: What's Real in 2026
Edge AI9 min read

Running an LLM on an $8 Microcontroller: What's Real in 2026

In July 2026 a 28.9-million-parameter LLM ran fully on-device on an $8 ESP32-S3 at almost 10 tokens per second. Here's how the trick works, who built it, what's hype, and what you can actually build with a microcontroller LLM today.

340 views
Read