Tag

on-device-llm

2 posts

An NPU-Only Runtime Lands for Ryzen AI as a Vintage Terminal Learns to Think Offline

Edge AI4 min read

An NPU-Only Runtime Lands for Ryzen AI as a Vintage Terminal Learns to Think Offline

A 17MB runtime puts LLMs entirely on AMD's XDNA2 NPU, an old terminal gets an offline brain, and Intel's NPU gets unlocked by reverse engineering.

A Solo Coder Brings Vision to a Local LLM as Edge Silicon and TinyML Builders Push Back the Frontier

Edge AI4 min read

A Solo Coder Brings Vision to a Local LLM as Edge Silicon and TinyML Builders Push Back the Frontier

DeepSeek V4 Flash gains on-device vision on a Mac, a $1 chip draws pictures, and Qualcomm ships new edge silicon ahead of IFA.