Skip to content

Tag

edge silicon

4 posts

AI PCs Go Big: A 300B-Parameter Desktop, an 80-TOPS Mini PC, and Edge NPUs Redraw the Local-Inference Map
Edge AI4 min read

AI PCs Go Big: A 300B-Parameter Desktop, an 80-TOPS Mini PC, and Edge NPUs Redraw the Local-Inference Map

GMKtec, ASUS and Radxa all shipped NPU hardware this week while OpenVINO and a Qualcomm robotics runtime pushed what those chips can actually run.

183 views
Read
Qualcomm Chases 30B AI Models on a Phone as Edge Silicon Keeps Multiplying
Edge AI4 min read

Qualcomm Chases 30B AI Models on a Phone as Edge Silicon Keeps Multiplying

A phone NPU claims 30B MoE inference, a 35B model streams from storage on a Mac, and an XDNA1 NPU gets a Linux bring-up.

193 views
Read
Quantization Papers Pile Up as Researchers Argue Over Where Small AI Should Spend Its Bits
Edge AI4 min read

Quantization Papers Pile Up as Researchers Argue Over Where Small AI Should Spend Its Bits

Fresh arXiv work rethinks quantization strategy and sustainability, an Apple-adjacent paper shrinks the dictation encoder, and new silicon and Jetson guidance round out the ed

153 views
Read
AMD, Qualcomm and NVIDIA All Chase the Same Local-AI Bottleneck: Memory
Edge AI5 min read

AMD, Qualcomm and NVIDIA All Chase the Same Local-AI Bottleneck: Memory

Three chipmakers and a mini-PC builder all attack the same problem this week: getting AI inference closer to memory, not just closer to silicon.

183 views
Read