Skip to content

Tag

AI PC

5 posts

Windows Learns GGUF as AI Agents Design Their Own Inference Chip
Edge AI5 min read

Windows Learns GGUF as AI Agents Design Their Own Inference Chip

Microsoft wires llama.cpp into Windows ML's NPU stack while an agent-built FPGA accelerator and fresh AI PC benchmarks show where edge inference actually stands.

133 views
Read
AI PCs Go Big: A 300B-Parameter Desktop, an 80-TOPS Mini PC, and Edge NPUs Redraw the Local-Inference Map
Edge AI4 min read

AI PCs Go Big: A 300B-Parameter Desktop, an 80-TOPS Mini PC, and Edge NPUs Redraw the Local-Inference Map

GMKtec, ASUS and Radxa all shipped NPU hardware this week while OpenVINO and a Qualcomm robotics runtime pushed what those chips can actually run.

183 views
Read
AMD, Qualcomm and NVIDIA All Chase the Same Local-AI Bottleneck: Memory
Edge AI5 min read

AMD, Qualcomm and NVIDIA All Chase the Same Local-AI Bottleneck: Memory

Three chipmakers and a mini-PC builder all attack the same problem this week: getting AI inference closer to memory, not just closer to silicon.

183 views
Read
Edge Dispatch: Intel's Wildcat Lake Brings a Modest NPU to AI PCs, While Edge AI Claims It's Going Mainstream in IoT
Edge AI3 min read

Edge Dispatch: Intel's Wildcat Lake Brings a Modest NPU to AI PCs, While Edge AI Claims It's Going Mainstream in IoT

Intel details a 17 TOPS NPU chip built for chiplets, and an industry trend piece argues edge inference is leaving the pilot stage — both light on independent proof so far.

120 views
Read
Edge Dispatch: AMD's Ryzen AI Halo Jumps to 192GB While Qualcomm Pushes On-Device AI Agents
Edge AI5 min read

Edge Dispatch: AMD's Ryzen AI Halo Jumps to 192GB While Qualcomm Pushes On-Device AI Agents

AMD bumps its NPU mini PC to 192GB of unified memory, Qualcomm ships five agentic apps for Snapdragon X, and Korea rethinks its NPU strategy.

228 views
Read