Skip to content

Tag

ExecuTorch

3 posts

ExecuTorch Hits 1.0 as llama.cpp Learns to Make Instant AI Decisions
Edge AI4 min read

ExecuTorch Hits 1.0 as llama.cpp Learns to Make Instant AI Decisions

PyTorch declares its on-device AI runtime production-ready while llama.cpp adds a decision-model endpoint and two new NPU modules land for edge boards.

170 views
Read
Runtimes on the Move: llama.cpp, ExecuTorch and LiteRT All Update as Edge AI's Software Layer Speeds Up
Edge AI4 min read

Runtimes on the Move: llama.cpp, ExecuTorch and LiteRT All Update as Edge AI's Software Layer Speeds Up

llama.cpp shipped two builds in two days, ExecuTorch hit 1.0 with new NPU backends, and LiteRT tuned fp16 kernels for mobile CPUs.

166 views
Read
Runtimes Race Ahead: llama.cpp 0.4.0 and a 30B On-Device AI Agent Test the Edge's Limits
Edge AI4 min read

Runtimes Race Ahead: llama.cpp 0.4.0 and a 30B On-Device AI Agent Test the Edge's Limits

A new llama.cpp release, an ExecuTorch-powered 30B agent model, a cheap RK3576 vision board, and a DIY Jetson robot dog mark a busy week for edge toolchains.

128 views
Read