Karpathy's Autoresearch Ported to Apple Neural Engine for Better Throughput per Watt
A new prototype project combines Andrej Karpathy's autoresearch with reverse-engineered Apple Neural Engine (ANE) performance, available at github.com/fiale-plus/autoresearch-ane. The primary appeal is achieving better throughput per watt compared to official APIs.
Project Details
The project was described as "gluing the concepts together" and is currently a prototype that needs longer testing runs. The author credits Claude for the implementation and acknowledges miolini for the original MacOS port idea.
Technical References
- Autoresearch: github.com/karpathy/autoresearch - Andrej Karpathy's original project
- ANE Project: github.com/maderix/ANE - Reverse-engineered Apple Neural Engine performance
- MacOS Port: github.com/miolini/autoresearch-macos - Original MacOS implementation
The project represents an experimental approach to hardware utilization optimization, with the expectation that performance will improve as the underlying ANE project matures. This is particularly relevant for developers working on Apple silicon hardware who want to maximize local inference efficiency.
📖 Read the full source: r/LocalLLaMA
👀 See Also
PromptForest: Local-First Prompt Injection Detection with Uncertainty
PromptForest is a lightweight, local-first library that detects prompt injections and jailbreaks, classifying them while evaluating certainty, all without increasing average request latency.
Sentrial: Production Monitoring for AI Agents
Sentrial is a monitoring tool that automatically detects failure patterns in AI products including loops, hallucinations, tool misuse, and user frustrations. It diagnoses root causes by analyzing conversation patterns, model outputs, and tool interactions.
Claude Dispatch Beta: Setup Tips and Initial Impressions
A developer shares their experience setting up Claude's Dispatch beta on a Mac Mini, highlighting the need for constant uptime, specific success criteria, and aggressive permissions with Computer Use enabled.
Claude adds interactive chart and diagram creation feature
Claude can now generate interactive visuals including charts, diagrams, and explorable breakdowns directly within conversations. The feature is available in beta across all plans including free tier.