Karpathy's Autoresearch Ported to Apple Neural Engine for Better Throughput per Watt
A new prototype project combines Andrej Karpathy's autoresearch with reverse-engineered Apple Neural Engine (ANE) performance, available at github.com/fiale-plus/autoresearch-ane. The primary appeal is achieving better throughput per watt compared to official APIs.
Project Details
The project was described as "gluing the concepts together" and is currently a prototype that needs longer testing runs. The author credits Claude for the implementation and acknowledges miolini for the original MacOS port idea.
Technical References
- Autoresearch: github.com/karpathy/autoresearch - Andrej Karpathy's original project
- ANE Project: github.com/maderix/ANE - Reverse-engineered Apple Neural Engine performance
- MacOS Port: github.com/miolini/autoresearch-macos - Original MacOS implementation
The project represents an experimental approach to hardware utilization optimization, with the expectation that performance will improve as the underlying ANE project matures. This is particularly relevant for developers working on Apple silicon hardware who want to maximize local inference efficiency.
📖 Read the full source: r/LocalLLaMA
👀 See Also
engram: Claude memory plugin with salience-gated capture and dream cycles
engram is a Claude memory plugin that filters observations at capture time using 5 salience dimensions, persisting only high-scoring events to SQLite with no LLM calls in scoring. It features automatic injection through 5 hooks and dream cycles that extract recurring workflows at session end.
ETL-D MCP Server: Deterministic CSV Parsing for Claude to Prevent Financial Hallucinations
A developer built ETL-D, an open-source MCP server for Claude Desktop that processes CSVs in three deterministic layers to prevent decimal point hallucinations in financial data. It uses Python parsers for known formats, achieves ~70ms response times with 0 LLM calls for 200 parallel requests, and only uses LLMs as a fallback for high-entropy text.
CostClaw: Free Local Cost Tracking Dashboard for OpenClaw Agents
CostClaw is a free, local plugin that captures every LLM call via OpenClaw's native hooks and provides a dashboard showing model breakdowns, per-session costs, and hourly spend charts. The developer discovered their heartbeat agent was running Claude Sonnet every 3 minutes 24/7, costing $60/month, and switching to Haiku cut their bill by ~65%.
Claude Code v2.1.166: Fallback Models, Glob Deny Rules, Cross-Session Hardening
Claude Code v2.1.166 introduces up to 3 fallback models, glob pattern support in deny rules, hardened cross-session messaging, and fixes for terminal flickering, orphaned processes, and more.