Local Voice Control Setup for AI Agents on Apple Silicon
This setup details how to implement local voice control for AI agents using Parakeet STT and Kokoro TTS on Apple Silicon, specifically tested on a Mac Mini M4. The goal was to achieve a fully local and fast voice interaction layer, eliminating dependencies on cloud services.
Key Details
- Hardware: Mac Mini M4 running OpenClaw + Claude as the AI agent.
- Software Setup: Parakeet for speech-to-text (STT) which transcribes voice input in approximately 240ms, and Kokoro for text-to-speech (TTS) that provides nearly instant responses.
- Benefits: Transitioning from typing to voice commands significantly enhances workflow flexibility, allowing for office-independent operation, such as from the balcony or while walking a dog.
- Challenges: Occasionally, the STT struggles with accent recognition, humorously leading to the AI agent correcting the user’s pronunciation.
- Enhancements: A browser extension incorporating a 3D avatar named Mimora enables visual interaction, showing various expressions like listening, thinking, and happy states during agent responses.
This configuration is ideal for those seeking cloud-independent, fast voice interaction with AI agents, particularly using Apple Silicon hardware.
📖 Read the full source: r/LocalLLaMA
👀 See Also
Fleet Commander: Open-source dashboard for orchestrating multiple Claude Code agent teams
Fleet Commander is a local web dashboard that runs multiple Claude Code agent teams in parallel on different issues. It uses a 'Diamond team' structure with Planner, Dev, and Reviewer agents that communicate peer-to-peer via SendMessage.
SWE-rebench-V2 Released: Largest Open Multilingual Dataset for Code Agent Training
Nebius has released SWE-rebench-V2, currently the largest open dataset for training coding agents, featuring an automated pipeline for extracting RL environments at scale and designed specifically for large-scale reinforcement learning training.
SOULS for AI Agents: A Community-Driven Personality Library
A Reddit user created an open-source repository of carefully crafted personality files ("souls") for AI coding agents. The repo currently includes Jarvis, Gojo, Eren Yeager, René Descartes, and Rapper, with a call for community contributions.
Building a Self-Improving Knowledge System with Claude Code and Obsidian
A developer built a 25-tool system that gives Claude Code persistent memory through semantic search, knowledge graphs, and spaced repetition over an Obsidian vault. The system indexes content with bge-m3 embeddings, detects contradictions, auto-prunes stale notes, and generates Obsidian Canvas maps automatically.