Building a Local Voice AI Assistant with SwiftUI and CSM-1B on Apple Silicon
A developer shared their side project mobiGlas, a SwiftUI app that turns an OpenClaw AI assistant into a hands-free voice companion. The app runs entirely on Apple Silicon with local speech-to-text, local LLM, and local voice cloning using CSM-1B — no cloud dependencies.
Key Details
- Trigger: Say "Hey Skippy" into AirPods to start a conversation.
- Voice: Uses CSM-1B voice cloning model running locally on an M2 Ultra. Generates ~15 seconds of audio in about 7 seconds.
- Stack:
- OpenClaw — AI assistant framework running on Mac
- mobiGlas — SwiftUI app with real-time speech-to-text and text-to-speech
- CSM-1B — Local voice cloning model
- AirPods — hands-free audio I/O
- Status: v0.1 (described as "janky but functional"). The feel of walking around having a conversation with AI is reportedly "genuinely wild."
- Voice example: The developer cloned the voice of R.C. Bray (narrator of Expeditionary Force) as the assistant "Skippy."
Next Steps
The developer plans to smooth the experience for daily use cases like news briefings, reminders, and talking through ideas out loud.
If you're experimenting with local voice AI on Apple Silicon, the developer is looking to compare notes.
📖 Read the full source: r/openclaw
👀 See Also
free-claude-code adds GLM-5 support via NVIDIA NIM, expands to OpenRouter and Discord
free-claude-code now supports GLM-5 through NVIDIA NIM's free tier (40 requests/min) and adds OpenRouter integration, Discord bot support, and LMStudio local provider compatibility. The tool converts Claude Code's Anthropic API requests to work with alternative model backends.
Maestro v1.5.0 adds Claude Code support for multi-agent orchestration
Maestro v1.5.0, an open-source multi-agent orchestration platform, now runs as a native plugin on Claude Code in addition to Gemini CLI. The update includes deeper design planning, a 42-step orchestration backbone, agent capability enforcement, and security hardening.
PocketTeam: A Claude Code Pipeline with Hook-Based Safety and Learning Agents
PocketTeam is a Claude Code pipeline that implements 9 safety layers at the tool-call level to block dangerous operations like writes to .env or rm -rf commands. The system includes an Observer agent that analyzes completed tasks and writes structured learnings to improve future agent performance.
Antibody System: Out-of-Band Watchdog for OpenClaw Agents
The Antibody System is an open-source watchdog that runs on a separate machine and monitors OpenClaw agents over SSH, implementing tiered responses from detection to service recovery. It's designed to survive failures that take down the primary agent.