Gemma4 26B-A4B Delivers Fast Local Performance with Web Search and Image Support
Gemma4 26B-A4B Performance and Features
The gemma-4-26B-A4B model demonstrates strong performance for local use, with the source reporting speeds of approximately 145 tokens per second when running on an RTX 4090 GPU. This combination of capability and speed makes it suitable for responsive local applications.
Key Features from Source
- Model: gemma-4-26B-A4B
- Performance: ~145 t/s (tokens per second) on RTX 4090
- Integration: Web search MCP (Model Context Protocol) support
- Multimodal: Image support included
- Platforms: Setup documented for Mac and iPhone usage
The source mentions that the experience can be improved with simple tricks and a short system prompt, though specific details about these optimizations are not provided in the excerpt. The author has documented their complete setup process in a blog post that covers configuration and usage across multiple devices.
For developers interested in implementing this setup, the full configuration details, system prompts, and optimization techniques are available in the referenced blog post at the provided URL.
📖 Read the full source: r/LocalLLaMA
👀 See Also
Total Recall: Local Knowledge Graph for Claude Code Conversation History
Total Recall is an open-source system that ingests Claude Code's JSONL conversation transcripts into a SQLite database with full-text search and vector embeddings, making conversation history searchable across sessions. It retrieves actual conversation excerpts with DAG-aware context and includes a ChatGPT importer.
Automated .xcstrings Localization with Claude Code
A new Claude Code skill automates localization of Xcode .xcstrings files with five pipeline stages: domain scanning, comment generation, translation with CLDR plurals, grammar checking, and plural fix conversion.
Claude Skills Silently Override Instructions: Undocumented Pitfalls Exposed
User discovers Claude skills silently enforce hard limits on user input via `ask_user_input_v0` (max 3 questions, 4 options each), `Write` overwrites files while `create_file` refuses on Claude.ai, and relative paths in `references/` don't resolve. A community repo catalogs findings.
Claude-rank: Claude Code Plugin for AI Search Visibility Audits
Claude-rank is a free Claude Code plugin and CLI that audits technical foundations for AI search visibility, handling technical SEO, AI citability scoring, crawlability checks for AI bots, and automated fixes for discoverability issues.