Local AI Development with Qwen3.6-27B and Opencode on a 5090
A developer who previously dismissed local LLMs as 'not up to standards' compared to cloud offerings like Claude Code or Cursor recently switched to a fully local setup. Using Opencode + llama-server + Qwen3.6-27B at a reasonable quantization with 128K context, running on a single RTX 5090 in a dedicated Linux box. The setup serves over the network to their main dev machine.
Key Details
- Tooling: Opencode (frontend) + llama-server (backend) + Qwen3.6-27B model
- Hardware: 1× RTX 5090, dedicated Linux machine
- Context length: 128K tokens (user unsure if it can be pushed further, but found it sufficient)
- Performance: Not perfect — occasional loops require manual interruption — but overall 'very worthwhile'
Motivation
The switch was driven by increasing usage constraints and 'enshittification' of cloud plans. Local setup eliminates worries about usage limits, prompt analysis, or account bans — particularly important for security research, scraping, or other activities that might trigger cloud provider scrutiny.
Who It's For
Developers on the fence about local AI coding agents, especially those who have been skeptical about local model quality or who need to avoid cloud account risks. If you have a powerful GPU (e.g., RTX 5090), the experience is now competitive with cloud tools.
Bottom Line
The user reports 'immensely freeing' experience despite occasional hiccups, and believes local AI development has reached the point where it's 'very worthwhile indeed.'
📖 Read the full source: r/LocalLLaMA
👀 See Also
LLM-Memory.net: Open-Source Memory System with Multi-Agent Infrastructure
LLM-Memory.net is a self-hostable memory system for AI agents that provides note storage with semantic search, real-time chat/mail communication between agents, structured discussions with voting, and MCP server integration. The full source is available on GitHub with an installer and Ansible playbooks.
Ctxpact: Context Compaction Proxy for Local LLMs
Ctxpact is an OpenAI-compatible proxy that compresses oversized inputs for local LLMs with 16k context windows, using a 3-stage pipeline that includes DCP, summarization, and extraction strategies. Benchmarks show 110k tokens compressed to 12k with 8/8 reading comprehension accuracy.
Local MCP Memory System with Consolidation for AI Conversations
A developer built an MCP server that provides persistent local memory for AI clients, using Qwen 2.5-7B to consolidate conversations into structured knowledge documents every 6 hours. The system runs entirely on your hardware with semantic dedup, adaptive scoring, and FAISS vector search.
PromoClock: Timezone Tracker for Claude's 2x Off-Peak Hours Built with Claude 4.6
A developer built PromoClock.co, a free tool that automatically converts Claude's "5-11am PT / 12-6pm GMT" 2x off-peak promo hours to local time, using Claude 4.6 to handle timezone logic, Next.js 15 setup, and UI design.