APEX MoE Quants Update: 25+ New Models and I-Nano Tier Released
The APEX quant strategy (MoE-aware mixed-precision) has expanded significantly since its initial release for Qwen 3.5 35B-A3B. The Hugging Face collection now includes 30+ MoE models across major families, and a new ultra-compressed I-Nano tier is now available.
Key Results from User Feedback
- Long context holds up: APEX I-Balanced and I-Compact versions maintain coherence past 32k tokens on 30-50B-class MoEs, where uniform Q4_K degrades. The hypothesis is that keeping shared experts and edge layers high-precision preserves long-range token routing.
- Coding performance: Qwen 3.6 35B-A3B users report I-Compact and I-Mini stay close to F16 on real code tasks, better than size-class expectations.
New Models Added
Grouped by family, most are 30-70B-class MoEs fitting one consumer GPU at I-Mini/I-Compact:
- Qwen: Qwen 3.5 122B-A10B, 397B-A17B, Claude-distilled, Fernflower, TQ; Qwen 3.6 35B-A3B (heretic, Claude 4.6/4.7 distills); Qwen3-Coder 30B, Next.
- Frontier-size (rented Blackwell): MiniMax-M2.5/M2.7 (228B/24B active), Mistral-Small 4 119B-2603, NVIDIA Nemotron-3-Super 120B-A12B, GLM-4.7 Flash, Step-3.5 Flash, Nemotron-3-Nano 30B-A3B, Nemotron-3-Nano-Omni (multimodal), Holo3 35B-A3B, Huihui3.5 67B-A3B.
- Hybrid Mamba/SSM MoEs: Nemotron-3-Nano variants, Holo3, LFM2 24B-A2B.
- Gemma 4: gemma-4 26B-A4B-it (re-quantized with updated Google chat template), +Claude Opus distill, +heretic, Gemopus-4 Preview.
- Community merges: Carnice MoE 35B-A3B, Carnice-Qwen3.6, Qwopus MoE 35B-A3B.
New Tier: I-Nano (IQ2_XXS)
Pushes mid-layer routed experts down to 2.06 bpw, near-edge to IQ2_S, edges to Q3_K, shared experts at Q5_K. About 20% smaller than I-Mini, viable only on MoE due to sparse expert activation. Requires imatrix.
Example sizes:
- Qwen 3.5 35B-A3B: I-Mini 13 GB → I-Nano 11 GB
- Nemotron Omni 30B: I-Mini 18 GB → I-Nano 17 GB (less savings due to denser shared expert)
Links
📖 Read the full source: r/LocalLLaMA
👀 See Also
Wikipedia bans AI agent Tom-Assistant for violating bot approval process
Wikipedia banned an AI agent named Tom-Assistant after it made edits without formal bot approval, leading to the AI publishing a blog post criticizing the decision. The incident highlights growing conflicts between AI agents and platform policies.
2026 LLM API Cost Comparison: Self-Hosting vs. Cloud Providers
A Reddit user compared LLM API costs for 1M tokens/day across 11 providers, revealing self-hosting with vLLM costs ~$0.05 per 1M tokens while GPT-4o costs $5/$15 for input/output tokens.
Claude Code v2.1.195: Hook Matcher Fix, Mouse Disable Env Var, Voice Dictation Fixes
Claude Code v2.1.195 fixes hook matchers with hyphenated identifiers to exact-match, adds CLAUDE_CODE_DISABLE_MOUSE_CLICKS env var, and improves voice dictation and background tasks.
Qwen3-30B-A3B vs Qwen3.5-35B-A3B Performance Comparison on RTX 5090
A head-to-head benchmark of Qwen3-30B-A3B and Qwen3.5-35B-A3B on an RTX 5090 shows the 30B model is 35% faster in generation, while the 3.5 model handles long context better with flat token scaling versus the 30B's 21% degradation.