SkillOpt: Optimizing Markdown Skill Files as Trainable Parameters for AI Agents
SkillOpt is a new optimization framework that treats markdown skill files as trainable parameters, applying proper optimization machinery to the ad-hoc skill editing many agent builders already do. The paper (arxiv.org/pdf/2605.23904) formalizes a process: a frontier model proposes bounded edits (add/delete/replace) to markdown skill files, and each edit is gated against a held-out validation set. Only strict improvements are accepted; ties are rejected, and rejected edits become negative signal for subsequent rounds.
Key Findings
- Convergence: Best skills converge with 1 to 4 accepted edits out of many more proposals. An edit budget of 4 to 8 per step works best; removing the cap causes performance to collapse.
- Skill size: The median final skill is ~920 tokens.
- Model transfer: A skill optimized on Codex transferred to Claude Code with zero modification and gained +59.7 on SpreadsheetBench. GPT 4.1 Nano with an optimized skill roughly matched frontier models on procedural benchmarks.
Limitations
The validation gate requires an auto-grader with clear correct answers. This works for code and spreadsheets but breaks for anything open-ended.
Who It's For
Developers building AI coding agents who want to systematically optimize skill files rather than relying on manual iteration or ad-hoc prompt engineering.
📖 Read the full source: r/LocalLLaMA
👀 See Also
Building syntaqlite: A SQLite DevTools Project Created with AI Assistance
Lalit Maganti built syntaqlite, a set of developer tools for SQLite, over three months using AI coding agents after wanting it for eight years. The project required parsing SQL exactly like SQLite, which involves adapting SQLite's dense C codebase with over 400 grammar rules.
Rowboat: Open-Source AI Coworker with Knowledge Graph Memory
Rowboat is an open-source app that transforms your work into a living knowledge graph, storing data locally as Markdown, and offering AI-driven local assistance.
OpenClawDreams: A Dream Simulator Extension for OpenClaw Agents
OpenClawDreams is an extension that adds a background reflection process and nightly dream cycle to OpenClaw agents. It captures encrypted conversation summaries to a local SQLite database, processes them during background cycles, and generates consolidated insights that get pushed into the agent's persistent memory.
SmallClaw v1.0.2 adds background task system for local LLMs
SmallClaw v1.0.2 introduces a background task engine that runs multi-step workflows autonomously, with step verification to address small model reliability issues. The update has been tested on 4B-class models like qwen3:4b on 8GB machines.