OpenEvol: Offline Self-Improvement Pipeline for LLMs Using Conversation History

What OpenEvol Does

OpenEvol is an offline self-improvement pipeline for large language models that automatically converts AI conversation history into training data. The tool mines high-value exchanges from conversations, judges their quality, and generates fine-tuning datasets without manual labeling or proprietary data flywheels.

How It Works

The pipeline runs through four automated stages:

• Mine high-value exchanges from conversations
• Judge quality using rules with an optional teacher LLM
• Synthesize SFT, preference, and pretraining datasets
• Fine-tune with one command

This creates a closed loop where the model learns from its own experience.

Technical Details

No GPU is required to get started - the full pipeline runs on CPU with a mock or OpenAI-compatible teacher backend. You can bring a GPU when ready to train.

Five teacher backends are supported:

• Mock
• Rule-based
• OpenAI-compatible API (any local proxy works)
• HuggingFace Transformers
• vLLM

Usage Options

Three ways to use OpenEvol:

• CLI for offline batch runs
• REST API server for automation
• OpenClaw desktop plugin that lets you trigger pipeline runs directly from chat

Quality Control

Every batch is automatically scored. If the approval rate drops below 80%, training is blocked and flagged for human review, giving users control over what data gets used for training.

This type of tool is useful for developers who want to improve their AI coding agents using actual conversation history without sending data to external services.