Single-page chatbot interface for locally running Gemma 4 26B A4B

A developer has created a single-page HTML chatbot interface designed to work with Gemma 4 26B A4B running locally. The implementation connects to LM Studio's API and provides a complete chatbot interface in a single HTML file.

Technical Implementation

The system runs Gemma 4 26B A4B locally with a 32K context window, achieving 50-65 tokens per second. The model is sharded between two GPUs: a 7900 XT and a 3060 Ti.

Interface Features

• Full streaming support for real-time responses
• Markdown rendering for formatted output
• Model selector for switching between available models
• Six parameter sliders for fine-tuning model behavior
• Message editing with history branching capabilities
• Regenerate function for response regeneration
• Abort button to stop generation mid-stream
• System prompt support for custom instructions

Development Details

The developer notes that Claude was used to fix two DOM bugs that Gemma couldn't resolve. All other development work was completed using Gemma 4. The project is available on GitHub for examination and use.

This type of single-page interface is particularly useful for developers working with local LLMs who want a lightweight, customizable chat interface without the overhead of complex web applications. The integration with LM Studio's API makes it compatible with various local models beyond just Gemma.