LetMeWatch: Python Plugin Adds Video Analysis to Claude via FFmpeg Scene Detection

A developer has created a Python plugin called LetMeWatch that enables Claude to analyze video content despite its lack of native video support. The tool addresses the specific use case of sending screen recordings of bugs to Claude for diagnosis.

How It Works

The plugin uses FFmpeg scene detection to extract only frames where the visuals actually change. It timestamps each extracted frame and feeds them to Claude in batches. This approach avoids using AI video models or complex infrastructure—it relies on frame extraction combined with Claude's existing multimodal vision capabilities.

Technical Implementation

• Written in Python (~200 lines of code)
• Uses FFmpeg for scene detection
• Extracts frames only when visual changes occur
• Adds timestamps to each frame
• Sends frames to Claude in batches
• Works on all platforms
• Open source (available on GitHub)

Practical Application

The developer tested the tool by recording a bug in a todo app and running the command /video-last. Claude successfully identified the exact line with the typo from watching the recording. This demonstrates how the tool can be used for debugging by having Claude analyze screen recordings of issues.

The project is available at github.com/BinyaminEden/letmewatch and represents a practical workaround for Claude's current video limitations using existing tools and Claude's vision capabilities.