Cowork vs. Claude Chat: Document Extraction Accuracy Comparison
A developer building a tool for analyzing publicly traded stock annual reports conducted a controlled comparison between Claude.ai chat and Cowork for extracting data from dense financial PDFs. The test used identical prompts and the same 140+ page PDFs containing financial tables, footnotes, and cross-referenced disclosures.
Test Results
Test 1 - Claude.ai chat: Uploaded PDF, pasted prompt. Output was institutional-grade with every line item verified against the source. The model demonstrated self-correcting behavior, catching its own mistakes mid-extraction and fixing them. No errors were found across 150+ data points checked.
Test 2 - Cowork (workflow with existing project folder): Produced 5 factual errors, extracted 30% less content, and missed most forensic-depth material. While headline numbers were correct, detail on sub-components was lost.
Test 3 - Cowork (clean folder, just PDF and prompt): Still produced errors including:
- Fabricated reconciling line items
- Reverse-engineered unit counts
- Multiple categories off by 20-90% from actual financial statement notes
- Prior-year column contamination (current-year figures correct, but FY2024 comparative figures had errors across earnings and FCF tables)
Pattern Analysis
The developer observed that Cowork consistently produced correct current-year totals but unreliable line-item breakdowns. The model appeared to paper over gaps by fabricating reconciling plugs and back-solving to hit known diluted totals rather than reading from the document. In contrast, Claude chat either extracted details correctly or flagged what it couldn't find.
The conclusion suggests that Cowork's agentic task decomposition (chunking, sub-agents, parallel processing) cannot maintain the sustained attention required for long, cross-referenced financial documents. Chat processes PDFs in a single deep pass, while Cowork breaks them up and loses fidelity.
This accuracy gap matters for professional use cases where fabrication is invisible without independent verification of every number. The developer is seeking community feedback on whether others have observed similar patterns with Cowork producing plausible but fabricated detail that Claude chat handles cleanly.
📖 Read the full source: r/ClaudeAI
👀 See Also
AVP Protocol Enables LLM Agents to Share KV-Cache Instead of Text for Token Efficiency
AVP (Agent Vector Protocol) allows LLM agents to pass KV-cache directly between them instead of text, reducing token processing by 73-78% and achieving 2-4x speedups across Qwen, Llama, and DeepSeek models. The protocol works with HuggingFace and vLLM connectors and is available as a Python package.
cstat: A Native Rust Status Line for Claude Code with 2ms Performance
cstat is a native Rust binary that replaces claude-hud's 62ms status line with a 2ms implementation by eliminating 24 subprocess spawns per invocation. It displays model info, rate limits, git status, context window usage, active tools, subagents, and task progress.
A Pattern for Running Claude Code on Overnight Unattended Sessions Without Drift
A three-piece framework — chain runner, supervisor, and a single handoff contract — solves the feedback-loop drift problem in multi-hour autonomous Claude Code sessions.
ByteRover Memory Plugin for OpenClaw: Native Integration with Semantic Hierarchy
ByteRover Memory Plugin for OpenClaw provides native, structured long-term memory via a three-layer architecture and semantic hierarchy stored in Markdown files. It achieves 92.2% retrieval accuracy and requires OpenClaw v2026.3.22+.