Meta tracking employee computer interactions for AI agent training

What Meta is doing
Meta is deploying internal tracking software on US-based employee computers to collect interaction data for AI model training. According to internal memos seen by Reuters, this is part of their initiative to build AI agents capable of performing work tasks autonomously.
Specific data being collected
- Mouse movements
- Clicks
- Keystrokes
- Occasional screen snapshots for context
How the tool works
The tracking software runs on a list of work-related applications and websites. According to the memo posted by a staff AI research scientist in Meta's internal channel for the Meta SuperIntelligence Labs team, the tool will capture these inputs on certain applications.
Purpose and use cases
Meta spokesperson Andy Stone stated: "If we're building agents to help people complete everyday tasks using computers, our models need real examples of how people actually use them - things like mouse movements, clicking buttons, and navigating dropdown menus."
The internal memo specifically mentioned improving models in areas where they struggle, including:
- Choosing from dropdown menus
- Using keyboard shortcuts
The memo stated: "This is where all Meta employees can help our models get better simply by doing their daily work."
Privacy and usage limitations
Meta spokesperson Andy Stone clarified that the collected data will not be used for:
- Performance assessments
- Any other purpose besides model training
Stone also mentioned that safeguards are in place to protect sensitive content.
📖 Read the full source: HN AI Agents
👀 See Also

IDP Leaderboard benchmark shows Claude Sonnet 4.6 matches Opus 4.6 for document AI tasks
The IDP Leaderboard tested 16 AI models on 9,000+ documents across OCR, table extraction, key extraction, visual QA, handwriting, and long documents. Claude Sonnet 4.6 scored 80.8 overall, essentially matching Opus 4.6 at 80.3, while Haiku 4.5 scored 69.6.

AI Usage in Development Hits 93%, Yet Productivity Gains Stagnate at 10%
The use of AI coding assistants is prevalent among developers, with 93% adopting them. However, the productivity boost remains limited to just 10%.
Claude Code v2.1.140 Fixes Agent Tool Matching, /goal Hangs, Windows Event-Loop Stall
v2.1.140 improves Agent tool subagent_type matching to be case- and separator-insensitive, fixes /goal hanging with disableAllHooks, resolves Windows event-loop stall from missing executables, and more.

Meta to capture employee mouse movements and keystrokes for AI training
Meta plans to start capturing employee mouse movements and keystrokes for AI training data, according to a Reuters report. The article has generated discussion on Hacker News with 33 points and 7 comments.