Tolan's AI-Enabled Engineering Interview Process

Tolan has redesigned their engineering interview process to reflect how engineers actually work with AI coding agents. Instead of traditional algorithmic questions, they focus on practical skills that matter when AI writes most production code.
The Interview Structure
Candidates spend a morning at their San Francisco office working on a small problem that Tolan has solved themselves. The problem comes from a bare-bones Figma file or short spec, typically representing a simple flow or lightweight feature that would normally take a day or two to build.
Candidates have just a few hours to work on the problem, which isn't enough time to create a polished product. The constraint is intentional—they want to see how candidates work within limitations.
AI Tools Encouraged
Candidates are explicitly encouraged to use AI to solve the problem. Tolan provides licenses for Claude, Codex, Cursor, or Gemini if needed. The key expectation is that candidates must balance LLM-generated code against their own judgment—even if they aren't writing the code, they own the output.
What they're looking for:
- How candidates approach the problem
- How they structure a solution
- How they think through constraints
- How they decide what actually matters
Evaluation Criteria
After the work session, there's a 20–30 minute conversation about what was created. Interviewers ask what candidates would improve if they had more time, what they'd change before sending for review, and what they'd change before shipping.
Red flags include:
- Candidates who use LLMs to think through how the project should be completed (like screenshotting Figma and asking Claude to solve it)
- Candidates who don't question unclear specs
- Candidates who say "I'm still not sure what this part does" but wouldn't change anything before human review
Positive signals include:
- Clarifying problem statements and exploring edge cases
- Recognizing tradeoffs
- Pointing out when something feels weird or doesn't seem right
- Showing creativity (like building a mini-game to entertain users during LLM response waits)
- Knowing when work isn't good enough and how to improve it
The core philosophy: In a world where implementation is getting easier, what matters most is judgment. Working code isn't the finish line—understanding and maintaining it is.
📖 Read the full source: HN AI Agents
👀 See Also

Amazon Workers Invent Busywork to Meet AI Usage Quotas
To comply with internal mandates to adopt AI tools, Amazon staff are fabricating tasks, inflating usage stats, and gaming metrics—revealing flawed implementation of AI adoption policies.

Vibe Coding vs Agentic Engineering: The Blur Lines Are Getting Uncomfortable
Simon Willison reflects on how vibe coding and agentic engineering are converging in his own workflow, noting that he now trusts Claude Code to write production JSON API endpoints without reviewing every line — and that feels weird.

Pope Leo XIV's 'Magnifica Humanitas': A 40,000-Word Encyclical on AI Disarmament
Pope Leo XIV releases Magnifica Humanitas, a 40,000-word encyclical calling for AI disarmament, critiquing autonomous weapons, data colonialism, and tech monopolies. Co-founder of Anthropic present at release.

Anthropic releases Claude Code Remote Control for mobile development
Anthropic has launched Remote Control, a feature that lets Claude Code users control their local development sessions from mobile devices. Available initially to Claude Max subscribers, it requires version 2.1.52 and uses a QR code to sync sessions.