Stanford CS 25 Transformers Course Opens to Public with Live Streaming
Stanford University's CS 25 Transformers course, a seminar focused on transformer architecture research, is now open to public participation through live streaming and auditing options.
Course Details
The course runs on Thursdays from 4:30-5:50pm PDT, starting January 23, 2025. Sessions are held at Stanford's Skilling Auditorium with simultaneous Zoom access for remote participants. All lectures will be recorded and made available online.
Course Content
Each week features researchers discussing transformer breakthroughs, including:
- LLM architectures like GPT and Gemini
- Creative applications in art generation (DALL-E, Sora)
- Biology and neuroscience applications
- Robotics implementations
Speaker Lineup
Previous and upcoming speakers include:
- Andrej Karpathy (former Tesla AI director)
- Geoffrey Hinton (deep learning pioneer)
- Jim Fan (NVIDIA AI researcher)
- Ashish Vaswani (co-author of "Attention Is All You Need")
- Researchers from OpenAI, Anthropic, Google, and NVIDIA
Access Information
The course website is https://web.stanford.edu/class/cs25/. Previous lectures have accumulated millions of views on YouTube, with the Andrej Karpathy session ranking as Stanford's second most popular YouTube video in 2023. A Discord server with 6000+ members is available through the website link.
This iteration of CS 25 is sponsored by Modal, AGI House, and MongoDB.
📖 Read the full source: r/LocalLLaMA
👀 See Also
PrismML's Bonsai 1-bit Qwen models tested: 107 t/s generation on 8GB VRAM
Bonsai models from PrismML are 1-bit quantized versions of Qwen3 8B, 4B, and 1.7B that achieve 107 tokens/second generation and >1114 t/s prompt processing on an RTX 4060 with 8GB VRAM, with significantly reduced memory requirements.
VS Code to Enable Co-Authored-by Copilot Trailer by Default
Microsoft's VS Code PR #310226 changes the git.addAICoAuthor setting default from 'off' to 'all', automatically adding a Co-authored-by trailer for AI-generated contributions. The PR also reveals a runtime fallback mismatch in repository.ts.
Context Quality Degradation in AI Agents: Hallucination Rates Increase with Token Count
Testing shows hallucination rates increase from ~3% at 10K tokens to ~28% at 200K tokens, with recall accuracy dropping below 90% for early-session information once context exceeds 50K tokens.
Clarifying OpenClaw's Automation Capabilities
OpenClaw doesn't perform fully automated tasks independently; it requires user guidance for setup, acting more like a traditional LLM.