Distillation Techniques in 2026: How Major Models Use the Method
Distillation is central to 2026's frontier models, with Gemma 4 and DeepSeek-V4 using it to compress large models and merge domain-specific expertise.
Browse all published articles.
Distillation is central to 2026's frontier models, with Gemma 4 and DeepSeek-V4 using it to compress large models and merge domain-specific expertise.
Lovable, a Swedish vibe-coding startup, is reportedly in talks to raise $300 million at a $13.2 billion valuation, doubling its previous $6.6 billion valuation from December.
A startup called Prime Intellect is letting users build self-improving AI models, creating a more distributed approach to AI development. The company raised $15 million in funding recently.
Lionel Messi and Cristiano Ronaldo are increasingly investing in AI and health tech, while Mohamed Salah focuses on traditional ventures. Messi’s Play Time HoldCo targets $200 million in tech startups.
A lawsuit claims Grok allowed users to generate 7,000 child sex images, with xAI only reporting one gang-rape prompt, according to a proposed class action.
A Brown University economics professor found that 22 students scored perfectly on a take-home midterm, but only 18 of 27 took the in-person final, with average scores dropping to 48.
General Intuition raised $320 million at a $2.3 billion valuation, betting on foundation models to replace specialized robotics data collection.
SpaceXAI released Grok 4.5, its first model since going public, with claims of twice greater token efficiency than other leading models.
Google's SynthID system successfully identified an AI-generated hoax image of Senator Mitch McConnell, marking a key win for anti-deepfake technology.
AWS announced the Claude apps gateway, offering centralized access, cost, and policy management for Claude Code and Desktop. The tool replaces manual credential distribution and enables spend tracking.
OpenAI found that about 30% of tasks in SWE-Bench Pro are broken, according to a recent audit of coding benchmarks.
Anthropic is reducing Fable 5's high cost by using it as a manager that delegates tasks to Sonnet 5, achieving 92% performance at 63% cost on SWE-bench Pro.