0:11
When a model gets dramatically better at one specific benchmark, what does that actually prove? Today's board had a clean test case. Good job, "it got really super good at that 2D game puzzle," I said on the show, but does that skill move anywhere else, or does it only exist inside the test?
Getting better at the benchmark and getting genuinely more capable are not the same achievement, and we keep getting sold the first one as the second. Next time a chart jumps, ask what it can now do that it couldn't before, not just how high the number went.
Where this came from
Value-First AI Daily - Aug 24, 2026Watch the full conversation this clip was pulled from.
The next step
