❌

Normal view

Why a Tiny GPT Can Know Two Facts and Still Not Connect Them

5 November 2026 at 12:00

A tiny GPT memorized every fact I gave it, then couldn’t answer a single question that needed two of them. I tested the one-line fix from a recent paper, and it only half worked.

The post Why a Tiny GPT Can Know Two Facts and Still Not Connect Them appeared first on Towards Data Science.

Is the #1 AI Model Really #1?

29 October 2026 at 12:30

On a 2,000-question test, my top two models couldn't be told apart at the usual 5% level. On a 200-question version, a different model would have taken first place about three times in ten.

The post Is the #1 AI Model Really #1? appeared first on Towards Data Science.

Your Six AI Models Are Really Two: The Math of Correlated Mistakes

23 October 2026 at 11:00

Ask several models the same question, take a vote, and you get fewer independent opinions than you paid for. One formula says how many, and I checked it on six open models and 1,500 exam questions.

The post Your Six AI Models Are Really Two: The Math of Correlated Mistakes appeared first on Towards Data Science.

Why Temperature 0 Isn't Deterministic

10 October 2026 at 12:00

A one-line formula for how often an LLM's top token flips, and why identical completions fall apart after about a hundred tokens

The post Why Temperature 0 Isn't Deterministic appeared first on Towards Data Science.

❌