Item

inknight · 2026-10-28T17:13:09.000Z

I don't trust AA scores after the last update to the index. Specially now that they are including private benchmarks that no one can test by themselves but only trust the entity doing them.

Marha01 · 2026-10-28T17:45:12.000Z

I don't like it much, but I understand. It's the only way to be objective. Models are trained and benchmaxxed on any popular public benchmarks.

JacobAsmuth · 2026-10-28T18:01:29.000Z

You'd prefer public questions and answer sheets that anyone can train on?