Item

Fergusonb · 2026-10-28T17:07:43.000Z

Interesting - at time of writing, Carbon is claimed to be #1 on AA, but AA has not updated yet.

Excited to try it, opus level benchmarks with their omniscience score and multimodality seems worth testing!

inknight · 2026-10-28T17:13:09.000Z

I don't trust AA scores after the last update to the index. Specially now that they are including private benchmarks that no one can test by themselves but only trust the entity doing them.

Marha01 · 2026-10-28T17:45:12.000Z

I don't like it much, but I understand. It's the only way to be objective. Models are trained and benchmaxxed on any popular public benchmarks.

JacobAsmuth · 2026-10-28T18:01:29.000Z

You'd prefer public questions and answer sheets that anyone can train on?

verdverm · 2026-10-28T17:15:25.000Z

AA just updated their intelligence index to v5

https://artificialanalysis.ai/articles/artificial-analysis-i...

https://news.ycombinator.com/item?id=50268868

https://theainewsreport.com/2026-10-28-artificial-analysis-i...

IMO it emphasizes the wrong things if we are interested in "intelligence"

machiaweliczny · 2026-10-28T17:25:45.000Z

I think it's best ranking of models so far

verdverm · 2026-10-28T17:50:27.000Z

yea, I probably agree, but I also do not find it represents real world use and performance

There are many more aspects which affect outcomes