Hacker News (curated)new | past | comments | ask | show | jobs| show hidden

> Training an LLM on content produced by the LLM gives it the equivalent of a digital prion disease, so when a source is guaranteed to be LLM-free, like the entire history of kernel commits, it's worth its weight in gold as a source of training data.

Except the majority of LLM training content nowadays is synthetically generated by LLMs. I wish people would stop making this statement, I don't know why this claim persists to this day. It wasn't true two years ago and it sure isn't true now





Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact | github