60% about news content, which I think is an important distinction. LLMs are basically lossy compressions of text, meaning their knowledge is frozen to the same time as their dataset. The fact that they are right even 40% of the time is the truly surprising thing.

It’s completely irresponsible for search engines to be using LLMs for news and current events. Science or history facts are probably a lot more reasonable though.