I was surprised to see that this lovely write-up wasn’t posted here already. Also see the author’s Mastodon post about it: https://wandering.shop/@aesthr/117470082684445346
I was surprised to see that this lovely write-up wasn’t posted here already. Also see the author’s Mastodon post about it: https://wandering.shop/@aesthr/117470082684445346
Neither AlphaGo, not AlphaFold are LLMs though.
Also the mathematical proofs you’re talking about seem to be mostly stolen by OpenAI from scientists that interacted with their chatbot before publishing their research.
That not fully true. The “problem” with math is that it is vast, so the building blocks for a proof are available but there is hardly anyone that has a wide enough interest to know about all the components. But AI is great at that. It read all the papers in all the disciplines and now can chain reasoning spanning all of it, a feat that’s impossible for a human.
And this makes their advances very tricky to evaluate. If a human did that, they would be a genius, but how do you evaluate a computer that did a very fancy word search across all publications?