4·
6 days agoThey studied 52 doctors responses to standardized (read publicly available online) cases written in front of them.
…
Then they ran 3 trials solely with LLM and find that these were significantly better.
How do they know that the answers to the “standardized” publically available case studies were not in the training data of the LLM? Isn’t it extremely likely that they were?
no body shaming please