DAIR Institute

2023-04-24 03:29:55

Mystery AI Hype Theater 3000, Episode 9 - Call The AI Quack Doctor

Alex and Emily discuss the not-so-real medical and healthcare applications of ChatGPT and other large language models.
Plus another round of fresh AI hell.

And introducing our new theme song, by composer Toby Menon!

References:
Glass.ai makes “diagnosis machine”:
https://twitter.com/AiBreakfast/status/1620128621821317125?t=Q6tTAOcGAoFJ3Ko9m4EC9g&s=19

Percy Liang claims 'PubMedGPT' can pass medical exams:
https://crfm.stanford.edu/2022/12/15/pubmedgpt.html
https://twitter.com/percyliang/status/1603469265583353856?s=20&t=SdWeINzUw92pbkTO8OAVqQ

Emily's reaction to the above:
https://twitter.com/emilymbender/status/1603766381807570944?s=20&t=SdWeINzUw92pbkTO8OAVqQ

ChatGPT gets 60 percent of questions right in US Medical Licensing Exam:
https://healthitanalytics.com/news/chatgpt-passes-us-medical-licensing-exam-without-clinician-input

An Apple Watch error is clogging up 911 lines:
https://www.nytimes.com/2023/02/03/health/apple-watch-911-emergency-call.html

ChatGPT-assisted diagnosis: Is the future suddenly here?
https://www.statnews.com/2023/02/13/chatgpt-assisted-diagnosis/

NVIDIA “eye contact” demo:
https://twitter.com/Jousefm2/status/1616878021280993284

“Theory of the mind":
https://twitter.com/LChoshen/status/1623575423652139015?t=Ohc9tzB09pAEddAReLc6mA&s=09

Preprint on "theory of the mind" by Michael Kosinski: https://arxiv.org/abs/2302.02083

You can check out future streams at http://twitch.tv/dair_institute.

Follow Emily at https://twitter.com/EmilyMBender and https://dair-community.social/@EmilyMBender
Follow Alex at https://twitter.com/alexhanna and https://dair-community.social/@alex

Music: Toby Menon.
Production: Christie Taylor.

ChatGPT-assisted diagnosis: Is the future suddenly here? - STAT

For online diagnosis, ChatGPT outperformed Google search and symptom checkers, and came close to diagnoses from real physicians.

^{Ateev Mehrotra (STAT)}