DAIR Institute

2023-06-20 02:39:25

Mystery AI Hype Theater 3000, Episode 13 - Beware the Robo-Therapist

Emily and Alex talk to UC Berkeley scholar Hannah Zeavin about the case of the National Eating Disorders Association helpline, which tried to replace human volunteers with a chatbot--and why the datafication and automation of mental health services are an injustice that will disproportionately affect the already vulnerable.

Content note: This is a conversation that touches on mental health, people in crisis, and exploitation.

---

Hannah Zeavin is a scholar, writer, and editor whose work centers on the history of human sciences (psychoanalysis, psychology, and psychiatry), the history of technology and media, feminist science and technology studies, and media theory. Zeavin is an Assistant Professor of the History of Science in the Department of History and The Berkeley Center for New Media at UC Berkeley. She is the author of, "The Distance Cure: A History of Teletherapy."

References:

VICE: Eating Disorder Helpline Fires Staff, Transitions to Chatbot After Unionization

… and then pulls the chatbot.

NPR: Can an AI chatbot help people with eating disorders as well as another human?

Psychiatrist.com: NEDA suspends AI chatbot for giving harmful eating disorder advice

Politico: Suicide hotline shares data with for-profit spinoff, raising ethical questions

Danah Boyd: Crisis Text Line from my perspective.

Tech Workers Coalition: Chatbots can't care like we do.

Slate: Who's listening when you call a crisis hotline? Helplines and the carceral system.

Hannah Zeavin: The Third Choice: Suicide Hotlines, Psychiatry, and the Police

New York Times hype: Using "AI" to diagnose mental disorders based on voice recordings, April 2022

Fresh AI Hell:

ChatGPT for city government work
https://www.japantimes.co.jp/news/2023/06/06/national/yokosuka-adopts-chatgpt/

ChatGPT as manuscript pre-screener for publishing companies:
https://www.publishersweekly.com/pw/by-topic/digital/content-and-e-books/article/92471-ai-is-about-to-turn-book-publishing-upside-down.html)
https://twitter.com/jgnoelle/status/1665729550922252288

A lawyer tried to use ChatGPT for “research”:
https://storage.courtlistener.com/recap/gov.uscourts.nysd.575368/gov.uscourts.nysd.575368.32.1.pdf
Legal scholar (and former MAIHT3K guest) Kendra Albert breaks down the story about a lawyer using ChatGPT for court proceedings:
https://dair-community.social/@kendraserra/110441210244994168

ChatGPT as investment advisor:
https://venturebeat.com/ai/jpmorgan-plans-for-a-chatgpt-like-investment-service-are-just-part-of-its-larger-ai-ambitions/

Professor asks “ChatGTP” if it wrote student’s assignments, and then gave them a 0 if it said yes.
https://twitter.com/Linkletter/status/1658591316991938560

---

You can check out future streams at http://twitch.tv/dair_institute.

Follow Emily at https://twitter.com/EmilyMBender and https://dair-community.social/@EmilyMBender
Follow Alex at https://twitter.com/alexhanna and https://dair-community.social/@alex

Music: Toby Menon.
Production: Christie Taylor.

JPMorgan’s plans for a ChatGPT-like investment service are just part of its larger AI ambitions

JPMorgan Chase is developing a ChatGPT-like service to provide investment advice to customers, but it is a small part of its AI ambitions.

^{Sharon Goldman (VentureBeat)}

DAIR Institute

2023-05-10 02:38:38

Mystery AI Hype Theater 3000, Episode 12 - It's All Hell

Take a deep breath and join Alex and Emily in hell itself, as they take down a month's worth of hype in a mere 60 minutes.

This episode aired on Friday, May 5, 2023.

---

References:

Terrifying NEJM article on GPT-4 in medicine:
https://www.nejm.org/doi/full/10.1056/NEJMsr2214184

“Healthcare professionals preferred ChatGPT 79% of the time”:
https://twitter.com/mdredze/status/1652025887355723776

Good thoughts from various experts in response:
https://www.sciencemediacentre.org/expert-reaction-to-study-comparing-physician-and-ai-chatbot-responses-to-patient-questions/

ChatGPT supposedly reading dental x-rays:
https://www.cureus.com/articles/154683-chatgpt-in-dentistry-a-comprehensive-review?score_article=true#!/

Chatbots “need” therapists:
https://arxiv.org/abs/2304.00416

CEO proposes AI therapist, removes proposal upon realizing there’s regulation:
https://twitter.com/BEASTMODE/status/1650013819693944833 (deleted)
https://twitter.com/NecroKuma3/status/1650713432369315840
https://twitter.com/NecroKuma3/status/1650708989196337152

ChatGPT is more carbon efficient than human writers:
https://assets.researchsquare.com/files/rs-2724922/v1_covered.pdf?c=1680083818

Asking the disinformation machine for confirmation bias:
https://twitter.com/drmistercody/status/1646965265857671168?s=20

GPT-4 glasses to tell you what to say on dates, "Charisma as a Service":
https://futurism.com/the-byte/smart-glasses-gpt-4?fbclid=IwAR0s8miqhKqg0eIoYmR5zZc2g-zLh8DJ0hKFzMkS7Hs1lypEn5kWCNWosGA

Context-aware fill for missing data:
https://twitter.com/jmeickle/status/1649419835980251141?s=20

“Overemployed” with help from ChatGPT:
https://www.vice.com/en/article/v7begx/overemployed-hustlers-exploit-chatgpt-to-take-on-even-more-full-time-jobs

Pakistani court uses GPT-4 in bail decision:
https://interestingengineering.com/culture/pakistani-court-utilizes-chatgpt-4-to-grant-bail
ChaGPT in Peruvian and Mexican courts:
https://techpolicy.press/judges-and-magistrates-in-peru-and-mexico-have-chatgpt-fever/

Elon Musk’s deepfake defense: https://twitter.com/Wolven/status/1652195823285837825?t=IY5iySp1NrXPrDYshl1zng&s=19
"Epistemic crisis go brrrrr":
https://twitter.com/Wolven/status/1652330424297828352?s=20

Elon Musk's TruthGPT:
https://twitter.com/SawyerMerritt/status/1648081976400703488
https://www.theverge.com/2023/4/17/23687440/elon-musk-truthgpt-ai-chatgpt

Fake interview in German publication revealed as “AI” at the end of the article:
https://www.npr.org/2023/04/28/1172473999/michael-schumacher-ai-interview-german-magazine

Stealing people’s voices, including those of voice actors:
https://twitter.com/washingtonpost/status/1650907842608611350

Hollywood writer’s strike & negotiating when & how “AI” can be used / AI as scabs:
https://twitter.com/harikunzru/status/1653391872172126214?s=20

AI will replace teachers:
https://www.gizchina.com/2023/04/26/bill-gates-chatgpt-will-soon-be-able-to-replace-teachers/

Geoffrey Hinton’s "x-risk" media tour:
https://twitter.com/xeegeex/status/1653549010094014466
https://www.theguardian.com/technology/2023/may/04/bernie-sanders-elon-musk-and-white-house-seeking-my-help-says-godfather-of-ai

Mind-reading machines:
https://www.nature.com/articles/d41586-023-01486-z
https://www.nature.com/articles/s41593-023-01304-9

---

You can check out future streams at http://twitch.tv/dair_institute.

Follow Emily at https://twitter.com/EmilyMBender and https://dair-community.social/@EmilyMBender
Follow Alex at https://twitter.com/alexhanna and https://dair-community.social/@alex

Music: Toby Menon.
Production: Christie Taylor.

Bernie Sanders, Elon Musk and White House seeking my help, says ‘godfather of AI’

Dr Geoffrey Hinton has been inundated with requests to talk after quitting Google to warn about risk of digital intelligence

^{Alex Hern (The Guardian)}