Measuring your talk time? Counting your filler words? What about "analyzing" your "emotions"? Companies that push LLM technology to surveil and summarize video meetings are increasingly offering to (purportedly) analyze your participation and assign your speech some metrics, all in the name of "productivity". Sociolinguist Nicole Holliday joins Alex and Emily to take apart claims about these "AI" meeting feedback tools, and reveal them to be just sparkling bossware, with little insight into how we talk.

Nicole Holliday is Acting Associate Professor of Linguistics at the University of California-Berkeley.

Quick note: Our guest for this episode had some sound equipment issues, which unfortunately affected her audio quality.

Main course:

Read AI Review: This AI Reads Emotions During Video Calls
- Marketing video for Read AI

Zoom rebrands existing and introduces new generative AI features
-

Speech analysis startup releases AI tool that simulates difficult job interview conversation

Fresh AI Hell:

Amazon Echo will send all recordings to Amazon beginning March 28

Trump’s NIST no longer concerned with “safety” or “fairness”

Reporter Kevin Roose is feeling the bullshit

UW’s eScience institute pushing “AI” for information access

OpenAI whines about data being too expensive, with a side of Sinophobia

You can check out future streams at on Twitch, and send us any AI Hell you see for future episodes.

Our book, 'The AI Con,' comes out in May! Pre-order your copy now.

Follow Emily: Bluesky/Mastodon
Follow Alex: Bluesky/Mastodon

Music: Toby Menon.
Production: Christie Taylor.
Graphic Design: Naomi Pleasure-Park.

From Bill Gates to Mark Zuckerberg, billionaires with no education expertise keep using their big names and big dollars to hype LLMs for classrooms. Promising ‘comprehensive AI tutors', or just ‘educator-informed’ tools to address understaffed classrooms, this hype is just another round of Silicon Valley pointing to real problems -- under-supported school systems -- but then directing attention and resources to their favorite toys. Former educator and DAIR research fellow Adrienne Williams joins to explain the problems this tech-solutionist redirection fails to solve -- and the new ones it creates.

Adrienne Williams started organizing in 2018 while working as a junior high teacher for a tech owned charter school. She expanded her organizing in 2020 after her work as an Amazon delivery driver, where many of the same issues she saw in charter schools were also in evidence. Since then she has worked both on the ground and behind the scenes with activists, politicians, researchers, and everyday people to enact positive change in the tech, labor, and education industries by educating the public on how these industries harm, and how that harm can be reversed. She hopes her unique experience working within and organizing against these industries helps promote a more equitable society. Adrienne is a Public Voices Fellow on Technology in the Public Interest with The OpEd Project in partnership with the MacArthur Foundation, as well as a Research Fellow at both (DAIR) and Just Tech.

References:

Funding Helps Teachers Build AI Tools

Sal Khan's 2023 Ted Talk: AI in the classroom can transform education

Bill Gates: My trip to the frontier of AI education
- Background: https://jacobin.com/2019/02/cory-booker-charters-public-schools-president
- Background: https://www.the74million.org/cory-booker-and-charter-schools-before-the-new-york-times-essay-what-the-senator-has-said-and-what-research-has-shown-about-his-education-track-record-in-newark/

Book: Access is Capture: How Edtech Reproduces Racial Inequality
Book: Disruptive Fixation: School Reform and the Pitfalls of Techno-Idealism

Previously on MAIHT3K: Episode 26, Universities Anxiously Buy Into the Hype (feat. Chris Gilliard)
Episode 17: Back to School with AI Hype in Education (feat. Haley Lepp)

Fresh AI Hell:

"Streamlining" teaching

Google, Microsoft and Perplexity are promoting scientific racism in 'AI overviews'

'Whisper' medical transcription tool used in hospitals is making things up

X's AI bot can't tell the difference between a bad game and vandalism

Prompting is not a substitute for probability measurements in large language models

Yet another 'priestbot'

Self-driving wheelchairs at Seattle-Tacoma International Airpot

You can check out future streams at http://twitch.tv/dair_institute.

Follow Emily at https://twitter.com/EmilyMBender and https://dair-community.social/@EmilyMBender
Follow Alex at https://twitter.com/alexhanna and https://dair-community.social/@alex

Music: Toby Menon.
Production: Christie Taylor.
Graphic Design: Naomi Pleasure-Park.

The Washington Post is going all in on AI -- surely this won't be a repeat of any past, disastrous newsroom pivots! 404 Media journalist Samantha Cole joins to talk journalism, LLMs, and why synthetic text is the antithesis of good reporting.

References:

The Washington Post Tells Staff It’s Pivoting to AI: "AI everywhere in our newsroom."
Response: Defector Media Promotes Devin The Dugong To Chief AI Officer, Unveils First AI-Generated Blog

The Washington Post's First AI Strategy Editor Talks LLMs in the Newsroom

Also: New Washington Post CTO comes from Uber

The Washington Post debuts AI chatbot, will summarize climate articles.

Media companies are making a huge mistake with AI

When ChatGPT summarizes, it does nothing of the kind

Fresh AI Hell:

"AI" Alan Turning

Google advertises Gemini for writing synthetic fan letters

Dutch Judge uses ChatGPT's answers to factual questions in ruling

Is GenAI coming to your home appliances?

AcademicGPT (Galactica redux)

"AI" generated images in medical science, again (now retracted)

You can check out future streams at http://twitch.tv/dair_institute.

Follow Emily at https://twitter.com/EmilyMBender and https://dair-community.social/@EmilyMBender
Follow Alex at https://twitter.com/alexhanna and https://dair-community.social/@alex

Music: Toby Menon.
Production: Christie Taylor.
Graphic Design: Naomi Pleasure-Park.

Alex and Emily put on their social scientist hats and take on the churn of research papers suggesting that LLMs could be used to replace human labor in social science research -- or even human subjects. Why these writings are essentially calls to fabricate data.

References:

PNAS: ChatGPT outperforms crowd workers for text-annotation tasks
* Beware the Hype: ChatGPT Didn't Replace Human Data Annotators
* ChatGPT Can Replace the Underpaid Workers Who Train AI, Researchers Say

Political Analysis: Out of One, Many: Using Language Models to Simulate Human Samples

Behavioral Research Methods: Can large language models help augment English psycholinguistic datasets?

Information Systems Journal: Editorial: The ethics of using generative AI for qualitative data analysis

Fresh AI Hell:

Advertising vs. reality, synthetic Willy Wonka edition
* https://x.com/AlsikkanTV/status/1762235022851948668?s=20
* https://twitter.com/CultureCrave/status/1762739767471714379
* https://twitter.com/xriskology/status/1762891492476006491?t=bNQ1AQlju36tQYxnm8BPVQ&s=19

A news outlet used an LLM to generate a story...and it falsely quoted Emily
* AI Invents Quote From Real Person in Article by Bihar News Site: A Wake-Up Call?

Trump supporters target Black voters with faked AI images
* Seeking Reliable Election Information? Don’t Trust AI

You can check out future streams at http://twitch.tv/dair_institute.

Follow Emily at https://twitter.com/EmilyMBender and https://dair-community.social/@EmilyMBender
Follow Alex at https://twitter.com/alexhanna and https://dair-community.social/@alex

Music: Toby Menon.
Production: Christie Taylor.
Graphic Design: Naomi Pleasure-Park.