Alex and Emily put on their social scientist hats and take on the churn of research papers suggesting that LLMs could be used to replace human labor in social science research -- or even human subjects. Why these writings are essentially calls to fabricate data.
References:
PNAS: ChatGPT outperforms crowd workers for text-annotation tasks
* Beware the Hype: ChatGPT Didn't Replace Human Data Annotators
* ChatGPT Can Replace the Underpaid Workers Who Train AI, Researchers Say
Political Analysis:
... show moreExperts testing five leading AI models found the answers were often inaccurate, misleading, and even downright harmful
Julia Angwin (Proof)