Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

What per cent of Mechanical Turk hits are being performed by an LLM these days?



Several researchers where I work used to use mturk regularly and now have been forced to stop using it entirely because of this. They started getting "As a large language model" answers ... in even things where the only possible answer was 'true' or 'false' or '1-7'.


“I hope this email finds you well…”


I love how your CompanyName does XYZ in field ABC. Buy our product. Let’s talk!


Click here for virtual coffee with me!


According to Eric Schmidt, OpenAI is worth $90B. LLMs being unable to master mturk and $90B are incongruent.

https://twitter.com/ericschmidt/status/1725625144519909648

Who's right? Who's wrong?


Good question. Let's go ask our expert, an internet commenter who calls himself "John Galt", to step in with an opinion based solely on market value!


troll.


> According to Eric Schmidt, OpenAI is worth $90B. LLMs being unable to master mturk and $90B are incongruent.

Top 5 reasons why OpenAI was probably never really worth $86 billion <https://garymarcus.substack.com/p/top-5-reasons-why-openai-w...>

The company is overhyped and over-valued, and the capabilities of LLMs aren't All That and a Bag of Chips




Consider applying for YC's Fall 2025 batch! Applications are open till Aug 4

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: