Claude 3.5 Sonnet took a solid lead on our internal benchmarks over gpt-4-turbo ... | Hacker News

Hacker News new | past | comments | ask | show | jobs | submit

login

alach11 7 months ago | parent | context | favorite | on: Claude 3.5 Sonnet

Claude 3.5 Sonnet took a solid lead on our internal benchmarks over gpt-4-turbo for extraction tasks against large documents.

It may not be great for every workflow, but it certainly hits a sweet spot for intelligence x cost on most of my workflows.

petra 7 months ago [–]

Have anybody tried it against Gemini, for extraction tasks against large documents(its similar to question answering from books, right?)?

panarky 7 months ago | [–]

Claude 3.5 Sonnet supports a maximum of 200k tokens. Gemini handles 2,000k tokens.

Join us for AI Startup School this June 16-17 in San Francisco!
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact