Hacker News new | past | comments | ask | show | jobs | submit login

I was just looking at that! I know how these models work internally (), and I’d have said it’d not make a difference to use capslock. But then I see this prompt by OpenAI engineers and I’m like “they work then?”

() I know the basics of ML, NLP, transformers, etc. I know the theory, not even remotely close to how they really work.




Why would it not make a difference to use Caps Lock? It's fairly universally used in English to show emphasis.


Words with capital letters typically have higher token counts. This causes the LLM to apply attention differently.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: