I've been using using [BAML](https://github.com/boundaryml/baml) to do this, and it works really well. Lets you have multiple different fallback and retry policies, and returns strongly typed outputs from LLMs.

Don't do that! This was a great post with a lot to learn from.

The fact you came to a very similar solution from first principles is very interesting (assuming you didn't know about this before!)

CTO here, using BAML in our stack has let us use LLMs a LOT more in places that wouldn't make sense without the type-safety. We started using it for line item tag prediction and classification, false-positive checking on our fuzzy match algo, and forecasting. Especially with models like 4o-mini and Gemini Flash, its now actually cost effective to do this at scale.

What incentive would HN or YC have to do this?

Especially since they are putting out content that argues that you don't even need a business co-founder: https://youtu.be/43RhhwpiSk0?si=NMt8jLFLB9dU0TQ0

Did you actually watch the video because it they are resoundingly saying yes

Also, YCombinator is a venture fund

They are not technical people. Their entire business model is stealing from technologists

I've been using this website for ~15 years now. I've never tried to prove it, but its been obvious for a long time

In my experience, after tip Lyft/Uber are more expensive. The exception is during surges when Waymo's price shoots up like crazy.

We use GPT-4o for data extraction from documents, its really good. I published a small library that does a lot of the document conversion and output parsing: https://npmjs.com/package/llm-document-ocr

For straight OCR, it does work really well but at the end of the day its still not 100%

Thanks! look forward to checking this out as soon as I get home.

I knew in my heart as I made the comment it had been done. Amazing

Cool!

I think a portion of people would say yes, it's better to keep the status quo. Imo progress always wins because eventually someone somewhere will break the taboo. Technology even gets lost and rediscovered, which means even if you supress the knowledge someone will still eventually do it. So it's pretty pointless to fight, I'd rather try to benefit from it.

I left Google in 2020. It is not like this anymore. I heard its gotten even worse.

> Also there is the fact that America is extremely anti-immigration at the moment.

In what way? Compared to which countries? If OP is coming to the USA for school, I don't think this is a concern esp in the short term.