Hacker News new | past | comments | ask | show | jobs | submit login

Anything that can be divided and conquered in a batch process, especially where there is a ton of distributed data, and you can do the computation on the machines where it's stored.

Building search indexes is one of the greatest uses of it. You put in (say) a ton of crawled webpages, you generate link graphs and other internal representations from that, then feed that in again to generate rankings, etc.




Consider applying for YC's Spring batch! Applications are open till Feb 11.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: