Hacker News new | past | comments | ask | show | jobs | submit login

It's not that much, but it's also not nothing. The input file of the challenge was very narrow, just a relatively short text column and a numeric value. It still is >13 GB uncompressed; an actual table with a few more columns with 1B rows will easily be beyond 100 GB. And chances are it's not the only table in your database, so it won't fit into RAM of most common database machines. I.e. still a non-trivial dataset in most contexts.



> an actual table with a few more columns with 1B rows will easily be beyond 100 GB

Especially if you need to have supplementary indexes to support common queries on that data.


non-trival yes, but still small enough for a hobbyist. my desktop box has 96GB of ram and I don't feel special about it, nor was it expensive.




Consider applying for YC's Spring batch! Applications are open till Feb 11.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: