Analysis of some hardware RNGs shows that some of them are not very good. Here's a bunch of links I made earlier.

https://news.ycombinator.com/item?id=6060636

Obviously computers are much faster now than they were in 1997; and as you say we only need a small amount for entropy.