Bandwidth on EC2 VMs is crazily expensive, especially when you add the fact that you need to use the most expensive instances to get decent speeds.

On the other hand, if you have some heavy static files to serve, the scalability of S3 is hard to beat. It can serve the files more reliably than anything you can come up with.