But what about all the small retailers that do business under the Amazon umbrella?

Somehow, a lot of those little businesses still do not charge sales tax. A significant fraction of Amazon's sales are those little retailers.