That's a fallacious argument. The reason it's mainly used by criminals and speculators is because it's brand new, as far as currencies go. If Bitcoin had been used by lots of people already who then abandoned it, you might be able to make the argument you're trying to make.

And one thing I've noticed it increasingly being used for is basic (small-scale) financial services - for example, loans.