As long as you are also willing to do the same with alcohol, which I would absolutely argue is a much more damaging drug to both the individual and society at large.
Alcohol is just generally a more toxic chemical. People don't get cirrhosis of the liver from smoking too much marijuana. I think if you really wanted to dig into the subject, you'd also find the alcohol is also more addictive and that driving under the influence of alcohol tends to be more dangerous that driving under the influence of cannabis.