This is a reasonable position, which is not something that can be said about the "war on drugs" type of person that I've encountered. That person is much less likely to be critical about why they question the use and, in my experience, will often assume that "use" is "abuse" regardless of the actual effect it has on the user.

The comment rightly calls out that it is a personal take about your friends but that is also something which might be done by someone with more pointed and less honest intentions. Certainly assumptions can be more charitable, however. I don't mean to justify these complaints of your comment but hopefully they're more understandable.