Pain relief is a pretty vague reason. I smoke pot to relax from anxiety. Is that pain relief? I agree it might be immaturity but i also think you can be a good person and be immature at the same time.

If the pot smoking isnt something you want to deal with i think it makes perfect sense not to go out with someone for that reason though.