You reminded me of a talk I had with the girl I coached. She said the same thing: "oh, I don't breathe music like you do". I'm gonna put the same thing I said to her:
It's OK if it's not a huge passion for you. It's OK even if you're not that good! As long as you are a cool person to be around and willing to learn, people will want to play with you. Just have fun (and try playing with others right now)!