Yea, my reason for not driving comes from a couple things. First is not having a car. My bro has his own that he won't let me use. And my parents for a long time didn't want me driving their vans. The second reason is due to busyness as well as a slight phobia of driving. But I've started along the path, hating every second :P.
Man, I can't even fathom that. When I was a kid, I wanted nothing more than a driver's licence. To me, the ability to control where I was going on my own terms was a proxy for freedom, something I think many kids lack to a great extent. For my 16th birthday, my father split the cost of a 1983 RX-7 with me ($900 in 1998!), which was the happiest day of my life to date. The down side of having a sports car at age 16 is that it took me less than three weeks to total it.