I learned when I was about 12 so I could knit myself scarves and jerseys, but stopped when I was about 18 for the same reason as you. It all came back though! And knitting is suddenly cool (who knew?) and being done by guys. :-)

Crochet is easy. I taught myself that at one stage, at about 15 I think. You might find that easier; I did.