I think it is great!
My kid loves rock/punk. Every since he was 6 months old he would pitch a fit when we put the kids channel on the satellite radio. SWMBO popped and AFI disc in one time and he was happy as a clam. Since then we've compiled a couple of CDs with stuff that isn't offensive and no cussing. Full of NOFX, blink 182, AFI, Rise Against, Bad Religion, etc etc. His current favorite is Nirvana Unplugged. We are also very strict about keeping it at a reasonable volume
He has also always had a fascination with drums too. He has been able to maintain a rhythm and beat since he was 18 months, now he is 2 and a half and has quite a bag full of beats and fills he does.