Yep, give it some time. Time does miraculous things to beer. Trust me, it's worth the wait.
I freaked out about the yeasty flavors in some of my first brews. 3 or 4 weeks later, I was drinking some amazing beer - and I was the one who made it. Hopefully, you will know what I mean soon enough.