I've got to ask, what are the hardware specs that you are trying this on? I have a laptop with a T9300 CPU, 4 GB RAM and an nVidia 8600M GS, and Vista was no slower than XP. I am running Win 7 on it right now, and it is about the same.
As far as memory hog goes, how are you coming up with...