Texasred,
I think it sounds like you did it perfectly well. The fact is that the (noticeable) fermentation is very often pretty much over and done with before the end of four days and therefore you will see very little activity in the airlock.
Another factor, is that after racking your beer to the secondary fermenter, you lose some of the CO2 pressure that was in the primary fermenter, and it can take a day or perhaps more before enough of that builds up in the secondary and gives new activity in the airlock.
That being said . . . well, don't worry. After the initial strong fermentation, the lack of activity in the fermenter can seem a bit upsetting and worrying, but it is quite natural. On my last brew, the airlock seemed to have stopped nearly all activity after five days in the primary. After a week I racked to secondar, and it took at least a day before I heard the first "plop" from the airlock. I think that from then on and over the next week it was once every 30 minutes or so.
You racked it right - you left the sludge.
Don't worry, mate - from what I can hear you've done it just right and you will most likely get good beer out of it! And as a bit of advice for any batch you brew from now on; You will have to be pretty damned certain that a batch has gone bad before wanting to throw it out. During the process, there are stages where your beer will taste pretty awful compared to what you are aiming for, but with maturing it will end up just right.
Don't discard a thing - continue with the batch and enjoy. Remember to let us know how it turns out.
Cheers,
Jens-Kristian
[edited to note: Ferret beat me to it and managed to say it all in two lines!]
