I find it much more endurable to clean all my ("new," labelled) bottles before bottling day. I did clean bottles and bottle for my first batch but I'm not planning on doing that again! For the ones I just drank homebrew out of I just rinse really well and check for deposits in the neck. I store them upside down for a little while and then flip them over, because they do not always dry thoroughly upside down.