I get my stir bars from Northern Brewer. I wait until I am ordering something else due to their flat rate shipping. My magnets came from a harddrive, but you can get several different sizes at RadioShack.
Also, I keep a magnetic wreath hanger (for a front door) in my brew box. That way if you pitch the bar in the carboy by accident, you can easily fish it up the side of the glass.