I took Beerhaiku's advice and bought an RV water filter.
http://www.walmart.com/ip/Camco-Water-Filter-with-Hose/14504321
These things are cheap, filter a couple thousand gallons of water and are very easy to setup/breakdown in and out of the house. I am about to dive into AG brewing, and will still use this filter. I think the replacement filters are 2 for $24, but buying the hose attachment is a great investment the first time around, keeps the stress off of the filter.