It is cheaper than your probably think.
There is a place just down the road from me that sells 5 gallons of water for like $3. I usually get a 5 gallon and 1 gallon container. I then top off the rest with tap water if needed.
Not sure what its like around you so you might have to shop...