you can get kits pretty cheap. or find recipes and buy the ingredients separately. extract is the expensive thing, but both of those stores have good prices and quality ingredients. if you reuse yeast or even just use dry, you can do a lot of brews for under $20.
what i would suggest if you're trying to save some cash, is to look into BIAB (brew in a bag). there's a great sticky in the beginners forum by DeathBrewer on the subject. it's a very easy, stovetop method of brewing, and you can eliminate a good portion of the malt extract and replace it with grains which are
way cheaper <$2 a lb most of the time, cheaper if you buy in bulk. reusing yeast, i regularly brew BIAB batches for ~$15 or so. so check out the sticky if you're interested. it's a good read.