Definitely not stupid. You have to start somewhere. I actually find the all-grain process actually more relaxing and less stressful than extract brewing. Extract definitely takes less time, but the boil seems to be a lot busier. I like the time gaps you have between mash in and draining the wort. Then, for the boil, all you have to worry about is the hop additions. I would always stress about scorching the extract, when exactly to add it, etc. Over all the all grain day isn't any harder, it's more relaxing and just takes a little longer.
In the end, imo, the most important part of making good beer is good fermentation and controlling the temps of that. So no matter how you create your wort, just make sure you ferment at the lower to mid range of the yeast you select and it will all be good.