Former bike shop mech here (10 years shop experience, but have been in the industry for close to 20 years). From what you're describing I would consider a gravel bike. Gravel bikes are basically road bikes with a little more stouter (is that a word?) and sporty frame, wider tires (usually with some treads), and geared lower than a typical road bike. Theyre great on road and offer the option to ride some trails. Can you ride traditional mtb trails on them? I suppose so, but not like you could on a true mountain bike, but they are definitely the best of both worlds.
As far as brands, I would motion to stay away from the big names (Specialized, Trek, Giant, etc). Not due to quality, but price (I have multiple specialized and Trek bikes, so it has nothing to do with the brand). I've found that the direct to consumer brands are definitely your best bang for the buck. Look at either YT (YT Szepter gravel) or Canyon Bikes (Grizl). My money would be on the YT Szepter Core 3. Direct to consumer cuts out the middle man of the bike shop so keeps your cost down significantly. Compare the Szepter Core 3 to the Specialized Diverge Comp Carbon and the Specialized is ~$1,500 more and doesnt even match the components of the YT (i.e. Sram Apex on the Specialized vs Rival on the YT).
YT has a showroom in Arkansas and California, so not ideal for trying them out, but they also have road shows called the rolling circus that may be near you. They also have a great return policy so you could always buy and return if it doesnt fit, ride quite right, etc. P.S. I am in no way affiliated with YT, but I do own 3 of them and they are some of the best bikes I've ever owned. Plus, their customer service is world class, so thats a bonus.
I would also like to note that I dont necessarily agree with increased cost only reducing weight. While that is partially true, increased cost gets you increased performance. Things like carbon frame vs aluminum frame (carbon is slightly lighter, but is stiffer which results in better pedaling, but due to the fibers is actually a comfier ride). You will also go from 9 or 10 speed groupos to 12's. Shifters and derailleurs will work more effortlessly, and shift smoother. You will go from mechanical to hydraulic disc brakes, less maintenance and better overall performance and modulation. Many more to note, but those are just some of the benefits of increased cost. Just my 2 cents.
Good luck on your search!