Ive been and had an absolute blast. I was about 35 minutes to the NE of Cabo at some small out of the way resort. I was lucky enough to catch two Striped Marlin in the time I was there. One was 165 lbs, and the other was 135. After docking the locals took the marlin and cut it into steaks for us. All they asked for payment was some to take home to their families, and 2" thick marlin steak with fresh ceviche is heaven....best Ive ever had too! We stayed away from downtown and chose the "off the beaten path" approach.
IMHO its the best place Ive ever been. Everything is just relaxed and really laid back.