I did the drill and jigsaw route also. No issues here.
One thing I would reccomend is doing your layout on a piece of software. I used Visio as it was available and I'm familiar with it. When it's all drawn up print it to full scale on 8x11 full sheet clear stickers. Stick that to your panel...