@andrew I removed the swipe gesture for the panel and started re-working the bars icon. I started noticing a lot of accidental openings especially on first page load. I took your advice and removed it. I do need to make the button more noticeable/larger which is what I am working on now. I have pushed the changes so far.
Edit: I took it a step further and de-emphasized the panel. I was cramming to many things in there. I have since moved out some of the options. That caused the main menu to be cluttered and I re-organized it based on the action it carries. I personally like it better, but would love some feedback. I also made the bars button flatter which seems less out of place now.