I have the opposite situation, but not as severe. I have a harder time popping it open and easier time closing, but it usually only takes me 2-3 attempts to open it.
But I think our issue is the same, you need to press at the location of the mechanism, and do so with the right amount of pressure. If not, the mechanism doesn't open/close correctly. If I focus, I can get it to open and close consistently on the first try. I would practice and see if you can do that, if no matter what you do it still doesn't work well, I would try using some dry lube on the mechanism. If that doesn't work, I would take it to the dealer (assuming I'm under warranty).
It bothers me because I'm doing it at a Costco gas line where everyone behind you is watching for any flubs that slow down the line. I can feel their eyes burning at my back as I take a couple of seconds too long to get my gas. Though I don't blame them, I was doing the same thing just a moment ago when I was next in line. It's what happens when discount gasoline is well above $5 a gallon.