If you can move it around and it works, then either the connector terminal is loose (a little plier action to make it fit tighter on its matching terminal) or the connection between the terminal and the wire itself might need some attention. You'll spend LOTS more time wiring in a starter button than fixing the original problem, I suspect.