Wasn't able to reproduce the problem with white TOH, even by directly pressing on the SIM.

However after I switched to the limited edition TOH it was actually pretty easy. Good thing I don't like the colour and never use it.