And this never happened with the 16GB card?

There's no technical reason whatsoever that would cause it. I have heard that on some cards the factory format is such (usually exfat) that it should not be wiped&reformatted to other filesystems or performance will suffer somewhat but it should not cause anything that extreme.

what are the make/model of your cards, and have you tried any other?