That really only applies if the user has some degree of skill with picking simple locks. Experieced locksport enthusiasts could probably pick it quickly, but for the vast majority of people a key would be easier.
I promise you that for the most commonly used TSA approved locks, this is not true. Many models consist of 2-3 pins and can be open in 1 second by jamming anything that fits into the the channel and wiggling.