To me the problem is not so much that the TSA might rifle through your luggage but the attitude to anyone questioning anything the TSA does. If you so much as squeak at them it seems like they give you as hard a time as they possibly can, and that's pretty hard.
(That goes for anything to do with US travel security, or immigration).