Turns out TPM wasn't Microsoft being difficult.
I've tested many portable Linux distros, but PorteuX is the one I keep on my USB drive ...