I've tested many portable Linux distros, but PorteuX is the one I keep on my USB drive ...
No VM, no setup hassle, no leftover clutter afterward.