How about making the town clothes work as other games mounts, ie when equip they give a huge speed bonus.
For GW2 lets say 66% speed bonus, and I would also put in, if taking any kind of dmg whilst in town clothes you lose 99% of your HP bar.
This to prevent abuse in WWW or speed running cloaked in dungeons.
This sounds cool?