If the map change is via walking.
Obviously using a waypoint should remove stacks, because if it didn’t, people could one-shot stuff in low level zones and then warp over to Cursed Shore.
But if I’m killing things and I’ve got 25 stacks built up and I walk one map over, it sucks that I have to do it all over again to regain those stacks.