Q:
How / can I freely explore PvP maps?
A:
If you join an empty custom arena then you can explore them freely.
Dueling arenas are good for that too even if they have people in them. Typically you have to emote and the other acknowledges it before you start fighting.