You can also “trick” the game into shuffling the playlist by creating a blank mp3 (a second-long duration will do) and putting it first on the playlist queue.
Unfortunately said trick doesn’t work with BossBattle playlist.
I know that some areas will not allow your playlists to shuffle. For example most if not all of the Charr region won’t shuffle playlists such as Battle/BossBattle.