Same issue here, it’s almost on the verge of being game-breaking at times. Sometimes it doesn’t even go into mouse look when I press and hold right-button, especially in wvwvw.
It seems that whenever I have my pointer over for example a gate, it won’t go into mouse look.