I just noticed this the other day, when I view the minature window in the hero panel after clicking through a bunch of different mini’s and leave, my frame rate will be permanently bogged down until i exit and restart the game.
I run on max settings with a gtx 780ti and i5 processor. Typically the game runs smooth for hours on end but then i notice this when i started using the minature preview window.