Only unset hovered row if it's the current row

The order of the enter and exit events are not deterministic judging
from obversation. If the sequence is enter -> enter -> exit we end
up with no hovered row.