Fix scrolled line highlight

In some use cases, the line highlighting was not drawn properly, for
example when copying files with scp.