pk: Don't call the size function as it triggers a details fetch

We are only checking the previous size to see if it needs to emit a
change, we were fetching twice in practice.

CCBUG: 432657


(cherry picked from commit 76780c71)