legend: Use implicit size for checking item size

Explicit size will be manipulated by the layout, so we should check
implicit sizes instead as we know those are supplied by the item.