Remove the border point annotations

This is unused and despite several attempts I haven't found a way to make
use of this in geometry reassembly. Given this is based on the already
clipped and reduced paths it also seems like this cannot possibly contain
additional information for reassembly anyway.