Get rid of temporary QSet for lookup

Converting the QList to a QSet is an O(n) operation, lookup of the
property in a QList is O(n) as well. The algotithmically faster lookup
in the QSet is never amortized due to n being small, and the lookup is
done only 4 times.