findClose: ignore other bracket types within non-angle brackets

Unreliable distinguishing of angle brackets from operators causes less
wrong parsing now.

Remove no longer used findClose() public API.

Additional improvements:
* return str.size() rather than -1 from findClosing*() to avoid checking
  (pos == -1) after calling these functions;
* check depth == 0 only after decrementing depth.