Selectively remove entries in the tree
The filter
callback will be called for each entry in the tree with a
pointer to the entry and the provided payload
; if the callback returns
non-zero, the entry will be filtered (removed from the builder).
Extra data to pass to filter callback
0 on success, non-zero callback return value, or error code