We will surely add more flexibility – currently we are trying to completely rework the back-end to make it much more user friendly.
On the searc shources panel, check if you have no taxonomies selected to be shown as search results, here: https://i.imgur.com/W5JYewU.png
I believe you may have accidentally selected a few to return as results.
