If you uncheck all of the checkboxes, then by default the filter does not consider as exclusion, but has “no effect”. You can change that behaviour here: https://i.imgur.com/jPIvbPs.png
For the checkboxes, since you are using individual options, the checkbox states have to be changed here: https://i.imgur.com/obz4GFE.png
The “display mode” button is a generic setting, when the “show all from xy taxonomy” option is used.
These should do the trick.