It’s because that is only for the fronted search settings box, it does not actually exclude the category, it only makes it invisible on the frontend. To exclude the category go to the Advanced Option panel, and there you can do it. It’s all explained in the documentation.
I already excluded the Hidden Category so you should not see the posts from there now.Best,
If you like my products, don't forget to rate them on codecanyon :)