Hi,
Try also enabling the search override feature.
It is however possible, that this is a custom search results page of some sort, and not the default WordPress results page, which usually cannot be affected by the plugin. You mentioned that this might be managed by an add-on, then it probably uses a custom query to display those results, and the override might not have an effect on those.