Hi!
Can you please link me to a page where the plugin is present and I can check the issue? I am not sure what might be the cause yet.
The search performance mostly depends on the server performance, but there are things you can do of course to speed it up. This documentation should help you out.