Hi Conor,
The plugin performance mostly depends on server response times, however there are a few built-in options you can try to maximize it.
There is a chapter in the documentation, which details multiple options that will affect the performance: Fine tuning the search configuration – Documentation
Suggestions in chapters 1. and 2. can have a great impact on the performance.