Hi,
First I would recommend trying the index table engine. That can fetch the field data, not only the references.
Is this by any chance some sort of a repeater field? Those are not really indexable, because the fileds are dynamic. But let me know, I may be able to suggest something for those as well.