In Find Similar's results, sometimes there is only 1 match (the reference file + result file). Currently, there is no way to delete only the reference file.
If I remember correctly, I de-selected the result and then deleted Reference+Selected... => Only Reference was deleted.
Not exactly intuitive, though -> should be improved.