The solution was to reduce all the non-glossy materials’ reflectivity to 0. Materials have a default reflectivity of 1, this is a separate setting to the specular glossiness.
Thanks to @LeXXik for pointing out this is a reflection, not a transparency issue.