Mirroring an Entity containing a CollisionComponent doesnt work as intended

Im trying to mirror entities in my game using entity.setLocalScale(1, -1, 1). Everything works fine, except that the CollisionComponent for the mirrored entity doesnt map 1:1 to its rendered model anymore.

Any known workarounds except having to make a new set of mirrored models?

Best regards,
Doggolainen