Click Coordinates for Annotations with Gaussian Splats

Hey everyone!
I’m using pc.Picker.getSelection() to select a gaussian splat object in my scene. Currently, I can pick and select an entire splat entity using it like this: example with FrameBufferPicking. But, I’d like to get the exact coordinates of the click point in my Scene and translate it to world coordinates. The goal is to add an annotation or hotspot precisely at the clicked location of the splat.

Does anyone know how I can recieve these specific coordinates or has any tips for implementing this? I cannot use rigidbody.raycastFirst(from, to).

I talking to Will Eascott, he mentioned that I should get the depth value of the click point and then translate this to world coordinates. But I don’t know how to even start here. Where can I access the deph value of the click because in my mind this has to be done with some sort of Raycast.

Thanks in advance!

We have a ticket for this here: Getting the click point on a splat · Issue #7075 · playcanvas/engine · GitHub

@slimbuck - any suggestion here?