Compression and performance for Gaussian splats

Hi

I know this is a fast paced field and the technology development is everchanging, but what’s the current outlook on techniques for working with large splats on the web in terms of - compression, LOD/distance culling techniques, streaming of data etc.

I’ve seen this example using Self Organizing Gaussians compression that @will posted about on linkedin. It mentions it has PlayCanvas support it right out of the gate. What does that mean in practice? @slimbuck you’re mentioned there been helping to create the decoding of the compressed format. Is that something built into the engine now, or proprietary code? Anyone else tried this technique?

Best Regards

  • Björn

Hi @bjorn.syse,

I have been intending to add support for loading and rendering SOGS in the engine for a while now since the compression results look very promising.

There is a quite a lot of work to do though to get runtime performance and also tooling to match what we have for compressed.ply.

SOGS itself won’t help much with lod, culling, streaming unfortunately. That’s a different kettle of fish :smiley:

1 Like

I see,

Well judging from the large dataset there at Sutro tower, perhaps SOGS is all that is needed to make tours like this perform making the need for the other techniques smaller.

So cool, you are implementing support for it then I figure. Right now that repo is quite high threshold to use it though, perhaps if it would be included in the Postshot software too training would be easier.

Or, did you mean there could be a possibility to no only add support for decompression but also the SOGS compression itself in supersplat, so input could still be an uncompressed ply?

Sorry I missed your reply!

I actually merged SOGS engine support today Support sogs by slimbuck · Pull Request #7510 · playcanvas/engine · GitHub

Getting the tooling for generating SOGS/plas data in SuperSplat would require quite a lot of work, because the tooling is currently CUDA based.

However we could relatively easily offer SOGS compression to our registered users (i.e. editor feature) and we could use it for the superspl.at published content too.

1 Like

Yes please, that would not only be awesome but also i think one of the main things holding 3DGS content back right now. :star_struck: