Idea about automated test scripts

Suggestions & Feedback
1

Hello,

As far as I can see PlayCanvas releases are being checked by test tools on code level.

Since releases are mostly stable on code side, and sometimes we only experience unexpected views or displays scene, I have this idea where we test an example scene with a NodeJS application.

This NodeJS application will simply take screenshot of scenes for different cases and compare images with original one. If similarity is below %70, system simply warn Github users (contributors) about that.

Engine is very stable with it’s current state. So I believe we won’t see any changes the way how graphics work. This similarity check can prevent potential bugs with different cases quickly.

Best regards

2

We actually have something like this where we run a series of scenes against the current engine release and the release candidate.

It then does a diff between the two images.

Ideally we would like to automate it for every commit to master but we aren’t quite there yet :sweat_smile:

3 Likes
3

If you guys find yourselves looking for a solution for that, I’ve had success doing CI visual regression with Reg Suit on a non-3D project. Has a GitHub bot and sends screenshots to the cloud which is pretty nifty.

1 Like