Describe the feature

Currently, the GitHub jobs is running all unit tests, then build the package, then publish it (if a release).
A possible future improvement could be building before running tests and then testing the same dists.

Additional context

Suggested by @webknjaz during review of #915