gitlab-ci won't trigger when just pushing remote branches

At the same time I have added the controls to allow for master only builders which is required for nightly ubsan/asan testing