There's currently a case during the metadata validation process where instead of failing and exiting immediately, the Commander gives a warning and continues.
However, since the metadata isn't valid, a metadata report cannot be generated and therefore the results are not valid in this case.
The Commander should fast-fail in this scenario and indicate why in the certification reports.