CTest: incomplete report when stop-time is reached
If the stop-time given to ctest is reached (ctest --stop-time
/ STOP_TIME
), the report pushed to CDash is incomplete and sources of misunderstanding.
-
✅ the tests that were already finished are well reported -
⚠ the tests that were running are stopped and tagged asTest Details: Completed (Timeout)
whereas their own timeouts were never reached, it is really disturbing and leads to false leads. Maybe they should be flagged asNot Run
as the given time was not enough to run them completely. -
🔴 the tests that were not yet started are totally ignored and does not appear in the report, as if they would not exist. They would be expected asNot Run
.
A CTest log is printed The stop time has been passed. Stopping all tests.
, but it is lost in the middle of the stopping test logs.
Edited by n