diva_evaluation_cli merge requestshttps://gitlab.kitware.com/actev/diva_evaluation_cli/-/merge_requests2019-07-02T10:00:47-04:00https://gitlab.kitware.com/actev/diva_evaluation_cli/-/merge_requests/29Baseline setup: use latest version of the gpu driver2019-07-02T10:00:47-04:00Maxime HubertBaseline setup: use latest version of the gpu driverMaxime HubertMaxime Huberthttps://gitlab.kitware.com/actev/diva_evaluation_cli/-/merge_requests/28Update baseline with CLI v1.2.02019-07-01T12:13:12-04:00Maxime HubertUpdate baseline with CLI v1.2.0https://gitlab.kitware.com/actev/diva_evaluation_cli/-/merge_requests/27Bugfix in unittests: ignore existing container outputs2019-07-01T12:10:33-04:00Maxime HubertBugfix in unittests: ignore existing container outputshttps://gitlab.kitware.com/actev/diva_evaluation_cli/-/merge_requests/25Update baseline with CLI v1.2.02019-07-01T11:09:41-04:00Maxime HubertUpdate baseline with CLI v1.2.0https://gitlab.kitware.com/actev/diva_evaluation_cli/-/merge_requests/24Push version to 1.2.02019-07-01T11:05:32-04:00Maxime HubertPush version to 1.2.0* Update validate-execution command with a `--score` flag https://gitlab.kitware.com/actev/diva_evaluation_cli/issues/11
* Update validate-system command, and add a `--strict` flag https://gitlab.kitware.com/actev/diva_evaluation_cli/iss...* Update validate-execution command with a `--score` flag https://gitlab.kitware.com/actev/diva_evaluation_cli/issues/11
* Update validate-system command, and add a `--strict` flag https://gitlab.kitware.com/actev/diva_evaluation_cli/issues/12
* Improved documentation for each command https://gitlab.kitware.com/actev/diva_evaluation_cli/issues/14
* New _free disk_ metric in resources monitoring https://gitlab.kitware.com/actev/diva_evaluation_cli/issues/15
* Bug fixeshttps://gitlab.kitware.com/actev/diva_evaluation_cli/-/merge_requests/23Resources monitoring add free disk2019-06-28T17:20:21-04:00Maxime HubertResources monitoring add free diskhttps://gitlab.kitware.com/actev/diva_evaluation_cli/-/merge_requests/21Enhance validate-system command with system output validation + introduce par...2019-06-07T10:52:26-04:00Maxime HubertEnhance validate-system command with system output validation + introduce partitions directoryFixing https://gitlab.kitware.com/actev/diva_evaluation_cli/issues/12
The validate-system now validates three things:
* That the `container_outputs` directory contains at least one sub-directory, containing at least one `*output.json` ...Fixing https://gitlab.kitware.com/actev/diva_evaluation_cli/issues/12
The validate-system now validates three things:
* That the `container_outputs` directory contains at least one sub-directory, containing at least one `*output.json` system output,
* That each reported system output is different from the baseline's,
* The directory name starts with a dataset name
These three checks only cause a failure if a `--strict` flag is provided.
This design is picked so it is backward-compatible with the previous format of the `container_output` directory
Also, the index files and the activity index files have been moved in a new directory called `partitions`.
The `container_outputs` can now contain the outputs only.Alexandre BoyerAlexandre Boyerhttps://gitlab.kitware.com/actev/diva_evaluation_cli/-/merge_requests/20Baseline system development2019-05-15T17:18:44-04:00Ameya ShringiBaseline system development1. Updated the url for the docker image
2. Modified location where json files provided by NIST go
3. Updated the command for running the baseline wrapper
Changes in the docker image:
1. Built against kitware/master
2. Uses a copy of act...1. Updated the url for the docker image
2. Modified location where json files provided by NIST go
3. Updated the command for running the baseline wrapper
Changes in the docker image:
1. Built against kitware/master
2. Uses a copy of activity-index.json that is stored internally to make predictions. The activity-index.json provided by NIST is used to prune the output produced by RC3Dhttps://gitlab.kitware.com/actev/diva_evaluation_cli/-/merge_requests/19Merge with baseline system2019-04-04T09:59:36-04:00Alexandre BoyerMerge with baseline systemhttps://gitlab.kitware.com/actev/diva_evaluation_cli/-/merge_requests/17Add resource monitoring2018-11-20T17:53:09-05:00Alexandre BoyerAdd resource monitoringhttps://gitlab.kitware.com/actev/diva_evaluation_cli/-/merge_requests/161.1 changes on baseline system2018-11-19T09:03:41-05:00Alexandre Boyer1.1 changes on baseline systemhttps://gitlab.kitware.com/actev/diva_evaluation_cli/-/merge_requests/15Add actev validate-execution2018-11-19T08:57:46-05:00Alexandre BoyerAdd actev validate-executionhttps://gitlab.kitware.com/actev/diva_evaluation_cli/-/merge_requests/14Add actev validate-execution2018-11-16T10:52:24-05:00Alexandre BoyerAdd actev validate-executionhttps://gitlab.kitware.com/actev/diva_evaluation_cli/-/merge_requests/13Add actev status command2018-11-09T16:52:35-05:00Alexandre BoyerAdd actev status commandModify cli_validation_mini
Use actev statusModify cli_validation_mini
Use actev statushttps://gitlab.kitware.com/actev/diva_evaluation_cli/-/merge_requests/12Add actev status command2018-11-09T16:48:59-05:00Alexandre BoyerAdd actev status commandhttps://gitlab.kitware.com/actev/diva_evaluation_cli/-/merge_requests/11Add --system-cache-directory arg to post/pre/process-chunk2018-10-26T11:03:24-04:00Alexandre BoyerAdd --system-cache-directory arg to post/pre/process-chunkhttps://gitlab.kitware.com/actev/diva_evaluation_cli/-/merge_requests/10Add argument to reset chunk, modify composed arguments names2018-10-24T17:54:10-04:00Alexandre BoyerAdd argument to reset chunk, modify composed arguments nameshttps://gitlab.kitware.com/actev/diva_evaluation_cli/-/merge_requests/8Development2018-10-22T10:48:00-04:00Alexandre BoyerDevelopmenthttps://gitlab.kitware.com/actev/diva_evaluation_cli/-/merge_requests/7Add get-system validate-system and exec, required named args2018-10-19T11:17:30-04:00Alexandre BoyerAdd get-system validate-system and exec, required named argshttps://gitlab.kitware.com/actev/diva_evaluation_cli/-/merge_requests/6Add required optional arguments2018-10-05T18:29:01-04:00Alexandre BoyerAdd required optional arguments