Tags give the ability to mark specific points in history as being important
  • testcomp20   Version used in Test-Comp'20
  • v3.0   Version 3.0: Rename and new features * Rename test-suite validator to TestCov (`bin/testsuite-validator` is now `bin/testcov`) * Add additional test-suite reduction strategy based on count distance between coverages * Merge the two plots created for accumulated and individual coverage into single plot
    5c65f239 · Add numpy as dependency ·
  • v2.0   Version 2 of testsuite-validator * Runs tests in a container through runexec. You can use `--memlimit MEM` and `--cpu-cores #CORES` to specify these limits (e.g.: `--memlimit 2GB --cpu-cores 2`) This requires access to cgroups (cf. https://github.com/sosy-lab/benchexec/blob/master/doc/INSTALL.md#setting-up-cgroups) If it is not possible for you to provide this access, use argument `--no-runexec`. With this parameter, testsuite-validator will only use containerexec, but no cgroups. * Creates not only coverage information for line and branch coverage, but also for condition coverage. Previously, the number of evaluated conditions was shown ('branches executed'), but not the conditions taken. 'Branches executed' is not displayed anymore because we don't see any usage for it. * Coverage goals are provided through property files in Test-Comp format (https://test-comp.sosy-lab.org/2019/rules.php). If the goal is 'coverage-error', test-suite execution stops after a covering test is found. Argument `--stop-after-success` is replaced by this. * The coverage to display in coverage statistics is chosen according to the coverage goal provided. * Creates additional coverage statistics for individual tests and plots for this data. To turn any of these off, use argument `--no-sequence-file`, `--no-individual-test-coverage`, and `--no-plots`. * Creates a reduced test suite not only for coverage goal coverage-error, but also for line, branch and condition coverage. To disable this, use argument `--no-create-reduced-suite`
    be7448e7 · Fix name ·
  • v1.3   First standalone version of tbf-testsuite-validator. Identical in features to v1.2, but with small adjustments to be independent of other test-format tools. Previous project tbf-testsuite-validator belonged to: https://gitlab.com/sosy-lab/software/test-format/