Version 3 of PRTest.
PRTest 3 does not change how to use PRTest, but provides a major
overhaul of under-the-hood coverage tracking, test generation,
and handling of failures in the program under test.
PRTest 3 ships with the following improvements:
1. Optimizations that reduce the time per execution in the domain of
nanoseconds per execution; over many rapid executions this piles up.
1.1 Replace the callback-based coverage sanitizer with inline
coverage flags (inline-bool-flag)
to reduce the number of function calls per execution
1.2 Leave the harness code itself uninstrumented to save
a few more operations per execution
1.3 Introduce a faster algorithm for random number generation,
xoroshiro128**. This also fixes a bug that the FIXED_SEED
macro was not respected before.
1.4 When the program under execution is stopped by an abort, exit, or
__assert_fail, do not go through signal handling and the libc
exit, but instead stop the test execution directly, via a longjmp.
2. PRTest 3 resets global state between program executions,
avoiding wrong and useless test generations in case where the program
execution depends on the global state.
3. PRTest 3 handles more cases of program failure without stopping test generation.
If the program under test sends SIGSEGV, SIGBUS, SIGFPE or SIGILL,
PRTest 3 handles this gracefully and continues with a new program execution;
unless the program handles the signal itself. PRTest 3 also recovers from
stack overflows.
As a minor fix, PRTest 3 now uses the correct return type for __VERIFIER_nondet_size_t and
introduces new nondet functions, like __VERIFIER_nondet_memory.
PRTest 3 requires clang 13.