Experiment with Mutation tests for Access group

Briefly, mutation testing is a technique to "test" unit tests.

There are different libraries available for running mutation tests, and what they do is changing the application logic slightly, like changing a > sign by a < sign, changing a == sign by a != sign, changing a true by a false, etc., and then running the unit tests to see if they fail.

If unit tests fail, the mutation testing succeeded, while if they don't, chances are that the unit tests are passing with false-positive results, meaning that they are passing when they should be failing. In other words, unit tests are not being effective.

More details about mutation tests on Wikipedia.

And below are some libraries and other content about the subject that may be valid to look into:

  • https://github.com/mbj/mutant
  • https://github.com/maksar/mentat
  • https://github.com/dgollahon/mutest
  • https://isotope11.com/blog/mutation-testing-in-ruby

Phase 1

Implement a POC for the ruby and JavaScript code to gather data

Phase 2

Data analysis and action items

Phase 3

Depends on the above

Edited Dec 10, 2020 by Mek Stittri
Assignee Loading
Time tracking Loading