Add flag for running only failed and new tests

It's often these tests that you want to run again and again and again
until they pass. The new flag makes it easy to do so.