It would be great if you don't need to restart the test runner if you add/remove test files. We would need to watch the file system based on the globs provided, and carefully add/remove tests from the test runner.