When we run generate_test_compatibility_cache.py to update our regression test vectors, it doesn't delete the old test vectors, but there's no point in keeping them around. It would be better if the script deleted the old test vectors.