CMakeLists.txt has the condition disallowing benchmarks without test:

message(STATUS "You have enabled the benchmarks, but not the tests. We don't allow running the benchmarks without the tests.")

What is the rationale? TBH, this seems to be an artificial restriction.