@lgarrison Do you have any thoughts about the technical implementation, or other ideas for important things to benchmark here? I'd be interested in discussing at some point! I'll probably add more benchmarks for all of the potential classes.

CodSpeed Performance Report

Congrats! CodSpeed is installed 🎉

🆕 206 new benchmarks were detected.

You will start to see performance impacts in the reports once the benchmarks are run from your default branch.

This is running on GH Actions runners right now, right? If those turn out to be too noisy, we could look into running this on Jenkins instead (unless we just want to use Codspeed runners).

Noisy is one thing, but they're also super slow -- do you think they'd be faster via Jenkins?

Potentially! Although the biggest gain on either Jenkins or GH Actions would probably be to run benchmarks in parallel (e.g. with a job matrix, https://codspeed.io/docs/benchmarks/python#running-benchmarks-in-parallel-ci-jobs).

@lgarrison I'm going to give this a try with GH actions since the total test time is now reasonable for infrequent runs (~40 mins). Thanks for the tips! I'll let you know if I want to try switching to Jenkins at some point.