Improve the cache when getting font metrics#28831

tacaswell wants to merge 2 commits intomatplotlib:mainmatplotlib/matplotlib:mainfrom

tacaswell:fix/better_fm_cachetacaswell/matplotlib:fix/better_fm_cacheCopy head branch name to clipboard