To improve the Gallery of our online docs, Sphinx-gallery seems like the way to go.

It's used for example by Matplotlib and NetworkX.

It works by generating a Gallery from a collection of pure python files that are executed to produce drawings.
I think it's a good idea to populate our gallery with more simple examples that people can quickly browse (see NetworkX).
We could already take many examples from the tutorials.