There have been attempts to get something like this going, check the issues or PRs, there were definitely some proof of concept implementations. I think it didn't go anywhere so far because doing this by default adds another layer of observable connections that we were not super keen to have by default I think, and such a functionality seems to have a lot of edge cases (for example, what happens with the legend when you delete!(ax, someplot), should a plot know about legends it's represented in to notify them of deletion?)