Pyramid filter cache prevents switching between cuda and cpu #32
Description
Pyramid has filter cache that is created the first time forward is invoked that is then reused in the subsequent runs. This prevents switching the model back and forth between CPU and GPU.