Whenever I try to use ControlNet with an input image bigger than 512x512 I keep getting ggml_new_object: not enough space in the context's memory pool (needed 18122976, available 16777216).
I'm currently using a HIPBlas build and have plenty of vram available.
Is this expected or is there a way to manually increase the context memory pool in the code?