Merging to see if this helps #103 and #108

I failed to leverage mmap to fit Parler mini into memory, as it still asks for 5.3GB somehow. I must be doing something wrong.

@aPaleBlueDot Can you upload your cmake-build-release/CMakeCache.txt file and post the arguments you are invoking cmake-build-release/bin/tts-cli with?

@danielzgtg Here is the file
CMakeCache.txt
and here are the parameters (w/ added line breaks for readability):

`
generation_configuration config(

  "",      // voice (empty)

  30,      // top_k (reduced from 50)

  1.0f,    // temperature

  1.1f,    // repetition_penalty

  false,   // use_cross_attn (disabled to save memory)

  "",      // espeak_voice_id (empty)

  256,     // max_tokens (reduced from 512)

  0.95f,   // top_p

  true     // sample

);

int n_threads = 4; // 4 threads on iOS

bool cpu_only = true; // Force CPU-only mode
`

And it was the 5-bit quantized model.