Tags: dumpmemory/llama.cpp
Tags
cmake : Handle mixed-case 'Power' strings in POWER CPU detection (ggm… …l-org#13966) Some systems report the CPU implementation as "Power11" instead of "POWER11". The existing CMake logic uses a case-sensitive regular expression to extract the CPU generation, which fails when the casing doesn't exactly match "POWER". This patch provides a fix by first converting the string to uppercase before applying the regex. Signed-off-by: root <[email protected]> Co-authored-by: root <[email protected]>
threading: support for GGML_SCHED_PRIO_LOW, update thread info on Win… …dows to avoid throttling (ggml-org#12995) * threading: support for GGML_SCHED_PRIO_LOW, update thread info on Windows to avoid throttling We talked about adding LOW priority for GGML threads in the original threadpool PR. It might be useful for some cases to avoid contention. Latest Windows ARM64 releases started parking (offlining) the CPU cores more aggresively which results in suboptimal performance with n_threads > 4. To deal with that we now disable Power Throttling for our threads for the NORMAL and higher priorities. Co-authored-by: Diego Devesa <[email protected]> * threading: disable SetThreadInfo() calls for older Windows versions * Update tools/llama-bench/llama-bench.cpp Co-authored-by: Diego Devesa <[email protected]> --------- Co-authored-by: Diego Devesa <[email protected]>
docs : Note about necessity of having libcurl installed for standard … …build. (ggml-org#13945) Signed-off-by: Jiri Podivin <[email protected]>
PreviousNext