Code

Multi-threaded quantization#1075

Code

Merged

ggerganov merged 6 commits intomasterggml-org/llama.cpp:masterfrom

multi-thread-quantizeggml-org/llama.cpp:multi-thread-quantizeCopy head branch name to clipboard

Apr 20, 2023

Commits

Commits on Apr 19, 2023

• Multi-threading quantization.

  Show description for d2f9266
  Kawrakow

  committed
  d2f9266

  Copy full SHA for d2f9266

Commits on Apr 20, 2023

• Multi-threading for quantize-stats

  Show description for ce05fc0
  Kawrakow

  committed
  ce05fc0

  Copy full SHA for ce05fc0

• Reviewer comments

  Kawrakow

  committed
  b65e559

  Copy full SHA for b65e559

• Avoiding compiler confusion

  Show description for 7fae1c4
  Kawrakow

  committed
  7fae1c4

  Copy full SHA for 7fae1c4

• Still fighting with lambda captures in MSVC

  Kawrakow

  committed
  0ae02eb

  Copy full SHA for 0ae02eb

• Merge branch 'master' into multi-thread-quantize

  ggerganov

  authored
  b3545d9

  Copy full SHA for b3545d9