Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Commit 8c60a8a

Browse files
bssrdfbssrdf
authored and
ggerganov
committed
increase cuda_cpy block size (ggml/996)
Co-authored-by: bssrdf <[email protected]>
1 parent 9e4a256 commit 8c60a8a

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

‎ggml/src/ggml-cuda/cpy.cuh

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
#include "common.cuh"
22

3-
#define CUDA_CPY_BLOCK_SIZE 32
3+
#define CUDA_CPY_BLOCK_SIZE 64
44

55
void ggml_cuda_cpy(ggml_backend_cuda_context & ctx, const ggml_tensor * src0, ggml_tensor * src1);
66

0 commit comments

Comments
 (0)