-
Notifications
You must be signed in to change notification settings - Fork 122
Description
python generate_completions.py X:\rwkv.cpp-169M-Q8_0.bin
System info: AVX=1 AVX2=1 AVX512=0 FMA=1 NEON=0 ARM_FMA=0 F16C=1 FP16_VA=0 WASM_SIMD=0 SSE3=1 VSX=0
Loading RWKV model
Traceback (most recent call last):
File "X:\Desktop\RWKV\rwkv.cpp\python\generate_completions.py", line 43, in
model = rwkv_cpp_model.RWKVModel(library, args.model_path, gpu_layers_count=args.num_gpu_layers)
File "X:\Desktop\RWKV\rwkv.cpp\python\rwkv_cpp\rwkv_cpp_model.py", line 66, in init
self._ctx: rwkv_cpp_shared_library.RWKVContext = self._library.rwkv_init_from_file(model_path, thread_count, gpu_layer_count)
File "X:\Desktop\RWKV\rwkv.cpp\python\rwkv_cpp\rwkv_cpp_shared_library.py", line 124, in rwkv_init_from_file
ptr = self.library.rwkv_init_from_file(model_file_path.encode('utf-8'), ctypes.c_uint32(thread_count), ctypes.c_uint32(offload_layers))
OSError: exception: access violation reading 0xFFFFFFFFFFFFFFFF
Anyone know how to fix it ?