rknpu driver version: 0.8.2, platform: RK3588，please upgrade to 0.9.7
rknn-llm/examples/rkllm_api_demo/deploy/install/demo_Linux_aarch64$ ./llm_demo /home/linaro/code/DeepSeek-R1-Distill-Qwen-1.5B_W8A8_RK3588.rkllm 1024 1024
rkllm init start
W rkllm: Warning: Your rknpu driver version is too low, please upgrade to 0.9.7
I rkllm: rkllm-runtime version: 1.2.2, rknpu driver version: 0.8.2, platform: RK3588
I rkllm: loading rkllm model from /home/linaro/code/DeepSeek-R1-Distill-Qwen-1.5B_W8A8_RK3588.rkllm
I rkllm: rkllm-toolkit version: unknown, max_context_limit: 4096, npu_core_num: 3, target_platform: RK3588, model_dtype: W8A8
I rkllm: Enabled cpus:
I rkllm: Enabled cpus num: 4
rkllm init success
**********************可输入以下问题对应序号获取回答/或自定义输入********************
[0] 现有一笼子，里面有鸡和兔子若干只，数一数，共有头14个，腿38条，求鸡和兔子各有多少只？
[1] 有28位小朋友排成一行,从左边开始数第10位是学豆,从右边开始数他是第几位?
*************************************************************************
user: 0
现有一笼子，里面有鸡和兔子若干只，数一数，共有头14个，腿38条，求鸡和兔子各有多少只？
E rkllm: matmul(w8a8) run failedrobot:
E rkllm: matmul(w8a8) run failed
E rkllm: matmul(w8a8) run failed
E rkllm: matmul(w8a8) run failed
E rkllm: matmul(w8a8) run failed
E rkllm: matmul(w8a8) run failed
E rkllm: matmul(w8a8) run failed
E rkllm: matmul(w8a8) run failed
E rkllm: matmul(w8a8) run failed
E rkllm: 2features matmul run failed
E rkllm: 2features matmul run failed
E rkllm: 2features matmul run failed
E rkllm: 2features matmul run failed
E rkllm: matmul(w8a8) run failed
E rkllm: matmul(w8a8) run failed
E rkllm: matmul(w8a8) run failed
页:
[1]