查看: 6|回复: 0

rknpu driver version: 0.8.2, platform: RK3588,please upgrade to 0.9.7

[复制链接]

1

主题

0

回帖

205

积分

中级会员

Rank: 3Rank: 3

积分
205
发表于 5 小时前 | 显示全部楼层 |阅读模式

rknn-llm/examples/rkllm_api_demo/deploy/install/demo_Linux_aarch64$ ./llm_demo /home/linaro/code/DeepSeek-R1-Distill-Qwen-1.5B_W8A8_RK3588.rkllm 1024 1024
rkllm init start
W rkllm: Warning: Your rknpu driver version is too low, please upgrade to 0.9.7
I rkllm: rkllm-runtime version: 1.2.2, rknpu driver version: 0.8.2, platform: RK3588
I rkllm: loading rkllm model from /home/linaro/code/DeepSeek-R1-Distill-Qwen-1.5B_W8A8_RK3588.rkllm
I rkllm: rkllm-toolkit version: unknown, max_context_limit: 4096, npu_core_num: 3, target_platform: RK3588, model_dtype: W8A8
I rkllm: Enabled cpus: [4, 5, 6, 7]
I rkllm: Enabled cpus num: 4
rkllm init success

**********************可输入以下问题对应序号获取回答/或自定义输入********************

[0] 现有一笼子,里面有鸡和兔子若干只,数一数,共有头14个,腿38条,求鸡和兔子各有多少只?
[1] 有28位小朋友排成一行,从左边开始数第10位是学豆,从右边开始数他是第几位?

*************************************************************************


user: 0
现有一笼子,里面有鸡和兔子若干只,数一数,共有头14个,腿38条,求鸡和兔子各有多少只?
E rkllm: matmul(w8a8) run failedrobot:
E rkllm: matmul(w8a8) run failed
E rkllm: matmul(w8a8) run failed
E rkllm: matmul(w8a8) run failed
E rkllm: matmul(w8a8) run failed
E rkllm: matmul(w8a8) run failed
E rkllm: matmul(w8a8) run failed
E rkllm: matmul(w8a8) run failed
E rkllm: matmul(w8a8) run failed
E rkllm: 2features matmul run failed
E rkllm: 2features matmul run failed
E rkllm: 2features matmul run failed
E rkllm: 2features matmul run failed
E rkllm: matmul(w8a8) run failed
E rkllm: matmul(w8a8) run failed
E rkllm: matmul(w8a8) run failed


回复

使用道具 举报

您需要登录后才可以回帖 登录 | 立即注册

本版积分规则

QQ|风火轮WIKI|手机版|小黑屋|深圳风火轮团队 ( 粤ICP备17095099号 )

GMT+8, 2025-11-14 16:48 , Processed in 0.080934 second(s), 22 queries .

快速回复 返回顶部 返回列表
 
【客服1】 商务合作 15289193
【客服2】 业务洽谈 13257599
【客服3】 售前咨询 510313198
【邮箱】
smartfire@smartfire.cn