Orange Pi 5 Plus: NPU Driver Support for Docker Projects (e.g., rkllama)?

General Discussion
21

I just re-flash with new image (last week) using linux-image-current-rockchip64 package, I couldn’t found /dev/dri/render* on NPU, only GPU. Check dmesg the NPUs are recognized

[ 4.754521] rocket fdab0000.npu: Rockchip NPU core 0 version: 1179210309
[ 4.754842] rocket fdac0000.npu: Rockchip NPU core 1 version: 1179210309
[ 4.755038] rocket fdad0000.npu: Rockchip NPU core 2 version: 1179210309

I am trying to switch to vendor image like you have been suggested long time ago downloaded via Index of /downloads/binaries . But I couldn’t found linux-dtb package. Please advise, to enable RKNPU on new dietpie version v10.6.2.

22

The mainline Rocket NPU driver does not expose NPU devices below /dev/dri/, but below /dev/accel/, and /sys/class/accel/ in sysfs.

You might need to update the Mesa libraries from backports:

apt install -t trixie-backports mesa-libgallium mesa-teflon-delegate

which can then be used via TensorFlow Lite.

If your software does not support this mainline Mesa Rocket stack, you can switch to the vendor kernel:

apt install linux-image-vendor-rk35xx

The linux-dtb packages have been merged into the linux-image packages a while ago, i.e. just one package needs to be switched. After a reboot, if things then work as you expect, I suggest to purge linux-image-current-rockchip64. Else, an upgrade of that package will cause that mainline kernel to be picked up again on reboot.