For me it works OOTB with plain ALSA. Of course one needs to take care to select the correct HDMI port:
rockchiphdmi0 is the one on the outer side, labeled with “TX1”, rockchiphdmi1 is the one next to the USB-C power port, labelled “TX2”.
rockchiphdmi0
rockchiphdmi1