PiVPN only working after debug has been run, after DietPi reboot?

Uninstalling iptables-persistent and its dependencies solved the issue for me:

sudo apt remove iptables-persistent
sudo apt autoremove

I found the solution here, but am unsure about the repercussions of doing this.

Thanks for all your help @Joulinar and @Ake2!