We have a couple of similar topics for lighttpd. But you could use them as starting point. Confused Reverse proxy and vaultwarden - #21 by Joulinar
Of course, proxy settings look different but there are a couple of examples within vaultwarden wiki. Proxy examples · dani-garcia/vaultwarden Wiki · GitHub