It’s not easy but connecting Bluetooth device from scratch within RetroPie did the job.
Is it possible to have the message windows that the device connects/disconnects appear in the background. They interfere with the software.
Edit: I uninstalled the blueman-manager, this prompted the windows. Once I got the hang of terminal Bluetooth connecting, easier and lighter.