If I remeber correctly problems with the clock appeared with speeds under 600mhz, at least on RPis.
Imho, If you want good sound, buy equipment what is build for this usecase, like good USB audio interfaces and a good pair of speakers.
I mean, when you can hear differences when the clock speed changes… Why would I use this when I want to enjoy high quality audio? 