Orange Pi Zero 3 - hangs up on wifi 2.4 GHz

I have Orange Pi Zero 3 and lastest DietPi and everything works perfect until I switch wireless from 5GHz to 2.4GHz. Then every ~2 seconds Pi hangs for second what cause that almost impossible even to login via ssh. I found that pings goes from 5-6 ms to far more than 100ms or connection is dropped for a while.

Is it a known issue? Is there any way to use 2.4GHz wifi?

Maybe the 2,4G is congested or noisy and you experience packet loss from that?