Which device do you actually use? It also depends on the GPU acceleration drivers that Kodi/the system offers/uses. On RPi however it should work out of the box and the increased gpu_mem share, advices by nicosea is worth a try.
If it solved the issue, I think we will increase this by default to 512M on >=1024M devices.
I am using a Pi 3 b+ and increasing gpu_mem share to 512mb solved all problems of frame losses or even black screen. Libreelec and OSMC have gpu_mem share to 512mb, I got the idea from there.