I guess you connect your SSD to the RPi4 just using USB ports without external PSU for the drive correct? Its well known that RPi4 USB ports technically not able to power SSD or HDD. Therefore it is highly recommended to use external PSU or powered USB hub
You should see kernel error messages as soon as the issue appears
dmesg -l 0,1,2,3