Did you performed some kernel update recently? Did you already tried to restart your system?
I did not change the kernel (unless it was done by dietpi-update).
System has been restarted several times with no change.
can you share some more logs
journalctl -u docker.service
journalctl -u containerd.service
Gladly, and thank you!
journalctl -u docker.service
Aug 01 19:08:05 DietPi systemd[1]: Started docker.service - Docker Application Container Engine.
Aug 01 19:08:55 DietPi dockerd[596]: time="2023-08-01T19:08:55.225107408-04:00" level=warning msg="failed to retrieve runc version: signal: segmentation fault (core dumped)"
Aug 01 19:09:56 DietPi dockerd[596]: time="2023-08-01T19:09:56.807959312-04:00" level=warning msg="failed to retrieve runc version: signal: segmentation fault (core dumped)"
Aug 01 19:10:28 DietPi dockerd[596]: time="2023-08-01T19:10:28.536228779-04:00" level=error msg="stream copy error: reading from a closed fifo"
Aug 01 19:10:28 DietPi dockerd[596]: time="2023-08-01T19:10:28.538932008-04:00" level=error msg="stream copy error: reading from a closed fifo"
Aug 01 19:10:28 DietPi dockerd[596]: time="2023-08-01T19:10:28.987492320-04:00" level=error msg="Handler for POST /v1.43/containers/a75a30127d9fe95d7b0c1740b2923a9585261f9df2781d98a792edd128abe701/start returned error: failed to create task for container: failed to start shim: start failed: unexpected fault address 0xffffffffff5c1720\nfatal error: fault\n[signal SIGSEGV: segmentation violation code=0x1 addr=0xffffffffff5c1720 pc=0xffffffffff5c1720]\n\ngoroutine 1 [running, locked to thread]:\nruntime.throw({0x52ad39?, 0x0?})\n\t/usr/local/go/src/runtime/panic.go:1047 +0x40 fp=0x40000977b0 sp=0x4000097780 pc=0x45130\nruntime.sigpanic()\n\t/usr/local/go/src/runtime/signal_unix.go:846 +0x1a0 fp=0x40000977e0 sp=0x40000977b0 pc=0x5bd70\nnet.init()\n\t/usr/local/go/src/net/conf.go:37 +0xc fp=0x40000977f0 sp=0x40000977f0 pc=0x1f15bc\nruntime: traceback stuck. pc=0x1f15bc sp=0x40000977f0\nstack: frame={sp:0x40000977f0, fp:0x40000977f0} stack=[0x4000096000,0x4000098000)\n0x00000040000976f0: 0x0000000000000001 0x0000004000097738 \n0x0000004000097700: 0x00000000000471bc <runtime.printstring+0x000000000000004c> 0x00000000005c7cd8 \n0x0000004000097710: 0x0000000000000001 0x0000000000000001 \n0x0000004000097720: 0x000000000005bd58 <runtime.sigpanic+0x0000000000000188> 0x0000004000097738 \n0x0000004000097730: 0x00000000000453c8 <runtime.fatalthrow+0x0000000000000058> 0x0000004000097778 \n0x0000004000097740: 0x0000000000045130 <runtime.throw+0x0000000000000040> 0x0000004000097758 \n0x0000004000097750: 0x00000040000021a0 0x00000000000453e0 <runtime.fatalthrow.func1+0x0000000000000000> \n0x0000004000097760: 0x00000040000021a0 0x0000000000045130 <runtime.throw+0x0000000000000040> \n0x0000004000097770: 0x0000004000097780 0x00000040000977a8 \n0x0000004000097780: 0x000000000005bd70 <runtime.sigpanic+0x00000000000001a0> 0x0000004000097790 \n0x0000004000097790: 0x0000000000045140 <runtime.throw.func1+0x0000000000000000> 0x000000000052ad39 \n0x00000040000977a0: 0x0000000000000005 0x00000040000977e8 \n0x00000040000977b0: 0x00000000001f15bc <net.init+0x000000000000000c> 0x000000000052ad39 \n0x00000040000977c0: 0x0000000000000000 0xffffffffff5c1720 \n0x00000040000977d0: 0x00000040000021a0 0x00000000008c3cf8 \n0x00000040000977e0: 0x00000000001f15bc <net.init+0x000000000000000c> 0x0000004000097928 \n0x00000040000977f0: >0x0000000000055568 <runtime.doInit+0x0000000000000068> 0x00000000008c1de0 \n0x0000004000097800: 0x000000000052a82a 0x0000004000097818 \n0x0000004000097810: 0x000000000001f3e8 <runtime.evacuate+0x0000000000000108> 0x00000040000978d8 \n0x0000004000097820: 0x000000000001f2ac <runtime.growWork+0x000000000000006c> 0x0000000000000000 \n0x0000004000097830: 0x00000040000d53a8 0x0000000000000000 \n0x0000004000097840: 0x000000000000000e 0x0000000000000000 \n0x0000004000097850: 0x0000000000000000 0x00000040000978c8 \n0x0000004000097860: 0x000000000001c82c <runtime.newobject+0x000000000000002c> 0x0000000000000008 \n0x0000004000097870: 0x00000040000be968 0x00000040000be968 \n0x0000004000097880: 0x00000040000be9e8 0x0000000000007988 \n0x0000004000097890: 0x0000007f8c57df38 0x0000007fb3a0e5b8 \n0x00000040000978a0: 0x0000000000000010 0x00000000008f1f20 \n0x00000040000978b0: 0x0000004000084430 0x0000000000000000 \n0x00000040000978c0: 0x0000000000000004 0x00000040000978f8 \n0x00000040000978d0: 0x00000000001ae704 <encoding/hex.init+0x0000000000000024> 0x0000000000000010 \n0x00000040000978e0: 0x00000000004ae840 0x0000000000499d01 \nfatal error: traceback stuck\npanic during panic\n\nruntime stack:\nruntime.throw({0x52fe5e?, 0x8cd100?})\n\t/usr/local/go/src/runtime/panic.go:1047 +0x40 fp=0x7fff3bbf60 sp=0x7fff3bbf30 pc=0x45130\nruntime.gentraceback(0x7fff3bc2f8?, 0x4e58c?, 0x40000021d8?, 0x40000021a0, 0x0, 0x0, 0x64, 0x0, 0x40000021a0?, 0x0)\n\t/usr/local/go/src/runtime/traceback.go:499 +0xeb4 fp=0x7fff3bc2c0 sp=0x7fff3bbf60 pc=0x69824\nruntime.traceback1(0x1?, 0x200000001?, 0x0?, 0x40000021a0, 0x1?)\n\t/usr/local/go/src/runtime/traceback.go:857 +0x148 fp=0x7fff3bc480 sp=0x7fff3bc2c0 pc=0x6aca8\nruntime.traceback(0x40000021a0?, 0xf4240?, 0x2?, 0x400002c000?)\n\t/usr/local/go/src/runtime/traceback.go:804 +0x20 fp=0x7fff3bc4c0 sp=0x7fff3bc480 pc=0x6aa90\nruntime.dopanic_m(0x40000021a0, 0x7374c?, 0x52ad39?)\n\t/usr/local/go/src/runtime/panic.go:1267 +0x234 fp=0x7fff3bc540 sp=0x7fff3bc4c0 pc=0x459f4\nruntime.fatalthrow.func1()\n\t/usr/local/go/src/runtime/panic.go:1129 +0x60 fp=0x7fff3bc580 sp=0x7fff3bc540 pc=0x45440\nruntime.systemstack()\n\t/usr/local/go/src/runtime/asm_arm64.s:243 +0x6c fp=0x7fff3bc590 sp=0x7fff3bc580 pc=0x7374c\n\ngoroutine 1 [running, locked to thread]:\nruntime.systemstack_switch()\n\t/usr/local/go/src/runtime/asm_arm64.s:200 +0x8 fp=0x4000097740 sp=0x4000097730 pc=0x736c8\nruntime.fatalthrow(0x97790?)\n\t/usr/local/go/src/runtime/panic.go:1122 +0x58 fp=0x4000097780 sp=0x4000097740 pc=0x453c8\nruntime.throw({0x52ad39?, 0x0?})\n\t/usr/local/go/src/runtime/panic.go:1047 +0x40 fp=0x40000977b0 sp=0x4000097780 pc=0x45130\nruntime.sigpanic()\n\t/usr/local/go/src/runtime/signal_unix.go:846 +0x1a0 fp=0x40000977e0 sp=0x40000977b0 pc=0x5bd70\nnet.init()\n\t/usr/local/go/src/net/conf.go:37 +0xc fp=0x40000977f0 sp=0x40000977f0 pc=0x1f15bc\nruntime: traceback stuck. pc=0x1f15bc sp=0x40000977f0\nstack: frame={sp:0x40000977f0, fp:0x40000977f0} stack=[0x4000096000,0x4000098000)\n0x00000040000976f0: 0x0000000000000001 0x0000004000097738 \n0x0000004000097700: 0x00000000000471bc <runtime.printstring+0x000000000000004c> 0x00000000005c7cd8 \n0x0000004000097710: 0x0000000000000001 0x0000000000000001 \n0x0000004000097720: 0x000000000005bd58 <runtime.sigpanic+0x0000000000000188> 0x0000004000097738 \n0x0000004000097730: 0x00000000000453c8 <runtime.fatalthrow+0x0000000000000058> 0x0000004000097778 \n0x0000004000097740: 0x0000000000045130 <runtime.throw+0x0000000000000040> 0x0000004000097758 \n0x0000004000097750: 0x00000040000021a0 0x00000000000453e0 <runtime.fatalthrow.func1+0x0000000000000000> \n0x0000004000097760: 0x00000040000021a0 0x0000000000045130 <runtime.throw+0x0000000000000040> \n0x0000004000097770: 0x0000004000097780 0x00000040000977a8 \n0x0000004000097780: 0x000000000005bd70 <runtime.sigpanic+0x00000000000001a0> 0x0000004000097790 \n0x0000004000097790: 0x0000000000045140 <runtime.throw.func1+0x0000000000000000> 0x000000000052ad39 \n0x00000040000977a0: 0x0000000000000005 0x00000040000977e8 \n0x00000040000977b0: 0x00000000001f15bc <net.init+0x000000000000000c> 0x000000000052ad39 \n0x00000040000977c0: 0x0000000000000000 0xffffffffff5c1720 \n0x00000040000977d0: 0x00000040000021a0 0x00000000008c3cf8 \n0x00000040000977e0: 0x00000000001f15bc <net.init+0x000000000000000c> 0x0000004000097928 \n0x00000040000977f0: >0x0000000000055568 <runtime.doInit+0x0000000000000068> 0x00000000008c1de0 \n0x0000004000097800: 0x000000000052a82a 0x0000004000097818 \n0x0000004000097810: 0x000000000001f3e8 <runtime.evacuate+0x0000000000000108> 0x00000040000978d8 \n0x0000004000097820: 0x000000000001f2ac <runtime.growWork+0x000000000000006c> 0x0000000000000000 \n0x0000004000097830: 0x00000040000d53a8 0x0000000000000000 \n0x0000004000097840: 0x000000000000000e 0x0000000000000000 \n0x0000004000097850: 0x0000000000000000 0x00000040000978c8 \n0x0000004000097860: 0x000000000001c82c <runtime.newobject+0x000000000000002c> 0x0000000000000008 \n0x0000004000097870: 0x00000040000be968 0x00000040000be968 \n0x0000004000097880: 0x00000040000be9e8 0x0000000000007988 \n0x0000004000097890: 0x0000007f8c57df38 0x0000007fb3a0e5b8 \n0x00000040000978a0: 0x0000000000000010 0x00000000008f1f20 \n0x00000040000978b0: 0x0000004000084430 0x0000000000000000 \n0x00000040000978c0: 0x0000000000000004 0x00000040000978f8 \n0x00000040000978d0: 0x00000000001ae704 <encoding/hex.init+0x0000000000000024> 0x0000000000000010 \n0x00000040000978e0: 0x00000000004ae840 0x0000000000499d01 \nfatal error: traceback stuck\nstack trace unavailable\n: exit status 4: unknown"
journalctl -u containerd.service
Aug 01 19:07:54 DietPi systemd[1]: Starting containerd.service - containerd container runtime...
Aug 01 19:08:04 DietPi containerd[486]: time="2023-08-01T19:08:04-04:00" level=warning msg="containerd config version `1` has been deprecated and will be removed in containerd v2.0, please switch to version `2`, see https://github.com/containerd/containerd/blob/e0912c068b131b33798ae45fd447a1624a6faf0a/docs/PLUGINS.md#version-header"
Aug 01 19:08:05 DietPi containerd[486]: time="2023-08-01T19:08:05.019103475-04:00" level=warning msg="failed to load plugin io.containerd.snapshotter.v1.devmapper" error="devmapper not configured"
Aug 01 19:08:05 DietPi containerd[486]: time="2023-08-01T19:08:05.063782798-04:00" level=warning msg="could not use snapshotter devmapper in metadata plugin" error="devmapper not configured"
Aug 01 19:08:05 DietPi containerd[486]: time="2023-08-01T19:08:05.135157537-04:00" level=error msg="failed to initialize a tracing processor \"otlp\"" error="no OpenTelemetry endpoint: skip plugin"
Aug 01 19:08:05 DietPi systemd[1]: Started containerd.service - containerd container runtime.
Aug 01 19:10:28 DietPi containerd[486]: time="2023-08-01T19:10:28.525888414-04:00" level=error msg="copy shim log" error="read /proc/self/fd/11: file already closed"
hmm this could be some file system corruption. Was this a fresh new installation?
I was running Nextcloud and Jellyfin on this Rpi for about 1 month. I wanted to add some functions to Nextcloud and needed docker, and that’s when I started running into this issue.
So this docker install is not new, since I tried some troubleshooting and remove/re-installs over the past few days. But the Dietpi instance is pretty young.
I have been avoiding a complete re-install of DIetpi, but if that would be your next suggestion, I would be willing to try it. My concern with that would be migrating my existing services to the “new” server.
before starting from scratch, can you try to remove docker completely, reboot and try to install Docker (just Docker) again?
Docker installed alone. “Docker run hello-world” is a success!
Assuming docker-compose is the issue, would you suggest I try adding it? I’m fairly new to docker but I sort of assumed you needed compose to get the most out of it.
don’t think so. Docker Compose has nothing to do with starting Docker engine. It’s just a plugin allowing to start container using a specific Docker compose config file. Same could be done using Portainer without having Docker Compose installed.
I tried adding Portainer after the successful hello-world run. The install failed. Docker would not run (even “docker version”) after the failed Portainer install.
I removed docker again and reinstalled. Immediately after reinstall the docker service ran hello-world successfully, but after reboot the daemon wouldn’t start. Attempted to start the daemon manually. Any call to docker results in “fatal error: slice bounds out of range.”
I believe I have a backup from prior to my first attempt to install docker/portainer, so I may drop back to that. I’m open to suggestions. It’s driving me crazy that it works, but doesn’t stay working.
for me this seems to be some file system issues or data corrupting leading to the service failing. Can you check for kernel error messages
dmesg -l 0,1,2,3
dmesg results in no output.
can you share again this after reboot
I wonder if this is missing/pointing to a wrong path. I don’t see /containerd in my /run folder 
journalctl -u docker.service
Aug 03 10:59:36 DietPi systemd[1]: Started docker.service - Docker Application Container Engine.
Aug 03 11:00:36 DietPi dockerd[1011]: failed to start daemon: failed to dial "/run/containerd/containerd.sock": failed to dial "/run/containerd/containerd.sock": context deadline exceeded
Aug 03 11:00:36 DietPi systemd[1]: docker.service: Main process exited, code=exited, status=1/FAILURE
Aug 03 11:00:36 DietPi systemd[1]: docker.service: Failed with result 'exit-code'.
Aug 03 11:00:36 DietPi systemd[1]: docker.service: Consumed 2.515s CPU time.
Aug 03 11:00:38 DietPi systemd[1]: docker.service: Scheduled restart job, restart counter is at 2.
Aug 03 11:00:38 DietPi systemd[1]: Stopped docker.service - Docker Application Container Engine.
Aug 03 11:00:38 DietPi systemd[1]: docker.service: Consumed 2.515s CPU time.
Aug 03 11:01:11 DietPi systemd[1]: Started docker.service - Docker Application Container Engine.
Aug 03 11:02:12 DietPi dockerd[1078]: failed to start daemon: failed to dial "/run/containerd/containerd.sock": failed to dial "/run/containerd/containerd.sock": context deadline exceeded
Aug 03 11:02:12 DietPi systemd[1]: docker.service: Main process exited, code=exited, status=1/FAILURE
Aug 03 11:02:12 DietPi systemd[1]: docker.service: Failed with result 'exit-code'.
Aug 03 11:02:12 DietPi systemd[1]: docker.service: Consumed 2.617s CPU time.
Aug 03 11:02:14 DietPi systemd[1]: docker.service: Scheduled restart job, restart counter is at 3.
Aug 03 11:02:14 DietPi systemd[1]: Stopped docker.service - Docker Application Container Engine.
Aug 03 11:02:14 DietPi systemd[1]: docker.service: Consumed 2.617s CPU time.
What is status of containerd.service??
journalctl -u containerd.service
systemctl status containerd.service
journalctl -u containerd.service
results in the below (small segment for sake of space). I needed to Ctrl-C to stop it.
Aug 03 16:24:58 DietPi containerd[14955]: k8s.io/apimachinery/pkg/apis/meta/v1.sovGenerated(...)
Aug 03 16:24:58 DietPi containerd[14955]: /go/src/github.com/containerd/containerd/vendor/google.golang.org/protobuf/internal/strs/strings_unsafe.go:-6211
Aug 03 16:24:58 DietPi containerd[14955]: k8s.io/apimachinery/pkg/apis/meta/v1.sovGenerated(...)
Aug 03 16:24:58 DietPi containerd[14955]: /go/src/github.com/containerd/containerd/vendor/google.golang.org/protobuf/internal/strs/strings_unsafe.go:-6211
Aug 03 16:24:58 DietPi containerd[14955]: k8s.io/apimachinery/pkg/apis/meta/v1.sovGenerated(...)
Aug 03 16:24:58 DietPi containerd[14955]: /go/src/github.com/containerd/containerd/vendor/google.golang.org/protobuf/internal/strs/strings_unsafe.go:-6211
systemctl status containerd.service
containerd.service - containerd container runtime
Loaded: loaded (/lib/systemd/system/containerd.service; enabled; preset: enabled)
Active: activating (start) since Thu 2023-08-03 16:27:38 EDT; 6s ago
Docs: https://containerd.io
Process: 15153 ExecStartPre=/sbin/modprobe overlay (code=exited, status=0/SUCCESS)
Main PID: 15154 (containerd)
Tasks: 6
Memory: 14.0M
CPU: 4.894s
CGroup: /system.slice/containerd.service
└─15154 /usr/bin/containerd
Aug 03 16:27:38 DietPi systemd[1]: Starting containerd.service - containerd container runtime...
For the record, I have tried to chase down some of these messages, but it’s either a dead end, or doesn’t apply to this situation.
Hmm Status of service is activating does this change over time? Usually it should be
● containerd.service - containerd container runtime
Loaded: loaded (/lib/systemd/system/containerd.service; enabled; vendor preset: enabled)
Active: active (running) since Thu 2023-08-03 12:17:10 CEST; 10h ago
The result I pasted from systemctl was after this server was online for approximately 5 hours.
Same result just a minute ago, so it has not changed in the last 24 minutes. 