High CPU usage on influxDB

Troubleshooting
1

I’m running dietpi (8.3.1) on a raspberry for years. since this night and without any reason I know, the CPU load on influxDB (v1.8.10 (git: 1.8 688e697c51fd)) has increased from about nothing to about 110% (25% over all cores). A reboot didn`t solve the issue. Any suggestions what to log/ test? Storage on pi is not full at all.

2

Maybe you could ask the question on InfluxDB community. https://community.influxdata.com/

I guess these guys are more specialised on how to analyse InfluxDB.

3

Seems to be solved by switching to TSI indexing.

4

thx for sharing

5

The problem was only solved temporarily. Now it’s back. “Fatal error: Out of Memory”. I noticed that the 8GB RAM of my Pi is barely used (only 700 MB). How can I change the settings of the influxDB docker container to use more of the memory?

6

Where do you see the error message? Somewhere inside Docker or container logs? Maybe you could ask the container developer for support as well.

7

errors are from the logs:

$ journalctl -u influxdb.service | grep "error"

Here is a short extract:

Jun 03 07:21:41 jhnPi influxd-systemd-start.sh[1640]: ts=2022-06-03T06:21:41.450109Z lvl=info msg=“Error replacing new TSM files” log_id=0ar2GsGW000 engine=tsm1 tsm1_level=2 tsm1_strategy=level trace_id=0ar3TiBG001 op_name=tsm1_compact_group db_shard_id=636 error=“cannot allocate memory”
Jun 03 07:21:43 jhnPi influxd-systemd-start.sh[1640]: ts=2022-06-03T06:21:43.450267Z lvl=info msg=“Error replacing new TSM files” log_id=0ar2GsGW000 engine=tsm1 tsm1_level=2 tsm1_strategy=level trace_id=0ar3Tp~G000 op_name=tsm1_compact_group db_shard_id=652 error=“cannot allocate memory”
Jun 03 07:21:43 jhnPi influxd-systemd-start.sh[1640]: ts=2022-06-03T06:21:43.452220Z lvl=info msg=“Error replacing new TSM files” log_id=0ar2GsGW000 engine=tsm1 tsm1_level=2 tsm1_strategy=level trace_id=0ar3Tp~G001 op_name=tsm1_compact_group db_shard_id=636 error=“cannot allocate memory”

8

Did you tried to restart your system?

And is this an error message from inside the container? I understood you are running InfluxDB from Docker.

9

System restart yes. often. sometimes helps for a few hours. I installed influxDB directly from “dietpi software”.

10

That’s basically 2 conflicting’s statement’s as we don’t install InfluxDB as Docker container :smiley:

11

yes. I do not know why I assumed that it was a docker installation. So please forget about the docker comment :slight_smile:

Sorry.

12

You are using NodeRed together with InfluxDB? And you are using 32bit? At least I found 2 issues (all not DietPi related and a bit older) having similar issues. Maybe you can have a look.

13

Thanks. I am already working on the “solution” of the Node-RED forum, which I also found a few days ago. It is not yet working. I`ll try to keep you updated.