Management Plane Crashing Due To Disk space Exhaustion Related to Logrotation Failure

Problem

The Management cluster crashing in the SMCP-GA and SMCP-Patch1 environments due to high disk utilisation in the Management Cluster nodes. The Fluentbit logs were using disk space around 92Gb.

Management Cluster node

[root@rocky-9 fluentbit]#ls -ahl /var/log/pf9/fluentbit/
total 94G
drwxr-xr-x. 2 root root 38 Dec 13 12:58 .
drwxr-xr-x. 9 pf9 pf9group 4.0K Jan 2 09:00 ..
-rw-r--r--. 1 root root 92G Jan 2 13:27 ddu.log
-rw-r--r--. 1 root root 1.7G Jan 2 13:21 infra.log

Environment

• Platform9 Self Managed Cloud Platform9 SMCP-GA [v-5.9.1-3097399] and SMCP patch1 [v-5.9.0-2847602].

Answer

This is a known issues and it will be resolved in the SMCP-Patch2 [v-5.9.2] release which will be available by the end of March in 2024.

Additional Information

For any further queries, please open a support request mentioning the jira ID AIR-1273.