Troubleshooting High Load Averages, CPU, and Memory Utilization on Server Node For VIL

Overview

The customer is experiencing high load averages, CPU, and memory utilization on their server node. This issue is causing alarms to trigger as the physical memory usage goes beyond the set threshold. Despite implementing a cache clear script that runs every 5 minutes, the problem persists. The server node serves multiple types of traffic and also functions as a backup node and a database server. The customer suspects that the high utilization could be due to multiple services running on the node, the node being used as a backup, and the operation of database services on this node. Additionally, the customer reported an issue with the aide command being unable to write into the aide log file.

Recording: Explaining the issue

Ticket: 4098678

Solution

1. Review the customer's observations and analysis of the high load average, CPU, and memory utilization on the server node.
2. Note that the customer has implemented a cache clear script that runs every five minutes and that the server node is serving multiple types of traffic and functioning as a backup node and a database server.
3. Review the CPU state and traffic trend provided by the customer.
4. Request a call with the customer to discuss the matter in detail due to the complexity of the issue.
5. During the call, ask the customer to provide the memory utilization and monitor the utilization and capacity.
6. Explain to the customer that the site is a replica of another site with a higher version of OS and a higher version of the application, which is currently being supported.
7. Advise the customer to check the traffic utilization on the server with the Circle team or the planning team.
8. Confirm to the customer that the server is capable of catering to the traffic for all the gateways and all the brands.
9. Mark the ticket as solved and allow the customer to follow up on the current period and Gateway capacity from the planning and Circle teams.

Summary

High CPU and memory utilization on a server node can be caused by multiple services running on the node, the node being used as a backup, and the operation of database services on this node. Implementing a cache clear script can help manage high cache memory. Monitoring the utilization of the server node and comparing the current throughput utilization with the proposed capacity throughput can help identify and resolve issues.

FAQ

1. What can cause high CPU and memory utilization on a server node?
   Multiple services running on the node, the node being used as a backup, and the operation of database services on this node can cause high CPU and memory utilization.
2. How can high cache memory be managed?
   Implementing a cache clear script can help manage high cache memory.
3. How can issues with high CPU and memory utilization be identified and resolved?
   Monitoring the utilization of the server node and comparing the current throughput utilization with the proposed capacity throughput can help identify and resolve issues.