.. _Monitoring Nodes: Monitoring Nodes ---------------- Nodes added to the infrastructure are listed on the **NODES** screen, grouped by status. If the storage cluster has not been created yet, you will only see nodes in the **UNASSIGNED** list. If the storage cluster exists, its nodes will be listed on the screen. .. include:: /includes/monitoring-storage-cluster-part1.inc .. _Node Statuses: Node Statuses ~~~~~~~~~~~~~ A node can have one of the following statuses: **HEALTHY** All the storage services on the node are running. **OFFLINE** The node cannot be reached from the admin panel, although it may still be up and its services may be running. **FAILED** One or more storage services on the node have failed. **UNASSIGNED** The node is not assigned to a cluster. .. _Monitoring Node Performance: Monitoring Node Performance ~~~~~~~~~~~~~~~~~~~~~~~~~~~ To monitor the performance of a cluster node, open the **NODES** screen and click the node. On the node overview screen, you will see performance statistics described below. The overall statistics include: - the number of CPUs and the amount of RAM, - CPU usage, in percent over time, - RAM usage, in megabytes or gigabytes over time. .. only:: ac .. image:: /images/stor_image29_ac.png :align: center :class: align-center .. only:: vz .. image:: /images/stor_image29_vz.png :align: center :class: align-center The **DISKS** section shows: - the number of HDD and SSD drives and their statuses, - node I/O activity over time on the read and write charts. .. only:: ac .. image:: /images/stor_image30_ac.png :align: center :class: align-center .. only:: vz .. image:: /images/stor_image30_vz.png :align: center :class: align-center The **NETWORK** section shows: - the list of network interfaces and their statuses, - the amount of transmitted (TX) and received (RX) traffic over time. .. only:: ac .. image:: /images/stor_image31_ac.png :align: center :class: align-center .. only:: vz .. image:: /images/stor_image31_vz.png :align: center :class: align-center The following sections provide more information on disk and network usage. .. _Monitoring Node Disks: Monitoring Node Disks ~~~~~~~~~~~~~~~~~~~~~ To monitor the usage and status of node disks, click the **DISKS** link on the node overview screen. You will see a list of all disks on the node and their status icons. A disk status icon shows the combined status of S.M.A.R.T. and the service corresponding to the disk role. It can be one of the following: **OK** The disk and service are healthy. **Failed** The service has failed or S.M.A.R.T. reported an error. **Releasing** The service is being released. When the process finishes, the disk status will change to **OK**. To monitor performance of a particular disk, select it and click **Performance**. The **Drive performance** panel will display the I/O activity of the disk. To view information about the disk, including its S.M.A.R.T. status, click **Details**. To have the disk blink its activity LED, select the disk, and click **Blink**. To have the disk stop blinking, click **Unblink**. .. _Monitoring the S.M.A.R.T. Status of Node Disks: Monitoring the S.M.A.R.T. Status of Node Disks ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ The S.M.A.R.T. status of all disks is monitored by a tool installed along with |product_name|. Run every 10 minutes, the tool polls all disks attached to nodes, including journaling SSDs and system disks, and reports the results to the management node. For the tool to work, make sure the S.M.A.R.T. functionality is enabled in node's BIOS. If a S.M.A.R.T. warning message is shown in the node status, one of that node's disks is in pre-failure condition and should be replaced. If you continue using the disk, keep in mind that it may fail or cause performance issues. Pre-failure condition means that at least one of these S.M.A.R.T. counters is not zero: - Reallocated Sector Count - Reallocated Event Count - Current Pending Sector Count - Offline Uncorrectable .. _Monitoring Node Network: Monitoring Node Network ~~~~~~~~~~~~~~~~~~~~~~~ To monitor the node's network usage, click **NETWORK** on the node overview screen. To display the performance charts of a specific network interface, select it in the list and click **Performance**. When monitoring network performance, keep in mind that if the **Receive and transmit errors** chart is not empty, the network is experiencing issues and requires attention. To display the details of a network interface, click **Details**. The **Network details** panel shows the interface state, bandwidth, MTU, MAC address, and all IP addresses.