Storage device IO
1readings
1conditions
2themes fed
Livestatus
Per-device IO posture, including a device that is busy but moving almost nothing.
Topic id: storage_device_io.
Conditions
A condition is a state that holds for a while. The agent opens it when the host enters it, keeps it open while it lasts, and closes it when the host comes back out, so one episode answers for the whole stretch instead of one alert per sample.
| Condition | Severity | How an episode ends |
|---|---|---|
disk unresponsive (disk_unresponsive) | Minor to Critical | It closes when any one of the several recovery conditions is met. |
Example
Inventory (every 5 minutes)
1 device; "Disk 0" nvme ssd busy 12%, 0.5 ms p90.
sparklogs.data.storage_device_io.device: storage_device:eui.0025385c91b5a1e2
sparklogs.data.storage_device_io.busy_pct_avg: 12.0
sparklogs.data.storage_device_io.total_iops_avg: 1400.0
sparklogs.data.storage_device_io.total_mb_per_s_avg: 11.4
SparkLogs: CONTEXT, Info, storage_device_io: INVENTORY: 1 device; "Disk 0" nvme ssd busy 12%, 0.5 ms p90.
Selected conditions
disk_unresponsive
A storage device is busy but moving almost no data.
Impact: IO to this device may be stalled, and a writeable volume on it can stop responding.
Example
started; "Disk 1" busy 99
sparklogs.instance: storage_device:eui.0025385c91b5a1e3
sparklogs.data.storage_device_io.device: storage_device:eui.0025385c91b5a1e3
sparklogs.data.storage_device_io.busy_pct_avg: 99.0
sparklogs.data.storage_device_io.total_iops_avg: 0.4
sparklogs.data.storage_device_io.total_mb_per_s_avg: 0.01
sparklogs.data.storage_device_io.disk_unresponsive_age_h: 0.0
SparkLogs: disk_unresponsive, Critical, storage_device_io: disk_unresponsive: NOTABLE: started; "Disk 1" busy 99
| Case | Severity | Ticket class |
|---|---|---|
onset | Trace to Fatal | storage |
held | Trace to Fatal | storage |
recovered | Trace to Fatal | storage |