Type Members

1.  class CPUMetrics extends SparkPlugin

   Collects CPU resource metrics from a unix-based operating system.

   Collects CPU resource metrics from a unix-based operating system.

   Use when Spark is running in clusters with standalone, Mesos or YARN resource managers.

   CPU metrics are obtained from the numbers of the first line of the /proc/stat file, available at the proc pseudo-filesystem of unix-based operating systems. These numbers identify the amount of time the CPU has spent performing different kinds of work, arranged in columns at the following order: "cpu_user", "cpu_nice", "cpu_system", "cpu_idle", "cpu_iowait", "cpu_irq" and "cpu_softirq".

   Note

   All of the numbers retrieved are aggregates since the system first booted.

   ,

   Time units are in USER_HZ or Jiffies (typically hundredths of a second)

   ,

   Values for "cpu_steal", "cpu_guest" and "cpu_guest_nice", available at spectific Linux versions, are not parsed from the file.

2.  class MeminfoMetricCollector extends ProcFileMetricCollector
3.  class MemoryMetrics extends SparkPlugin

   Collects memory resource metrics from a unix-based operating system.

   Collects memory resource metrics from a unix-based operating system.

   Use when Spark is running in clusters with standalone, Mesos or YARN resource managers.

   Memory metrics are obtained from the numbers of each line of the /proc/meminfo file, available at the proc pseudo-filesystem of unix-based operating systems. The file has statistics about memory usage on the system, arranged in lines consisted of a parameter name, followed by a colon, the value of the parameter, and an option unit of measurement.

   Note

   While the /proc/meminfo file shows kilobytes (kB; 1 kB equals 1000 B), its unit is actually kibibytes (KiB; 1 KiB equals 1024 B). This imprecision is known, but is not corrected due to legacy concerns.

   ,

   Many fields have been present since at least Linux 2.6.0, but most of the other fields are available at specific Linux versions (as noted in each method docstring) or are displayed only if the kernel was configured with specific options. If these fields are not found, the metrics won't be registered onto Dropwizard's metric system.

4.  trait ProcFileMetricCollector extends AnyRef
5.  class StatMetricCollector extends ProcFileMetricCollector