Package

io.minio.spark.benchmarks

dfsio

Permalink

package dfsio

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. dfsio
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Type Members

  1. type BytesSize = Long

    Permalink
  2. class IOReader extends IOTestBase

    Permalink
  3. abstract class IOTestBase extends Serializable with LazyLogging

    Permalink
  4. class IOWriter extends IOTestBase

    Permalink
  5. case class Stats(tasks: Long, size: BytesSize, time: Long, rate: Float, sqRate: Float) extends Product with Serializable

    Permalink
  6. case class TestDFSIOConf(mode: TestMode = NotDefined, numFiles: Int = 4, fileSize: Long = 1048576, benchmarkDir: String = "/benchmarks/DFSIO", resFileName: String = "TestDFSIO_results.log", bufferSize: Int = 1048576, hadoopExtraProps: Map[String, String] = Map.empty[String, String]) extends Product with Serializable

    Permalink
  7. sealed trait TestMode extends AnyRef

    Permalink

Value Members

  1. object BuildInfo extends Product with Serializable

    Permalink

    This object was generated by sbt-buildinfo.

  2. object Clean extends TestMode with Product with Serializable

    Permalink
  3. object ControlFilesCreator

    Permalink
  4. object NotDefined extends TestMode with Product with Serializable

    Permalink
  5. object Read extends TestMode with Product with Serializable

    Permalink
  6. object StatsAccumulator

    Permalink
  7. object TestDFSIO extends App with LazyLogging

    Permalink

    Distributed I/O benchmark.

    Distributed I/O benchmark.

    This test application writes into or reads from a specified number of files. The number of bytes to write or read is also specified as a parameter to the test. By default, each file is accessed in a separate spark task.

  8. object TestDFSIOConfParser extends LazyLogging

    Permalink
  9. object Write extends TestMode with Product with Serializable

    Permalink

Inherited from AnyRef

Inherited from Any

Ungrouped