util

Type Members

1. class BGZFCodec extends org.seqdoop.hadoop_bam.util.BGZFCodec

   

   A copy of Hadoop-BAM's BGZF codec that returns a Databricks BGZF output stream.

2. case class GenotypeInfo(size: Int, requiredFieldIndices: Seq[Int], optionalFieldIndices: Seq[Int]) extends Product with Serializable

   

   Stores the indices of required and optional fields within the genotype element struct after resolution.

   Stores the indices of required and optional fields within the genotype element struct after resolution.

   size

   The number of fields in the struct

   requiredFieldIndices

   The indices of required fields. 0 <= idx < size.

   optionalFieldIndices

   The indices of optional fields. -1 if not the field is not present.

3. class HadoopLineIterator extends Iterator[Text] with Closeable with GlowLogging

   

   Identical to org.apache.spark.sql.execution.datasources.HadoopFileLinesReader, but takes the individual fields of org.apache.spark.sql.execution.datasources.PartitionedFile instead of the object itself.

   Identical to org.apache.spark.sql.execution.datasources.HadoopFileLinesReader, but takes the individual fields of org.apache.spark.sql.execution.datasources.PartitionedFile instead of the object itself. PartitionedFile objects cannot be instantiated in DBR because of a binary incompatible change vs OSS Spark.

4. class LeveneHaldane extends AbstractIntegerDistribution

   

   Implementation pulled from Hail

5. trait Rewrite extends Expression with Unevaluable

   

   Expressions that should be rewritten eagerly.

   Expressions that should be rewritten eagerly. The rewrite must be able to be performed without knowing the datatype or nullability of any of the children.

   In general, rewrite expressions should extend this trait unless they have a compelling reason to inspect their children.

6. trait RewriteAfterResolution extends Expression with Unevaluable

   

   Rewrites that depend on child expressions.

7. class RowConverter[T] extends AnyRef

   

   A convenience class to help convert from objects to Spark InternalRows.

8. class SerializableConfiguration extends Serializable

   

9. trait ComDatabricksDataSource extends DataSourceRegister

   

   Annotations

   @deprecated

   Deprecated

   Remove the prefix com.databricks.

10. trait ExpectsGenotypeFields extends Expression

    

    A trait to simplify type checking and reading for expressions that operate on arrays of genotype data with the expectation that certain fields exists.

    A trait to simplify type checking and reading for expressions that operate on arrays of genotype data with the expectation that certain fields exists.

    Note: This trait introduces complexity during resolution and analysis, and prevents nested column pruning. Prefer writing new functions as rewrites when possible.

    Annotations

    @deprecated

    Deprecated

    (Since version 0.4.1) Write functions as rewrites when possible