Class

com.stratio.crossdata.connector.mongodb

MongodbXDRelation

Related Doc: package mongodb

Permalink

case class MongodbXDRelation(config: Config, schemaProvided: Option[StructType] = None)(sqlContext: SQLContext) extends MongodbRelation with NativeScan with SparkLoggerComponent with Product with Serializable

A MongoDB baseRelation that can eliminate unneeded columns and filter using selected predicates before producing an RDD containing all matching tuples as Row objects.

config

A Deep configuration with needed properties for MongoDB

schemaProvided

The optionally provided schema. If not provided, it will be inferred from the whole field projection of the specified table in Spark SQL statement using a sample ratio (as JSON Data Source does).

sqlContext

An existing Spark SQL context.

Linear Supertypes
Serializable, Serializable, Product, Equals, SparkLoggerComponent, Logging, LoggerComponent, NativeScan, PushDownable, MongodbRelation, InsertableRelation, PrunedFilteredScan, BaseRelation, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. MongodbXDRelation
  2. Serializable
  3. Serializable
  4. Product
  5. Equals
  6. SparkLoggerComponent
  7. Logging
  8. LoggerComponent
  9. NativeScan
  10. PushDownable
  11. MongodbRelation
  12. InsertableRelation
  13. PrunedFilteredScan
  14. BaseRelation
  15. AnyRef
  16. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new MongodbXDRelation(config: Config, schemaProvided: Option[StructType] = None)(sqlContext: SQLContext)

    Permalink

    config

    A Deep configuration with needed properties for MongoDB

    schemaProvided

    The optionally provided schema. If not provided, it will be inferred from the whole field projection of the specified table in Spark SQL statement using a sample ratio (as JSON Data Source does).

    sqlContext

    An existing Spark SQL context.

Type Members

  1. trait Logger extends AnyRef

    Permalink
    Definition Classes
    LoggerComponent

  2. class SparkLogger extends common.utils.components.logger.impl.SparkLoggerComponent.Logger

    Permalink
    Definition Classes
    SparkLoggerComponent

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  4. implicit val _: Config

    Permalink
    Definition Classes
    MongodbRelation

  5. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any

  6. def buildScan(optimizedLogicalPlan: LogicalPlan): Option[Array[Row]]

    Permalink
    Definition Classes
    MongodbXDRelation → NativeScan

  7. def buildScan(requiredColumns: Array[String], filters: Array[Filter]): RDD[Row]

    Permalink
    Definition Classes
    MongodbRelation → PrunedFilteredScan

  8. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  9. val config: Config

    Permalink

    A Deep configuration with needed properties for MongoDB

  10. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  11. def equals(other: Any): Boolean

    Permalink
    Definition Classes
    MongodbRelation → AnyRef → Any

  12. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  13. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any

  14. def hashCode(): Int

    Permalink
    Definition Classes
    MongodbRelation → AnyRef → Any

  15. def insert(data: DataFrame, overwrite: Boolean): Unit

    Permalink
    Definition Classes
    MongodbRelation → InsertableRelation

  16. def isEmptyCollection: Boolean

    Permalink
    Definition Classes
    MongodbRelation

  17. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any

  18. def isSupported(logicalStep: LogicalPlan, wholeLogicalPlan: LogicalPlan): Boolean

    Permalink
    Definition Classes
    MongodbXDRelation → PushDownable

  19. def isTraceEnabled(): Boolean

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  20. def log: org.slf4j.Logger

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  21. def logDebug(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  22. def logDebug(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  23. def logError(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  24. def logError(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  25. def logInfo(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  26. def logInfo(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  27. def logName: String

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  28. def logTrace(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  29. def logTrace(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  30. def logWarning(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  31. def logWarning(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  32. val logger: Logger

    Permalink
    Definition Classes
    SparkLoggerComponent → LoggerComponent

  33. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  34. def needConversion: Boolean

    Permalink
    Definition Classes
    BaseRelation

  35. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef

  36. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef

  37. val schema: StructType

    Permalink
    Definition Classes
    MongodbRelation → BaseRelation

  38. val schemaProvided: Option[StructType]

    Permalink

    The optionally provided schema.

    The optionally provided schema. If not provided, it will be inferred from the whole field projection of the specified table in Spark SQL statement using a sample ratio (as JSON Data Source does).

  39. def sizeInBytes: Long

    Permalink
    Definition Classes
    BaseRelation

  40. val sqlContext: SQLContext

    Permalink

    An existing Spark SQL context.

    An existing Spark SQL context.

    Definition Classes
    MongodbRelation → BaseRelation

  41. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef

  42. def unhandledFilters(filters: Array[Filter]): Array[Filter]

    Permalink
    Definition Classes
    BaseRelation

  43. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  44. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  45. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from Serializable

Inherited from Serializable

Inherited from Product

Inherited from Equals

Inherited from SparkLoggerComponent

Inherited from Logging

Inherited from LoggerComponent

Inherited from NativeScan

Inherited from PushDownable

Inherited from MongodbRelation

Inherited from InsertableRelation

Inherited from PrunedFilteredScan

Inherited from BaseRelation

Inherited from AnyRef

Inherited from Any

Ungrouped