SphereRDDFromFITS

Instance Constructors

new SphereRDDFromFITS(spark: SparkSession, filename: String, hdu: Int, colnames: String, isSpherical: Boolean = false)

spark
: (SparkSession) The spark session
filename
: (String) File name where the data is stored
hdu
: (Int) HDU to load.
colnames
: (String) Comma-separated names of (x, y, z, r) columns. Example: "Z_COSMO,RA,Dec,Radius".
isSpherical
: (Boolean) If true, it assumes that the coordinates of the center of the ShellEnvelope are (r, theta, phi). Otherwise, it assumes cartesian coordinates (x, y, z). Default is false.

Value Members

final def !=(arg0: Any): Boolean

Definition Classes
AnyRef → Any
final def ##(): Int

Definition Classes
AnyRef → Any
final def ==(arg0: Any): Boolean

Definition Classes
AnyRef → Any
final def asInstanceOf[T0]: T0

Definition Classes
Any
var boundary: BoxEnvelope

Definition Classes
Shape3DRDD
def clone(): AnyRef

Attributes
protected[java.lang]
Definition Classes
AnyRef
Annotations
@throws( ... )
val csplit: Array[String]
val df: DataFrame
final def eq(arg0: AnyRef): Boolean

Definition Classes
AnyRef
def equals(arg0: Any): Boolean

Definition Classes
AnyRef → Any
def finalize(): Unit

Attributes
protected[java.lang]
Definition Classes
AnyRef
Annotations
@throws( classOf[java.lang.Throwable] )
final def getClass(): Class[_]

Definition Classes
AnyRef → Any
def getDataEnvelope(): BoxEnvelope

Definition Classes
Shape3DRDD
def hashCode(): Int

Definition Classes
AnyRef → Any
final def isInstanceOf[T0]: Boolean

Definition Classes
Any
val isSpherical: Boolean

: (Boolean) If true, it assumes that the coordinates of the center of the ShellEnvelope are (r, theta, phi).
: (Boolean) If true, it assumes that the coordinates of the center of the ShellEnvelope are (r, theta, phi). Otherwise, it assumes cartesian coordinates (x, y, z). Default is false.

Definition Classes
SphereRDDFromFITS → Shape3DRDD
final def ne(arg0: AnyRef): Boolean

Definition Classes
AnyRef
final def notify(): Unit

Definition Classes
AnyRef
final def notifyAll(): Unit

Definition Classes
AnyRef
def partition(partitioner: SpatialPartitioner)(implicit c: ClassTag[ShellEnvelope]): RDD[ShellEnvelope]

Repartion a RDD[T] according to a custom partitioner.
Repartion a RDD[T] according to a custom partitioner.
partitioner
: (SpatialPartitioner) Instance of SpatialPartitioner or any extension of it.
returns
(RDD[T]) Repartitioned RDD[T].

Definition Classes
Shape3DRDD
val rawRDD: RDD[ShellEnvelope]

RDD containing the initial data formated as T.
RDD containing the initial data formated as T.

Definition Classes
SphereRDDFromFITS → Shape3DRDD
def spatialPartitioning(gridtype: GridType, numPartitions: Int = 1)(implicit c: ClassTag[ShellEnvelope]): RDD[ShellEnvelope]

Apply a spatial partitioning to this.rawRDD, and return a RDD[T] with the new partitioning.
Apply a spatial partitioning to this.rawRDD, and return a RDD[T] with the new partitioning. The list of available partitioning can be found in utils/GridType. By default, the outgoing level of parallelism is the same as the incoming one (i.e. same number of partitions).
gridtype
: (GridType) Type of partitioning to apply. See utils/GridType.
numPartitions
: (Int) Number of partitions for the partitioned RDD. By default (-1), the number of partitions is that of the raw RDD. You can force it to be different by setting manually this parameter. Be aware of shuffling though...
returns
(RDD[T]) RDD whose elements are T (Point3D, Sphere, etc...)

Definition Classes
Shape3DRDD
def spatialPartitioning(partitioner: SpatialPartitioner)(implicit c: ClassTag[ShellEnvelope]): RDD[ShellEnvelope]

Apply any Spatial Partitioner to this.rawRDD[T], and return a RDD[T] with the new partitioning.
Apply any Spatial Partitioner to this.rawRDD[T], and return a RDD[T] with the new partitioning.
partitioner
: (SpatialPartitioner) Spatial partitioner as defined in utils.GridType
returns
(RDD[T]) RDD whose elements are T (Point3D, Sphere, etc...)

Definition Classes
Shape3DRDD
final def synchronized[T0](arg0: ⇒ T0): T0

Definition Classes
AnyRef
def toString(): String

Definition Classes
AnyRef → Any
final def wait(): Unit

Definition Classes
AnyRef
Annotations
@throws( ... )
final def wait(arg0: Long, arg1: Int): Unit

Definition Classes
AnyRef
Annotations
@throws( ... )
final def wait(arg0: Long): Unit

Definition Classes
AnyRef
Annotations
@throws( ... )

Related Doc: package spatial3DRDD

class SphereRDDFromFITS extends Shape3DRDD[ShellEnvelope]

Instance Constructors

new SphereRDDFromFITS(spark: SparkSession, filename: String, hdu: Int, colnames: String, isSpherical: Boolean = false)

Value Members

final def !=(arg0: Any): Boolean

final def ##(): Int

final def ==(arg0: Any): Boolean

final def asInstanceOf[T0]: T0

var boundary: BoxEnvelope

def clone(): AnyRef

val csplit: Array[String]

val df: DataFrame

final def eq(arg0: AnyRef): Boolean

def equals(arg0: Any): Boolean

def finalize(): Unit

final def getClass(): Class[_]

def getDataEnvelope(): BoxEnvelope

def hashCode(): Int

final def isInstanceOf[T0]: Boolean

val isSpherical: Boolean

final def ne(arg0: AnyRef): Boolean

final def notify(): Unit

final def notifyAll(): Unit

def partition(partitioner: SpatialPartitioner)(implicit c: ClassTag[ShellEnvelope]): RDD[ShellEnvelope]

val rawRDD: RDD[ShellEnvelope]

def spatialPartitioning(gridtype: GridType, numPartitions: Int = 1)(implicit c: ClassTag[ShellEnvelope]): RDD[ShellEnvelope]

def spatialPartitioning(partitioner: SpatialPartitioner)(implicit c: ClassTag[ShellEnvelope]): RDD[ShellEnvelope]

final def synchronized[T0](arg0: ⇒ T0): T0

def toString(): String

final def wait(): Unit

final def wait(arg0: Long, arg1: Int): Unit

final def wait(arg0: Long): Unit

Inherited from Shape3DRDD[ShellEnvelope]

Inherited from Serializable

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped