Spark Project Core 1.4.0 API

SHUFFLE_DATA

SHUFFLE_INDEX

SPARK_VERSION

SPARK_YARN_CREDS_COUNTER_DELIM

SparkHadoopUtil

SPARK_YARN_CREDS_TEMP_EXTENSION

SparkHadoopUtil

STREAM

SchedulingMode

scheduler SchedulingMode

SequenceFileRDDFunctions

rdd

SerializableWritable

SerializationStream

Serializer

SerializerInstance

ShuffleBlockId

ShuffleDataBlockId

ShuffleDependency

ShuffleHandle

ShuffleIndexBlockId

ShuffleReadMetricDistributions

v1

ShuffleReadMetrics

executor v1

ShuffleWriteMetricDistributions

v1

ShuffleWriteMetrics

executor v1

ShuffledRDD

rdd

SimpleFutureAction

SizeEstimator

util

SnappyCompressionCodec

io

SparkConf

SparkContext

SparkEnv

SparkException

SparkFiles

SparkFirehoseListener

SparkHadoopMapRedUtil

SparkHadoopUtil

SparkJobInfo

SparkListener

SparkListenerApplicationEnd

SparkListenerApplicationStart

SparkListenerBlockManagerAdded

SparkListenerBlockManagerRemoved

SparkListenerEnvironmentUpdate

SparkListenerEvent

SparkListenerExecutorAdded

SparkListenerExecutorMetricsUpdate

SparkListenerExecutorRemoved

SparkListenerJobEnd

SparkListenerJobStart

SparkListenerStageCompleted

SparkListenerStageSubmitted

SparkListenerTaskEnd

SparkListenerTaskGettingResult

SparkListenerTaskStart

SparkListenerUnpersistRDD

SparkStageInfo

SparkStatusTracker

SparkSubmit

SparkTransportConf

SplitInfo

StageAttemptId

StageData

v1

StageId

StageInfo

StageStatus

v1

StandaloneRecoveryModeFactory

StatCounter

StatsReportListener

StorageLevel

StorageLevels

StorageListener

StorageStatus

StorageStatusListener

storage

StreamBlockId

storage

Success

JavaDoubleRDD JavaPairRDD JavaRDD RDD BernoulliCellSampler BernoulliSampler PoissonSampler RandomSampler

sample

sampleByKey

sampleByKeyExact

JavaDoubleRDD DoubleRDDFunctions StatCounter

sampleStdev

sampleVariance

JavaDoubleRDD DoubleRDDFunctions StatCounter

saveAsHadoopDataset

saveAsHadoopFile

saveAsNewAPIHadoopDataset

saveAsNewAPIHadoopFile

saveAsObjectFile

JavaRDDLike RDD

saveAsSequenceFile

SequenceFileRDDFunctions

saveAsTextFile

sc

scheduler

schedulingMode

schedulingPool

scope

securityManager

sequenceFile

ShuffleDependency SparkEnv spark

serialize

SerializerInstance

serializeStream

SerializerInstance

serializer

set

SparkConf SparkEnv BitSet

setAggregator

setAll

setAppName

setBytesReadCallback

setCallSite

setCheckpointDir

setDefaultClassLoader

setDouble

setExecutorEnv

setIfMissing

setInt

setJars

setJobDescription

setJobGroup

setKeyOrdering

ShuffledRDD

setLocalProperty

setLogLevel

BernoulliCellSampler BernoulliSampler PoissonSampler Pseudorandom

setMapSideCombine

ShuffledRDD

setMaster

SparkConf

setName

JavaDoubleRDD JavaPairRDD JavaRDD RDD

setSeed

setSerializer

CoGroupedRDD ShuffledRDD

setSparkHome

setStr

setTaskContext

setUntil

setValue

shuffle

shuffleBytesWritten

shuffleHandle

shuffleId

FetchFailed ShuffleDependency ShuffleHandle ShuffleBlockId ShuffleDataBlockId ShuffleIndexBlockId

shuffleManager

shuffleMemoryManager

shuffleRead

shuffleReadBytes

shuffleReadMetrics

TaskMetrics TaskMetricDistributions TaskMetrics

shuffleReadRecords

StageData

shuffleRecordsWritten

ShuffleWriteMetrics

shuffleWrite

ExecutorStageSummary

shuffleWriteBytes

StageData

shuffleWriteMetrics

TaskMetrics TaskMetricDistributions TaskMetrics

shuffleWriteRecords

shuffleWriteTime

size

skippedStages

sortBy

sortByKey

JavaPairRDD OrderedRDDFunctions

spark

apache

sparkContext

RDD

sparkFilesDir

SparkEnv

sparkProperties

EnvironmentListener

sparkUser

SparkContext JavaSparkContext SparkListenerApplicationStart ApplicationAttemptInfo

speculative

TaskInfo TaskData

spill

ExternalAppendOnlyMap

splitIndex

RDDBlockId

~~splits~~

~~JavaRDDLike~~

squaredDist

Vector

srdd

JavaDoubleRDD

stackTrace

ExceptionFailure

stageAttemptId

SparkListenerTaskEnd SparkListenerTaskStart

stageFailed

StageInfo

stageId

SparkStageInfo TaskContext SparkListenerTaskEnd SparkListenerTaskStart StageInfo StageData

stageIdToActiveJobIds

stageIdToData

stageIdToInfo

SparkJobInfo SparkListenerJobStart JobData

stageIds

stageInfo

SparkListenerStageCompleted SparkListenerStageSubmitted

stageInfos

SparkListenerJobStart

stageLogInfo

JobLogger

startTime

SparkContext JavaSparkContext ApplicationAttemptInfo JobProgressListener

stats

JavaDoubleRDD DoubleRDDFunctions

status

SparkJobInfo TaskInfo spark JobData StageData

statusTracker

JavaDoubleRDD DoubleRDDFunctions StatCounter

stdev

stop

SparkContext JavaSparkContext BroadcastFactory HttpBroadcastFactory TorrentBroadcastFactory HistoryServer LeaderElectionAgent UnsafeShuffleWriter

storage

spark ui

storageLevel

RDDPartitionInfo RDDStorageInfo BlockStatus RDDInfo

storageStatusList

StorageStatusListener ExecutorsListener StorageListener

str

TestWritable

streamId

StreamBlockId

~~stringToText~~

~~SparkContext~~

stringWritableConverter

~~SparkContext~~ WritableConverter

stringWritableFactory

WritableFactory

submissionTime

SparkStageInfo StageInfo JobData

submitJob

SparkContext

substituteHadoopVariables

SparkHadoopUtil

subtract

JavaDoubleRDD JavaPairRDD JavaRDD RDD Vector

subtractByKey