Spark Project Core 2.1.1 API

SparkListenerApplicationStart

SparkListenerBlockManagerAdded

SparkListenerBlockManagerRemoved

SparkListenerBlockUpdated

SparkListenerEnvironmentUpdate

SparkListenerEvent

SparkListenerExecutorAdded

SparkListenerExecutorMetricsUpdate

SparkListenerExecutorRemoved

SparkListenerJobEnd

SparkListenerJobStart

SparkListenerStageCompleted

SparkListenerStageSubmitted

SparkListenerTaskEnd

SparkListenerTaskGettingResult

SparkListenerTaskStart

SparkListenerUnpersistRDD

SparkStageInfo

SparkStatusTracker

SparkSubmit

SparkTransportConf

SplitInfo

StageAttemptId

StageData

v1

StageId

StageInfo

JavaDoubleRDD JavaPairRDD JavaRDD RDD BernoulliCellSampler BernoulliSampler PoissonSampler RandomSampler

StageStatus

v1

StandaloneRecoveryModeFactory

StatCounter

StatsReportListener

StorageLevel

StorageLevels

StorageListener

StorageStatus

StorageStatusListener

StreamBlockId

Success

safeLookup

sample

sampleByKey

sampleByKeyExact

JavaDoubleRDD DoubleRDDFunctions StatCounter

sampleStdev

sampleVariance

JavaDoubleRDD DoubleRDDFunctions StatCounter

saveAsHadoopDataset

saveAsHadoopFile

saveAsNewAPIHadoopDataset

saveAsNewAPIHadoopFile

saveAsObjectFile

JavaRDDLike RDD

saveAsSequenceFile

SequenceFileRDDFunctions

saveAsTextFile

sc

scheduler

schedulingMode

schedulingPool

scope

security

securityManager

sequenceFile

DummySerializerInstance SerializerInstance

serialize

serializeStream

DummySerializerInstance SerializerInstance

serializer

ShuffleDependency SparkEnv spark

serializerManager

SparkEnv

set

SparkConf SparkEnv BitSet

setAggregator

ShuffledRDD

setAll

SparkConf

setAppName

SparkConf

setCallSite

setCheckpointDir

setDefaultClassLoader

setDouble

setExecutorEnv

setIfMissing

setInt

setJars

setJobDescription

setJobGroup

setKeyOrdering

ShuffledRDD

setLocalProperty

setLogLevel

BernoulliCellSampler BernoulliSampler PoissonSampler Pseudorandom

setMapSideCombine

ShuffledRDD

setMaster

SparkConf

setName

JavaDoubleRDD JavaPairRDD JavaRDD RDD

setSeed

setSerializer

CoGroupedRDD ShuffledRDD

setSparkHome

setStr

setTaskContext

setUntil

setValue

setupCommitter

HadoopMapReduceCommitProtocol

setupJob

FileCommitProtocol HadoopMapReduceCommitProtocol

setupTask

FileCommitProtocol HadoopMapReduceCommitProtocol

showMemoryUsage

TaskMemoryManager

shuffle

spark

~~shuffleBytesWritten~~

~~ShuffleWriteMetrics~~

shuffleHandle

ShuffleDependency

shuffleId

FetchFailed ShuffleDependency ShuffleHandle ShuffleBlockId ShuffleDataBlockId ShuffleIndexBlockId

shuffleManager

SparkEnv

shuffleRead

ExecutorStageSummary

shuffleReadBytes

TaskMetrics TaskMetricDistributions TaskMetrics

shuffleReadMetrics

shuffleReadRecords

~~shuffleRecordsWritten~~

~~ShuffleWriteMetrics~~

shuffleWrite

ExecutorStageSummary

shuffleWriteBytes

TaskMetrics TaskMetricDistributions TaskMetrics

shuffleWriteMetrics

shuffleWriteRecords

AppendOnlyMap OpenHashSet

~~shuffleWriteTime~~

~~ShuffleWriteMetrics~~

size

skip

LZ4BlockInputStream NioBufferedFileInputStream

skippedStages

JavaPairRDD OrderedRDDFunctions

sort

shuffle unsafe

sortBy

JavaRDD RDD

sortByKey

source

metrics

sourceName

CodegenMetrics HiveCatalogMetrics

spark

apache VersionInfo

sparkContext

RDD

sparkProperties

EnvironmentListener

sparkUser

SparkContext JavaSparkContext SparkListenerApplicationStart ApplicationAttemptInfo

speculative

TaskInfo TaskData

spill

MemoryConsumer BytesToBytesMap MapIterator ExternalAppendOnlyMap UnsafeExternalSorter

splitIndex

RDDBlockId

srdd

JavaDoubleRDD

stackTrace

ExceptionFailure

stageAttemptId

SparkListenerTaskEnd SparkListenerTaskStart

stageFailed

StageInfo

stageId

SparkStageInfo TaskContext SparkListenerTaskEnd SparkListenerTaskStart StageInfo StageData

stageIdToActiveJobIds

stageIdToData

stageIdToInfo

SparkJobInfo SparkListenerJobStart JobData

stageIds

stageInfo

SparkListenerStageCompleted SparkListenerStageSubmitted

stageInfos

SparkListenerJobStart

startTime

SparkContext JavaSparkContext ApplicationAttemptInfo JobProgressListener

stats

JavaDoubleRDD DoubleRDDFunctions

status

SparkJobInfo TaskInfo spark JobData StageData

statusTracker

JavaDoubleRDD DoubleRDDFunctions StatCounter

stdev

stop

SparkContext JavaSparkContext HistoryServer LeaderElectionAgent UnsafeShuffleWriter

storage

spark ui

storageLevel

RDDPartitionInfo RDDStorageInfo BlockStatus BlockUpdatedInfo RDDInfo

storageStatusList

StorageStatusListener

str

TestWritable

streamId

StreamBlockId

stringWritableConverter

WritableConverter

stringWritableFactory

WritableFactory

submissionTime

SparkStageInfo StageInfo JobData StageData

submitJob

JobSubmitter SparkContext

substituteHadoopVariables

SparkHadoopUtil

subtract

JavaDoubleRDD JavaPairRDD JavaRDD RDD

subtractByKey