| Package | Description |
|---|---|
| io.cdap.cdap.api.mapreduce |
Defines MapReduce jobs.
|
| io.cdap.cdap.api.service |
Defines ServiceSpecification.
|
| io.cdap.cdap.api.spark |
Defines APIs for defining Spark jobs in CDAP.
|
| io.cdap.cdap.api.worker |
Configuration and specification of workers in CDAP.
|
| Modifier and Type | Method and Description |
|---|---|
Resources |
MapReduceSpecification.getDriverResources() |
Resources |
MapReduceSpecification.getMapperResources() |
Resources |
MapReduceSpecification.getReducerResources() |
| Modifier and Type | Method and Description |
|---|---|
protected void |
AbstractMapReduce.setDriverResources(Resources resources)
Sets the resources requirement for the driver of the
MapReduce. |
void |
MapReduceConfigurer.setDriverResources(Resources resources)
Sets the resources requirement for the driver of the MapReduce.
|
protected void |
AbstractMapReduce.setMapperResources(Resources resources)
Sets the resources requirement for Mapper task of the
MapReduce. |
void |
MapReduceConfigurer.setMapperResources(Resources resources)
Sets the resources requirement for Mapper task of the
MapReduce. |
void |
MapReduceContext.setMapperResources(Resources resources)
Overrides the resources, such as memory and virtual cores, to use for each mapper of this MapReduce job.
|
protected void |
AbstractMapReduce.setReducerResources(Resources resources)
Sets the resources requirement for Reducer task of the
MapReduce. |
void |
MapReduceConfigurer.setReducerResources(Resources resources)
Sets the resources requirement for Reducer task of the
MapReduce. |
void |
MapReduceContext.setReducerResources(Resources resources)
Override the resources, such as memory and virtual cores, to use for each reducer of this MapReduce job.
|
| Constructor and Description |
|---|
MapReduceSpecification(String className,
String name,
String description,
String inputDataSet,
String outputDataSet,
Set<String> dataSets,
Map<String,String> properties,
Resources driverResources,
Resources mapperResources,
Resources reducerResources,
Map<String,Plugin> plugins) |
| Modifier and Type | Method and Description |
|---|---|
Resources |
ServiceSpecification.getResources()
Returns the resources requirements for the service handler.
|
| Modifier and Type | Method and Description |
|---|---|
void |
ServiceConfigurer.setResources(Resources resources)
Sets the resources requirements for the server that runs all
HttpServiceHandlers of this Service. |
protected void |
AbstractService.setResources(Resources resources)
Sets the resources requirements for the server that runs all
HttpServiceHandlers of this Service. |
| Constructor and Description |
|---|
ServiceSpecification(String className,
String name,
String description,
Map<String,HttpServiceHandlerSpecification> handlers,
Resources resources,
int instances,
Map<String,Plugin> plugins) |
ServiceSpecification(String className,
String name,
String description,
Map<String,HttpServiceHandlerSpecification> handlers,
Resources resources,
int instances,
Map<String,Plugin> plugins,
Map<String,String> properties) |
| Modifier and Type | Method and Description |
|---|---|
Resources |
SparkSpecification.getClientResources() |
Resources |
SparkSpecification.getDriverResources() |
Resources |
SparkSpecification.getExecutorResources() |
| Modifier and Type | Method and Description |
|---|---|
void |
SparkConfigurer.setClientResources(Resources resources)
Sets the resources requirement for the Spark client process.
|
protected void |
AbstractSpark.setClientResources(Resources resources)
Sets the resources requirement for the Spark client process.
|
void |
SparkConfigurer.setDriverResources(Resources resources)
Sets the resources requirement for the Spark driver process.
|
void |
SparkClientContext.setDriverResources(Resources resources)
Sets the resources requirement for the Spark driver process.
|
protected void |
AbstractSpark.setDriverResources(Resources resources)
Sets the resources requirement for the Spark driver process.
|
void |
SparkConfigurer.setExecutorResources(Resources resources)
Sets the resources requirement for the Spark executor processes.
|
void |
SparkClientContext.setExecutorResources(Resources resources)
Sets the resources, such as memory and virtual cores, to use for each executor process for the Spark program.
|
protected void |
AbstractSpark.setExecutorResources(Resources resources)
Sets the resources requirement for the Spark executor processes.
|
| Constructor and Description |
|---|
SparkSpecification(String className,
String name,
String description,
String mainClassName,
Set<String> datasets,
Map<String,String> properties,
Resources clientResources,
Resources driverResources,
Resources executorResources,
List<SparkHttpServiceHandlerSpecification> handlers,
Map<String,Plugin> plugins) |
| Modifier and Type | Method and Description |
|---|---|
Resources |
WorkerSpecification.getResources() |
| Modifier and Type | Method and Description |
|---|---|
protected void |
AbstractWorker.setResources(Resources resources)
Sets the resources requirements for the
Worker. |
void |
WorkerConfigurer.setResources(Resources resources)
Sets the resources requirements for the the
Worker. |
| Constructor and Description |
|---|
WorkerSpecification(String className,
String name,
String description,
Map<String,String> properties,
Set<String> datasets,
Resources resources,
int instances,
Map<String,Plugin> plugins) |
Copyright © 2022 Cask Data, Inc. Licensed under the Apache License, Version 2.0.