etlflow-gcp
API
Generated with
etlflow-gcp/etlflow/etlflow.task/DPSparkJobTask

DPSparkJobTask

etlflow.task.DPSparkJobTask
See theDPSparkJobTask companion object
case class DPSparkJobTask(name: String, args: List[String], mainClass: String, libs: List[String], conf: Map[String, String]) extends EtlTask[DPJob, Job]

Attributes

Companion
object
Graph
Supertypes
trait Serializable
trait EtlTask[DPJob, Job]
trait ApplicationLogger
trait Product
trait Equals
class Object
trait Matchable
class Any
Show all

Members list

Value members

Inherited methods

def productElementNames: Iterator[String]

Attributes

Inherited from:
Product
def productIterator: Iterator[Any]

Attributes

Inherited from:
Product
final def toZIO: RIO[R & Audit, OP]

Convert the EtlTask to a ZIO effect, tracking the execution progress using the etlflow.audit.Audit API's task start and task end methods.

Convert the EtlTask to a ZIO effect, tracking the execution progress using the etlflow.audit.Audit API's task start and task end methods.

Attributes

Returns

The ZIO effect representing the task execution with audit logging.

Inherited from:
EtlTask

Concrete fields

override val metadata: Map[String, String]

Metadata associated with the task (A map of metadata key-value pairs)

Metadata associated with the task (A map of metadata key-value pairs)

Attributes

Inherited fields

lazy protected val logger: Logger

The logger instance used for logging within the application.

The logger instance used for logging within the application.

Attributes

Inherited from:
ApplicationLogger
val taskType: String

The task type.

The task type.

Attributes

Inherited from:
EtlTask
protected val zioSlf4jLogger: ULayer[Unit]

The ZIO logging layer for SLF4J backend.

The ZIO logging layer for SLF4J backend.

Attributes

Inherited from:
ApplicationLogger
Generated with