BQSensorTask
etlflow.task.BQSensorTask
case class BQSensorTask(name: String, query: String, sensor: Iterable[FieldValueList] => Boolean, spaced: Duration, retry: Option[Int]) extends EtlTask[BQ, Unit]
BQ Sensor on SQL query based on output rows satisfying condition defined by sensor function
Attributes
- name
Task name
- query
BigQuery SQL query
- retry
Number of times we need to check query the BQ table before this effect terminates
- sensor
Function which takes Iterable[FieldValueList] and return bool, which on returning true exits the poll
- spaced
Specifies duration each repetition should be spaced from the last run
- Graph
- Supertypes
- trait Serializabletrait Producttrait Equalstrait EtlTask[BQ, Unit]trait ApplicationLoggerclass Objecttrait Matchableclass Any