Interface SparkEndpointBuilderFactory.SparkEndpointBuilder

  • All Superinterfaces:
    org.apache.camel.builder.EndpointProducerBuilder, org.apache.camel.EndpointProducerResolver
    Enclosing interface:
    SparkEndpointBuilderFactory

    public static interface SparkEndpointBuilderFactory.SparkEndpointBuilder
    extends org.apache.camel.builder.EndpointProducerBuilder
    Builder for endpoint for the Spark component.
    • Method Detail

      • collect

        default SparkEndpointBuilderFactory.SparkEndpointBuilder collect​(boolean collect)
        Indicates if results should be collected or counted. The option is a: <code>boolean</code> type. Default: true Group: producer
        Parameters:
        collect - the value to set
        Returns:
        the dsl builder
      • collect

        default SparkEndpointBuilderFactory.SparkEndpointBuilder collect​(String collect)
        Indicates if results should be collected or counted. The option will be converted to a <code>boolean</code> type. Default: true Group: producer
        Parameters:
        collect - the value to set
        Returns:
        the dsl builder
      • dataFrame

        default SparkEndpointBuilderFactory.SparkEndpointBuilder dataFrame​(Object dataFrame)
        DataFrame to compute against. The option is a: <code>org.apache.spark.sql.Dataset&lt;org.apache.spark.sql.Row&gt;</code> type. Group: producer
        Parameters:
        dataFrame - the value to set
        Returns:
        the dsl builder
      • dataFrame

        default SparkEndpointBuilderFactory.SparkEndpointBuilder dataFrame​(String dataFrame)
        DataFrame to compute against. The option will be converted to a <code>org.apache.spark.sql.Dataset&lt;org.apache.spark.sql.Row&gt;</code> type. Group: producer
        Parameters:
        dataFrame - the value to set
        Returns:
        the dsl builder
      • dataFrameCallback

        default SparkEndpointBuilderFactory.SparkEndpointBuilder dataFrameCallback​(Object dataFrameCallback)
        Function performing action against an DataFrame. The option is a: <code>org.apache.camel.component.spark.DataFrameCallback</code> type. Group: producer
        Parameters:
        dataFrameCallback - the value to set
        Returns:
        the dsl builder
      • dataFrameCallback

        default SparkEndpointBuilderFactory.SparkEndpointBuilder dataFrameCallback​(String dataFrameCallback)
        Function performing action against an DataFrame. The option will be converted to a <code>org.apache.camel.component.spark.DataFrameCallback</code> type. Group: producer
        Parameters:
        dataFrameCallback - the value to set
        Returns:
        the dsl builder
      • lazyStartProducer

        default SparkEndpointBuilderFactory.SparkEndpointBuilder lazyStartProducer​(boolean lazyStartProducer)
        Whether the producer should be started lazy (on the first message). By starting lazy you can use this to allow CamelContext and routes to startup in situations where a producer may otherwise fail during starting and cause the route to fail being started. By deferring this startup to be lazy then the startup failure can be handled during routing messages via Camel's routing error handlers. Beware that when the first message is processed then creating and starting the producer may take a little time and prolong the total processing time of the processing. The option is a: <code>boolean</code> type. Default: false Group: producer
        Parameters:
        lazyStartProducer - the value to set
        Returns:
        the dsl builder
      • lazyStartProducer

        default SparkEndpointBuilderFactory.SparkEndpointBuilder lazyStartProducer​(String lazyStartProducer)
        Whether the producer should be started lazy (on the first message). By starting lazy you can use this to allow CamelContext and routes to startup in situations where a producer may otherwise fail during starting and cause the route to fail being started. By deferring this startup to be lazy then the startup failure can be handled during routing messages via Camel's routing error handlers. Beware that when the first message is processed then creating and starting the producer may take a little time and prolong the total processing time of the processing. The option will be converted to a <code>boolean</code> type. Default: false Group: producer
        Parameters:
        lazyStartProducer - the value to set
        Returns:
        the dsl builder
      • rdd

        default SparkEndpointBuilderFactory.SparkEndpointBuilder rdd​(String rdd)
        RDD to compute against. The option will be converted to a <code>org.apache.spark.api.java.JavaRDDLike</code> type. Group: producer
        Parameters:
        rdd - the value to set
        Returns:
        the dsl builder
      • rddCallback

        default SparkEndpointBuilderFactory.SparkEndpointBuilder rddCallback​(Object rddCallback)
        Function performing action against an RDD. The option is a: <code>org.apache.camel.component.spark.RddCallback</code> type. Group: producer
        Parameters:
        rddCallback - the value to set
        Returns:
        the dsl builder
      • rddCallback

        default SparkEndpointBuilderFactory.SparkEndpointBuilder rddCallback​(String rddCallback)
        Function performing action against an RDD. The option will be converted to a <code>org.apache.camel.component.spark.RddCallback</code> type. Group: producer
        Parameters:
        rddCallback - the value to set
        Returns:
        the dsl builder