Class DataFrameSparkProducer

  • All Implemented Interfaces:
    AutoCloseable, org.apache.camel.EndpointAware, org.apache.camel.IsSingleton, org.apache.camel.Processor, org.apache.camel.Producer, org.apache.camel.Service, org.apache.camel.ShutdownableService, org.apache.camel.StatefulService, org.apache.camel.SuspendableService

    public class DataFrameSparkProducer
    extends org.apache.camel.support.DefaultProducer
    • Field Summary

      • Fields inherited from class org.apache.camel.support.service.BaseService

        BUILT, FAILED, INITIALIZED, INITIALIZING, lock, NEW, SHUTDOWN, SHUTTING_DOWN, STARTED, STARTING, status, STOPPED, STOPPING, SUSPENDED, SUSPENDING
    • Method Summary

      All Methods Instance Methods Concrete Methods 
      Modifier and Type Method Description
      protected void collectResults​(org.apache.camel.Exchange exchange, Object result)  
      SparkEndpoint getEndpoint()  
      void process​(org.apache.camel.Exchange exchange)  
      protected org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> resolveDataFrame​(org.apache.camel.Exchange exchange)  
      protected DataFrameCallback resolveDataFrameCallback​(org.apache.camel.Exchange exchange)  
      • Methods inherited from class org.apache.camel.support.DefaultProducer

        createExchange, doStart, doStop, isSingleton, toString
      • Methods inherited from class org.apache.camel.support.service.BaseService

        build, doBuild, doFail, doInit, doLifecycleChange, doResume, doShutdown, doSuspend, fail, getStatus, init, isBuild, isInit, isNew, isRunAllowed, isShutdown, isStarted, isStarting, isStartingOrStarted, isStopped, isStopping, isStoppingOrStopped, isSuspended, isSuspending, isSuspendingOrSuspended, resume, shutdown, start, stop, suspend
      • Methods inherited from interface org.apache.camel.Service

        build, close, init, start, stop
      • Methods inherited from interface org.apache.camel.ShutdownableService

        shutdown
      • Methods inherited from interface org.apache.camel.StatefulService

        getStatus, isRunAllowed, isStarted, isStarting, isStopped, isStopping, isSuspending
      • Methods inherited from interface org.apache.camel.SuspendableService

        isSuspended, resume, suspend
    • Constructor Detail

      • DataFrameSparkProducer

        public DataFrameSparkProducer​(SparkEndpoint endpoint)
    • Method Detail

      • process

        public void process​(org.apache.camel.Exchange exchange)
                     throws Exception
        Throws:
        Exception
      • getEndpoint

        public SparkEndpoint getEndpoint()
        Specified by:
        getEndpoint in interface org.apache.camel.EndpointAware
        Overrides:
        getEndpoint in class org.apache.camel.support.DefaultProducer
      • collectResults

        protected void collectResults​(org.apache.camel.Exchange exchange,
                                      Object result)
      • resolveDataFrame

        protected org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> resolveDataFrame​(org.apache.camel.Exchange exchange)
      • resolveDataFrameCallback

        protected DataFrameCallback resolveDataFrameCallback​(org.apache.camel.Exchange exchange)