loaders

final case class CollectorApi(vendor: String, version: String) extends Product with Serializable

Define the vendor and version of the payload.
final case class CollectorContext(timestamp: Option[DateTime], ipAddress: Option[String], useragent: Option[String], refererUri: Option[String], headers: List[String], userId: Option[String]) extends Product with Serializable

Context derived by the collector.
final case class CollectorPayload(api: CollectorApi, querystring: List[NameValuePair], contentType: Option[String], body: Option[String], source: CollectorSource, context: CollectorContext) extends Product with Serializable

The canonical input format for the ETL process: it should be possible to convert any collector input format to this format, ready for the main, collector-agnostic stage of the ETL.
final case class CollectorSource(name: String, encoding: String, hostname: Option[String]) extends Product with Serializable

Unambiguously identifies the collector source of this input line.
abstract class Loader[T] extends AnyRef

All loaders must implement this abstract base class.
case class NdjsonLoader(adapter: String) extends Loader[String] with Product with Serializable
case class TsvLoader(adapter: String) extends Loader[String] with Product with Serializable

Loader for TSVs

object CljTomcatLoader extends Loader[String]

The dedicated loader for events collected by the Clojure Collector running on Tomcat.
The dedicated loader for events collected by the Clojure Collector running on Tomcat. The format started as an approximation of the CloudFront format, but has now diverged as we add support for POST payloads.
object CloudfrontLoader extends Loader[String]

The dedicated loader for events collected by CloudFront.
The dedicated loader for events collected by CloudFront.
We support the following CloudFront access log formats:
1. Pre-12 Sep 2012 2. 12 Sep 2012 - 21 Oct 2013 3. 21 Oct 2013 - 29 Apr 2014 4. Potential future updates, provided they are solely additive in nature
For more details on this format, please see: http://docs.amazonwebservices.com/AmazonCloudFront/latest/DeveloperGuide/AccessLogs.html#LogFileFormat
object CollectorApi extends Serializable
object CollectorPayload extends Serializable
object IpAddressExtractor

Gets the true IP address events forwarded to the Scala Stream Collector.
Gets the true IP address events forwarded to the Scala Stream Collector. See https://github.com/snowplow/snowplow/issues/1372
object Loader

Companion object to the CollectorLoader.
Companion object to the CollectorLoader. Contains factory methods.
object ThriftLoader extends Loader[Array[Byte]]

Loader for Thrift SnowplowRawEvent objects.