Package software.amazon.awssdk.services.glue.model

Interface SparkSQL.Builder

    • Method Detail

      • name

        SparkSQL.Builder name​(String name)

        The name of the transform node.

        Parameters:
        name - The name of the transform node.
        Returns:
        Returns a reference to this object so that method calls can be chained together.

      • inputs

        SparkSQL.Builder inputs​(Collection<String> inputs)

        The data inputs identified by their node names. You can associate a table name with each input node to use in the SQL query. The name you choose must meet the Spark SQL naming restrictions.

        Parameters:
        inputs - The data inputs identified by their node names. You can associate a table name with each input node to use in the SQL query. The name you choose must meet the Spark SQL naming restrictions.
        Returns:
        Returns a reference to this object so that method calls can be chained together.

      • inputs

        SparkSQL.Builder inputs​(String... inputs)

        The data inputs identified by their node names. You can associate a table name with each input node to use in the SQL query. The name you choose must meet the Spark SQL naming restrictions.

        Parameters:
        inputs - The data inputs identified by their node names. You can associate a table name with each input node to use in the SQL query. The name you choose must meet the Spark SQL naming restrictions.
        Returns:
        Returns a reference to this object so that method calls can be chained together.

      • sqlQuery

        SparkSQL.Builder sqlQuery​(String sqlQuery)

        A SQL query that must use Spark SQL syntax and return a single data set.

        Parameters:
        sqlQuery - A SQL query that must use Spark SQL syntax and return a single data set.
        Returns:
        Returns a reference to this object so that method calls can be chained together.

      • sqlAliases

        SparkSQL.Builder sqlAliases​(Collection<SqlAlias> sqlAliases)

        A list of aliases. An alias allows you to specify what name to use in the SQL for a given input. For example, you have a datasource named "MyDataSource". If you specify From as MyDataSource, and Alias as SqlName, then in your SQL you can do:

        select * from SqlName

        and that gets data from MyDataSource.

        Parameters:
        sqlAliases - A list of aliases. An alias allows you to specify what name to use in the SQL for a given input. For example, you have a datasource named "MyDataSource". If you specify From as MyDataSource, and Alias as SqlName, then in your SQL you can do:

        select * from SqlName

        and that gets data from MyDataSource.

        Returns:
        Returns a reference to this object so that method calls can be chained together.

      • sqlAliases

        SparkSQL.Builder sqlAliases​(SqlAlias... sqlAliases)

        A list of aliases. An alias allows you to specify what name to use in the SQL for a given input. For example, you have a datasource named "MyDataSource". If you specify From as MyDataSource, and Alias as SqlName, then in your SQL you can do:

        select * from SqlName

        and that gets data from MyDataSource.

        Parameters:
        sqlAliases - A list of aliases. An alias allows you to specify what name to use in the SQL for a given input. For example, you have a datasource named "MyDataSource". If you specify From as MyDataSource, and Alias as SqlName, then in your SQL you can do:

        select * from SqlName

        and that gets data from MyDataSource.

        Returns:
        Returns a reference to this object so that method calls can be chained together.

      • sqlAliases

        SparkSQL.Builder sqlAliases​(Consumer<SqlAlias.Builder>... sqlAliases)

        A list of aliases. An alias allows you to specify what name to use in the SQL for a given input. For example, you have a datasource named "MyDataSource". If you specify From as MyDataSource, and Alias as SqlName, then in your SQL you can do:

        select * from SqlName

        and that gets data from MyDataSource.

        This is a convenience method that creates an instance of the SqlAlias.Builder avoiding the need to create one manually via SqlAlias.builder().

        When the Consumer completes, SdkBuilder.build() is called immediately and its result is passed to #sqlAliases(List).

        Parameters:
        sqlAliases - a consumer that will call methods on SqlAlias.Builder
        Returns:
        Returns a reference to this object so that method calls can be chained together.
        See Also:
        #sqlAliases(java.util.Collection)

      • outputSchemas

        SparkSQL.Builder outputSchemas​(Collection<GlueSchema> outputSchemas)

        Specifies the data schema for the SparkSQL transform.

        Parameters:
        outputSchemas - Specifies the data schema for the SparkSQL transform.
        Returns:
        Returns a reference to this object so that method calls can be chained together.

      • outputSchemas

        SparkSQL.Builder outputSchemas​(GlueSchema... outputSchemas)

        Specifies the data schema for the SparkSQL transform.

        Parameters:
        outputSchemas - Specifies the data schema for the SparkSQL transform.
        Returns:
        Returns a reference to this object so that method calls can be chained together.

      • outputSchemas

        SparkSQL.Builder outputSchemas​(Consumer<GlueSchema.Builder>... outputSchemas)

        Specifies the data schema for the SparkSQL transform.

        This is a convenience method that creates an instance of the GlueSchema.Builder avoiding the need to create one manually via GlueSchema.builder().

        When the Consumer completes, SdkBuilder.build() is called immediately and its result is passed to #outputSchemas(List).

        Parameters:
        outputSchemas - a consumer that will call methods on GlueSchema.Builder
        Returns:
        Returns a reference to this object so that method calls can be chained together.
        See Also:
        #outputSchemas(java.util.Collection)