Approximate comparison between two DataFrames.
Approximate comparison between two DataFrames. If the DataFrames match the instances of Double, Float, or Timestamp, 'approx' will be used to compare an approximate equality of the two DFs.
DataFrame to compare to
double for the approximate comparison. If the absolute value of the difference between two values is less than approx, then the two values are considered equal.
Approximate comparison between two DataFrames, can be custom using the Spark-Test configuration If the DataFrames match the instances of Double, Float, or Timestamp, 'approx' will be used to compare an approximate equality of the two DFs.
Approximate comparison between two DataFrames, can be custom using the Spark-Test configuration If the DataFrames match the instances of Double, Float, or Timestamp, 'approx' will be used to compare an approximate equality of the two DFs.
DataFrame to compare to
double for the approximate comparison. If the absolute value of the difference between two values is less than approx, then the two values are considered equal.
Verify if if the Dataframe and the Sequence are equals, can be custom using the Spark-Test configuration
Verify if if the Dataframe and the Sequence are equals, can be custom using the Spark-Test configuration
Sequence to compare to
An exception if the Dataframe and the Sequence are not equals
Comparison between two DataFrames, can be custom using the Spark-Test configuration
Comparison between two DataFrames, can be custom using the Spark-Test configuration
DataFrame to compare to
An exception if both Dataframes are not equals
Gives each modifications for each row between this Dataframe and otherDf
Gives each modifications for each row between this Dataframe and otherDf
DataFrame to compare to
Return the Sequence of modifications for each rows
Depending on the configuration, try to modify the schema of the two DataFrames so that they can be compared.
Depending on the configuration, try to modify the schema of the two DataFrames so that they can be compared. Throw a SchemaError otherwise.
DataFrame to compare to
Both reduced Dataframes
Return a stringified version of the first modifications between this Dataframe and otherDf The number of showed modifications can be modified using the Spark-Test configuration's value: maxRowError
Return a stringified version of the first modifications between this Dataframe and otherDf The number of showed modifications can be modified using the Spark-Test configuration's value: maxRowError
DataFrame to compare to
Sequence of modifications for each rows
Stringified version of modifications
Return a stringified version of the first modifications between this Dataframe and otherDf The number of showed modifications can be modified using the Spark-Test configuration's value: maxRowError
Return a stringified version of the first modifications between this Dataframe and otherDf The number of showed modifications can be modified using the Spark-Test configuration's value: maxRowError
DataFrame to compare to
Sequence of modifications for each rows
Stringified version of modifications
Display the schema of the DataFrame as a case class.
Display the schema of the DataFrame as a case class. Example : val df = Seq(1, 2, 3).toDF("id") df.showCaseClass("Id")
result : case class Id ( id:Int )
name of the case class