(Since version 3.1.0) The styleName lifecycle method has been deprecated and will be removed in a future version of ScalaTest with no replacement.
Compares if two DataFrames are equal, checks that the schemas are the same.
Compares if two DataFrames are equal, checks that the schemas are the same. When comparing inexact fields uses tol & tolTimestamp.
max acceptable numeric tolerance, should be less than 1.
max acceptable timestamp tolerance.
unit function to customize the show method when dataframes are not equal. IE: df.show(false) or df.toJSON.show(false).
Compares if two DataFrames are equal without caring about order of rows, by finding elements in one DataFrame that is not in the other.
Compares if two DataFrames are equal without caring about order of rows, by finding elements in one DataFrame that is not in the other. The resulting DataFrame should be empty inferring the two DataFrames have the same elements. Does not compare the schema.
Compares if two DataFrames are equal, checks the schema and then if that matches checks if the rows are equal.
Compares if two DataFrames are equal, checks the schema and then if that matches checks if the rows are equal.
unit function to customize the show method when dataframes are not equal. IE: df.show(false) or df.toJSON.show(false).
Compares if two DataFrames are equal without caring about order of rows, by finding elements in one DataFrame that is not in the other.
Compares if two DataFrames are equal without caring about order of rows, by finding elements in one DataFrame that is not in the other. The resulting DataFrame should be empty inferring the two DataFrames have the same elements. Also verifies that the schema is identical.
Compare if two schemas are equal, ignoring autoGeneratedAlias magic
Compare if two schemas are equal, ignoring autoGeneratedAlias magic
Compares if two DataFrames are equal without caring about order of rows, by finding elements in one DataFrame that is not in the other.
Compares if two DataFrames are equal without caring about order of rows, by finding elements in one DataFrame that is not in the other. Similar to the function assertDataFrameDataEquals but for small DataFrame that can be collected in memory for the comparison.
Constructs a configuration for hive or iceberg, where the metastore is located in a temp directory.
Constructs a configuration for hive or iceberg, where the metastore is located in a temp directory.
Setup work to be called when creating a new SparkContext.
Setup work to be called when creating a new SparkContext. Default implementation currently sets a checkpoint directory.
This _should_ be called by the context provider automatically.
Test a simple streams end state
Sets all SQL configurations specified in pairs
, calls f
, and then restores all SQL
configurations.
Sets all SQL configurations specified in pairs
, calls f
, and then restores all SQL
configurations.
Taken from Spark SQLHelper.
Compares if two DataFrames are equal, checks that the schemas are the same.
Compares if two DataFrames are equal, checks that the schemas are the same. When comparing inexact fields uses tol.
max acceptable tolerance for numeric (between(0, 1)) & timestamp (millis).
(Since version 1.5.0) Use assertDataFrameApproximateEquals
with timestamp tolerance
(Since version ) see corresponding Javadoc for more information.
Early Experimental Structured Streaming Base.