final class Deduplicate extends GeneratedMessage with DeduplicateOrBuilder
Relation of type [[Deduplicate]] which have duplicate rows removed, could consider either only the subset of columns or all the columns.
Protobuf type spark.connect.Deduplicate
Linear Supertypes
Ordering
- Alphabetic
- By Inheritance
Inherited
- Deduplicate
- DeduplicateOrBuilder
- GeneratedMessage
- Serializable
- AbstractMessage
- Message
- MessageOrBuilder
- AbstractMessageLite
- MessageLite
- MessageLiteOrBuilder
- AnyRef
- Any
- Hide All
- Show All
Visibility
- Public
- Protected
Value Members
- final def !=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- final def ##: Int
- Definition Classes
- AnyRef → Any
- final def ==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- final def asInstanceOf[T0]: T0
- Definition Classes
- Any
- def clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.CloneNotSupportedException]) @IntrinsicCandidate() @native()
- final def eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- def equals(obj: AnyRef): Boolean
- Definition Classes
- Deduplicate → AbstractMessage → Message → AnyRef → Any
- Annotations
- @Override()
- def findInitializationErrors(): List[String]
- Definition Classes
- AbstractMessage → MessageOrBuilder
- def getAllColumnsAsKeys(): Boolean
(Optional) Deduplicate based on all the columns of the input relation. This field does not co-use with `column_names`.
(Optional) Deduplicate based on all the columns of the input relation. This field does not co-use with `column_names`.
optional bool all_columns_as_keys = 3;- returns
The allColumnsAsKeys.
- Definition Classes
- Deduplicate → DeduplicateOrBuilder
- Annotations
- @Override()
- def getAllFields(): Map[FieldDescriptor, AnyRef]
- Definition Classes
- GeneratedMessage → MessageOrBuilder
- final def getClass(): Class[_ <: AnyRef]
- Definition Classes
- AnyRef → Any
- Annotations
- @IntrinsicCandidate() @native()
- def getColumnNames(index: Int): String
(Optional) Deduplicate based on a list of column names. This field does not co-use with `all_columns_as_keys`.
(Optional) Deduplicate based on a list of column names. This field does not co-use with `all_columns_as_keys`.
repeated string column_names = 2;- index
The index of the element to return.
- returns
The columnNames at the given index.
- Definition Classes
- Deduplicate → DeduplicateOrBuilder
- def getColumnNamesBytes(index: Int): ByteString
(Optional) Deduplicate based on a list of column names. This field does not co-use with `all_columns_as_keys`.
(Optional) Deduplicate based on a list of column names. This field does not co-use with `all_columns_as_keys`.
repeated string column_names = 2;- index
The index of the value to return.
- returns
The bytes of the columnNames at the given index.
- Definition Classes
- Deduplicate → DeduplicateOrBuilder
- def getColumnNamesCount(): Int
(Optional) Deduplicate based on a list of column names. This field does not co-use with `all_columns_as_keys`.
(Optional) Deduplicate based on a list of column names. This field does not co-use with `all_columns_as_keys`.
repeated string column_names = 2;- returns
The count of columnNames.
- Definition Classes
- Deduplicate → DeduplicateOrBuilder
- def getColumnNamesList(): ProtocolStringList
(Optional) Deduplicate based on a list of column names. This field does not co-use with `all_columns_as_keys`.
(Optional) Deduplicate based on a list of column names. This field does not co-use with `all_columns_as_keys`.
repeated string column_names = 2;- returns
A list containing the columnNames.
- Definition Classes
- Deduplicate → DeduplicateOrBuilder
- def getDefaultInstanceForType(): Deduplicate
- Definition Classes
- Deduplicate → MessageOrBuilder → MessageLiteOrBuilder
- Annotations
- @Override()
- def getDescriptorForType(): Descriptor
- Definition Classes
- GeneratedMessage → MessageOrBuilder
- def getField(field: FieldDescriptor): AnyRef
- Definition Classes
- GeneratedMessage → MessageOrBuilder
- def getInitializationErrorString(): String
- Definition Classes
- AbstractMessage → MessageOrBuilder
- def getInput(): Relation
(Required) Input relation for a Deduplicate.
(Required) Input relation for a Deduplicate.
.spark.connect.Relation input = 1;- returns
The input.
- Definition Classes
- Deduplicate → DeduplicateOrBuilder
- Annotations
- @Override()
- def getInputOrBuilder(): RelationOrBuilder
(Required) Input relation for a Deduplicate.
(Required) Input relation for a Deduplicate.
.spark.connect.Relation input = 1;- Definition Classes
- Deduplicate → DeduplicateOrBuilder
- Annotations
- @Override()
- def getOneofFieldDescriptor(oneof: OneofDescriptor): FieldDescriptor
- Definition Classes
- GeneratedMessage → AbstractMessage → MessageOrBuilder
- def getParserForType(): Parser[Deduplicate]
- Definition Classes
- Deduplicate → GeneratedMessage → Message → MessageLite
- Annotations
- @Override()
- def getRepeatedField(field: FieldDescriptor, index: Int): AnyRef
- Definition Classes
- GeneratedMessage → MessageOrBuilder
- def getRepeatedFieldCount(field: FieldDescriptor): Int
- Definition Classes
- GeneratedMessage → MessageOrBuilder
- def getSerializedSize(): Int
- Definition Classes
- Deduplicate → GeneratedMessage → AbstractMessage → MessageLite
- Annotations
- @Override()
- def getUnknownFields(): UnknownFieldSet
- Definition Classes
- GeneratedMessage → MessageOrBuilder
- def getWithinWatermark(): Boolean
(Optional) Deduplicate within the time range of watermark.
(Optional) Deduplicate within the time range of watermark.
optional bool within_watermark = 4;- returns
The withinWatermark.
- Definition Classes
- Deduplicate → DeduplicateOrBuilder
- Annotations
- @Override()
- def hasAllColumnsAsKeys(): Boolean
(Optional) Deduplicate based on all the columns of the input relation. This field does not co-use with `column_names`.
(Optional) Deduplicate based on all the columns of the input relation. This field does not co-use with `column_names`.
optional bool all_columns_as_keys = 3;- returns
Whether the allColumnsAsKeys field is set.
- Definition Classes
- Deduplicate → DeduplicateOrBuilder
- Annotations
- @Override()
- def hasField(field: FieldDescriptor): Boolean
- Definition Classes
- GeneratedMessage → MessageOrBuilder
- def hasInput(): Boolean
(Required) Input relation for a Deduplicate.
(Required) Input relation for a Deduplicate.
.spark.connect.Relation input = 1;- returns
Whether the input field is set.
- Definition Classes
- Deduplicate → DeduplicateOrBuilder
- Annotations
- @Override()
- def hasOneof(oneof: OneofDescriptor): Boolean
- Definition Classes
- GeneratedMessage → AbstractMessage → MessageOrBuilder
- def hasWithinWatermark(): Boolean
(Optional) Deduplicate within the time range of watermark.
(Optional) Deduplicate within the time range of watermark.
optional bool within_watermark = 4;- returns
Whether the withinWatermark field is set.
- Definition Classes
- Deduplicate → DeduplicateOrBuilder
- Annotations
- @Override()
- def hashCode(): Int
- Definition Classes
- Deduplicate → AbstractMessage → Message → AnyRef → Any
- Annotations
- @Override()
- def internalGetFieldAccessorTable(): FieldAccessorTable
- Attributes
- protected[proto]
- Definition Classes
- Deduplicate → GeneratedMessage
- Annotations
- @Override()
- def internalGetMapFieldReflection(fieldNumber: Int): MapFieldReflectionAccessor
- Attributes
- protected[protobuf]
- Definition Classes
- GeneratedMessage
- final def isInitialized(): Boolean
- Definition Classes
- Deduplicate → GeneratedMessage → AbstractMessage → MessageLiteOrBuilder
- Annotations
- @Override()
- final def isInstanceOf[T0]: Boolean
- Definition Classes
- Any
- final def ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- def newBuilderForType(parent: BuilderParent): Builder
- Attributes
- protected[proto]
- Definition Classes
- Deduplicate → AbstractMessage
- Annotations
- @Override()
- def newBuilderForType(): Builder
- Definition Classes
- Deduplicate → Message → MessageLite
- Annotations
- @Override()
- def newInstance(unused: UnusedPrivateParameter): AnyRef
- Attributes
- protected[protobuf]
- Definition Classes
- GeneratedMessage
- final def notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @IntrinsicCandidate() @native()
- final def notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @IntrinsicCandidate() @native()
- def parseUnknownField(input: CodedInputStream, unknownFields: Builder, extensionRegistry: ExtensionRegistryLite, tag: Int): Boolean
- Attributes
- protected[protobuf]
- Definition Classes
- GeneratedMessage
- Annotations
- @throws(classOf[java.io.IOException])
- def parseUnknownFieldProto3(input: CodedInputStream, unknownFields: Builder, extensionRegistry: ExtensionRegistryLite, tag: Int): Boolean
- Attributes
- protected[protobuf]
- Definition Classes
- GeneratedMessage
- Annotations
- @throws(classOf[java.io.IOException])
- final def synchronized[T0](arg0: => T0): T0
- Definition Classes
- AnyRef
- def toBuilder(): Builder
- Definition Classes
- Deduplicate → Message → MessageLite
- Annotations
- @Override()
- def toByteArray(): Array[Byte]
- Definition Classes
- AbstractMessageLite → MessageLite
- def toByteString(): ByteString
- Definition Classes
- AbstractMessageLite → MessageLite
- final def toString(): String
- Definition Classes
- AbstractMessage → Message → AnyRef → Any
- final def wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
- final def wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException]) @native()
- final def wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
- def writeDelimitedTo(output: OutputStream): Unit
- Definition Classes
- AbstractMessageLite → MessageLite
- Annotations
- @throws(classOf[java.io.IOException])
- def writeReplace(): AnyRef
- Attributes
- protected[protobuf]
- Definition Classes
- GeneratedMessage
- Annotations
- @throws(classOf[java.io.ObjectStreamException])
- def writeTo(output: CodedOutputStream): Unit
- Definition Classes
- Deduplicate → GeneratedMessage → AbstractMessage → MessageLite
- Annotations
- @Override()
- def writeTo(output: OutputStream): Unit
- Definition Classes
- AbstractMessageLite → MessageLite
- Annotations
- @throws(classOf[java.io.IOException])
Deprecated Value Members
- def finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.Throwable]) @Deprecated
- Deprecated
(Since version 9)
- def internalGetMapField(fieldNumber: Int): MapField[_ <: AnyRef, _ <: AnyRef]
- Attributes
- protected[protobuf]
- Definition Classes
- GeneratedMessage
- Annotations
- @Deprecated
- Deprecated
- def mergeFromAndMakeImmutableInternal(input: CodedInputStream, extensionRegistry: ExtensionRegistryLite): Unit
- Attributes
- protected[protobuf]
- Definition Classes
- GeneratedMessage
- Annotations
- @throws(classOf[com.google.protobuf.InvalidProtocolBufferException]) @Deprecated
- Deprecated