- BAD_RECORD_THRESHOLD_CONF_KEY - Static variable in class org.apache.parquet.hadoop.UnmaterializableRecordCounter
-
- BadConfigurationException - Exception in org.apache.parquet.hadoop
-
Thrown when the input/output formats are misconfigured
- BadConfigurationException() - Constructor for exception org.apache.parquet.hadoop.BadConfigurationException
-
- BadConfigurationException(String, Throwable) - Constructor for exception org.apache.parquet.hadoop.BadConfigurationException
-
- BadConfigurationException(String) - Constructor for exception org.apache.parquet.hadoop.BadConfigurationException
-
- BadConfigurationException(Throwable) - Constructor for exception org.apache.parquet.hadoop.BadConfigurationException
-
- BenchmarkCounter - Class in org.apache.parquet.hadoop.util.counters
-
Encapsulate counter operations, compatible with Hadoop1/2, mapred/mapreduce API
- BenchmarkCounter() - Constructor for class org.apache.parquet.hadoop.util.counters.BenchmarkCounter
-
- BenchmarkCounter.NullCounter - Class in org.apache.parquet.hadoop.util.counters
-
- BLOCK_SIZE - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
-
- BlockMetaData - Class in org.apache.parquet.hadoop.metadata
-
Block metadata stored in the footer and passed in an InputSplit
- BlockMetaData() - Constructor for class org.apache.parquet.hadoop.metadata.BlockMetaData
-
- blockRead(byte[], int, int) - Method in class org.apache.parquet.hadoop.util.CompressionConverter.TransParquetFileReader
-
Deprecated.
- BLOOM_FILTER_CANDIDATES_NUMBER - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
-
- BLOOM_FILTER_ENABLED - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
-
- BLOOM_FILTER_EXPECTED_NDV - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
-
- BLOOM_FILTER_FPP - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
-
- BLOOM_FILTER_MAX_BYTES - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
-
- BLOOM_FILTERING_ENABLED - Static variable in class org.apache.parquet.hadoop.ParquetInputFormat
-
key to configure whether row group bloom filtering is enabled
- BloomFilterImpl - Class in org.apache.parquet.filter2.bloomfilterlevel
-
- BloomFilterReader - Class in org.apache.parquet.hadoop
-
- BloomFilterReader(ParquetFileReader, BlockMetaData) - Constructor for class org.apache.parquet.hadoop.BloomFilterReader
-
- bridgeAvailable() - Static method in class org.apache.parquet.hadoop.util.wrapped.io.VectorIoBridge
-
Is the bridge available for use?
- BUFFER_SIZE_CONFIG - Static variable in class org.apache.parquet.hadoop.codec.Lz4RawCodec
-
- build() - Method in class org.apache.parquet.crypto.ColumnDecryptionProperties.Builder
-
- build() - Method in class org.apache.parquet.crypto.ColumnEncryptionProperties.Builder
-
- build() - Method in class org.apache.parquet.crypto.FileDecryptionProperties.Builder
-
- build() - Method in class org.apache.parquet.crypto.FileEncryptionProperties.Builder
-
- build() - Method in class org.apache.parquet.hadoop.ParquetReader.Builder
-
- build() - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
- build() - Method in class org.apache.parquet.hadoop.rewrite.RewriteOptions.Builder
-
Build the RewriterOptions.
- build() - Method in class org.apache.parquet.HadoopReadOptions.Builder
-
- build() - Method in class org.apache.parquet.ParquetReadOptions.Builder
-
- buildColumnChunkMetaData(ColumnMetaData, ColumnPath, PrimitiveType, String) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
-
- builder(String) - Static method in class org.apache.parquet.crypto.ColumnDecryptionProperties
-
Convenience builder for regular (not nested) columns.
- builder(ColumnPath) - Static method in class org.apache.parquet.crypto.ColumnDecryptionProperties
-
- builder(String) - Static method in class org.apache.parquet.crypto.ColumnEncryptionProperties
-
Convenience builder for regular (not nested) columns.
- builder(ColumnPath) - Static method in class org.apache.parquet.crypto.ColumnEncryptionProperties
-
Builder for encrypted columns.
- builder(ColumnPath, boolean) - Static method in class org.apache.parquet.crypto.ColumnEncryptionProperties
-
Builder for encrypted columns.
- builder() - Static method in class org.apache.parquet.crypto.FileDecryptionProperties
-
- builder(byte[]) - Static method in class org.apache.parquet.crypto.FileEncryptionProperties
-
- builder(Path) - Static method in class org.apache.parquet.hadoop.example.ExampleParquetWriter
-
Creates a Builder for configuring ParquetWriter with the example object
model.
- builder(OutputFile) - Static method in class org.apache.parquet.hadoop.example.ExampleParquetWriter
-
Creates a Builder for configuring ParquetWriter with the example object
model.
- builder(ReadSupport<T>, Path) - Static method in class org.apache.parquet.hadoop.ParquetReader
-
- Builder(Path) - Constructor for class org.apache.parquet.hadoop.ParquetReader.Builder
-
Deprecated.
- Builder(InputFile) - Constructor for class org.apache.parquet.hadoop.ParquetReader.Builder
-
- Builder(InputFile, ParquetConfiguration) - Constructor for class org.apache.parquet.hadoop.ParquetReader.Builder
-
- Builder(Path) - Constructor for class org.apache.parquet.hadoop.ParquetWriter.Builder
-
- Builder(OutputFile) - Constructor for class org.apache.parquet.hadoop.ParquetWriter.Builder
-
- Builder(Configuration, Path, Path) - Constructor for class org.apache.parquet.hadoop.rewrite.RewriteOptions.Builder
-
Create a builder to create a RewriterOptions.
- Builder(ParquetConfiguration, InputFile, OutputFile) - Constructor for class org.apache.parquet.hadoop.rewrite.RewriteOptions.Builder
-
Create a builder to create a RewriterOptions.
- Builder(Configuration, List<Path>, Path) - Constructor for class org.apache.parquet.hadoop.rewrite.RewriteOptions.Builder
-
Create a builder to create a RewriterOptions.
- Builder(ParquetConfiguration, List<InputFile>, OutputFile) - Constructor for class org.apache.parquet.hadoop.rewrite.RewriteOptions.Builder
-
Create a builder to create a RewriterOptions.
- builder(Configuration) - Static method in class org.apache.parquet.HadoopReadOptions
-
- builder(Configuration, Path) - Static method in class org.apache.parquet.HadoopReadOptions
-
- Builder(Configuration) - Constructor for class org.apache.parquet.HadoopReadOptions.Builder
-
- Builder(Configuration, Path) - Constructor for class org.apache.parquet.HadoopReadOptions.Builder
-
- builder() - Static method in class org.apache.parquet.ParquetReadOptions
-
- builder(ParquetConfiguration) - Static method in class org.apache.parquet.ParquetReadOptions
-
- Builder() - Constructor for class org.apache.parquet.ParquetReadOptions.Builder
-
- Builder(ParquetConfiguration) - Constructor for class org.apache.parquet.ParquetReadOptions.Builder
-
- BytesCompressor() - Constructor for class org.apache.parquet.hadoop.CodecFactory.BytesCompressor
-
Deprecated.
- BytesDecompressor() - Constructor for class org.apache.parquet.hadoop.CodecFactory.BytesDecompressor
-
Deprecated.
- CACHE_LIFETIME_DEFAULT_SECONDS - Static variable in class org.apache.parquet.crypto.keytools.KeyToolkit
-
- CACHE_LIFETIME_PROPERTY_NAME - Static variable in class org.apache.parquet.crypto.keytools.KeyToolkit
-
Lifetime of cached entities (key encryption keys, local wrapping keys, KMS client objects).
- canDrop(FilterPredicate, List<ColumnChunkMetaData>, BloomFilterReader) - Static method in class org.apache.parquet.filter2.bloomfilterlevel.BloomFilterImpl
-
- canDrop(FilterPredicate, List<ColumnChunkMetaData>, DictionaryPageReadStore) - Static method in class org.apache.parquet.filter2.dictionarylevel.DictionaryFilter
-
- canDrop(FilterPredicate, List<ColumnChunkMetaData>) - Static method in class org.apache.parquet.filter2.statisticslevel.StatisticsFilter
-
- checkContractViolations(InputFile) - Static method in class org.apache.parquet.hadoop.ColumnIndexValidator
-
- checkFooterIntegrity() - Method in class org.apache.parquet.crypto.FileDecryptionProperties
-
- checkFooterIntegrity() - Method in class org.apache.parquet.crypto.InternalFileDecryptor
-
- CHUNK_LENGTH - Static variable in class org.apache.parquet.crypto.AesCipher
-
- cipher - Variable in class org.apache.parquet.crypto.AesCipher
-
- clean() - Method in interface org.apache.parquet.hadoop.IndexCache
-
Clean the cache
- cleanDirectBuffer(ByteBuffer) - Static method in class org.apache.parquet.hadoop.codec.CleanUtil
-
- CleanUtil - Class in org.apache.parquet.hadoop.codec
-
A Helper class which use reflections to clean up DirectBuffer.
- close() - Method in class org.apache.parquet.hadoop.codec.ZstdCompressorStream
-
- close() - Method in class org.apache.parquet.hadoop.codec.ZstdDecompressorStream
-
- close() - Method in class org.apache.parquet.hadoop.ColumnChunkPageWriteStore
-
- close() - Method in class org.apache.parquet.hadoop.ParquetFileReader
-
- close() - Method in class org.apache.parquet.hadoop.ParquetFileWriter
-
- close() - Method in class org.apache.parquet.hadoop.ParquetReader
-
- close() - Method in class org.apache.parquet.hadoop.ParquetRecordReader
- close(TaskAttemptContext) - Method in class org.apache.parquet.hadoop.ParquetRecordWriter
- close() - Method in class org.apache.parquet.hadoop.ParquetWriter
-
- close() - Method in class org.apache.parquet.hadoop.rewrite.ParquetRewriter
-
- close() - Method in class org.apache.parquet.hadoop.util.HadoopPositionOutputStream
-
- CODEC_BY_NAME - Static variable in class org.apache.parquet.hadoop.CodecFactory
-
- CodecConfig - Class in org.apache.parquet.hadoop.codec
-
- CodecConfig() - Constructor for class org.apache.parquet.hadoop.codec.CodecConfig
-
- CodecFactory - Class in org.apache.parquet.hadoop
-
- CodecFactory(Configuration, int) - Constructor for class org.apache.parquet.hadoop.CodecFactory
-
Create a new codec factory.
- CodecFactory(ParquetConfiguration, int) - Constructor for class org.apache.parquet.hadoop.CodecFactory
-
Create a new codec factory.
- codecFactory - Variable in class org.apache.parquet.ParquetReadOptions.Builder
-
- CodecFactory.BytesCompressor - Class in org.apache.parquet.hadoop
-
- CodecFactory.BytesDecompressor - Class in org.apache.parquet.hadoop
-
- COLUMN_INDEX_FILTERING_ENABLED - Static variable in class org.apache.parquet.hadoop.ParquetInputFormat
-
key to configure whether column index filtering of pages is enabled
- COLUMN_INDEX_TRUNCATE_LENGTH - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
-
- COLUMN_KEYS_PROPERTY_NAME - Static variable in class org.apache.parquet.crypto.keytools.PropertiesDrivenCryptoFactory
-
List of columns to encrypt, with master key IDs (see HIVE-21848).
- ColumnChunkMetaData - Class in org.apache.parquet.hadoop.metadata
-
Column meta data for a block stored in the file footer and passed in the InputSplit
- ColumnChunkMetaData(ColumnChunkProperties) - Constructor for class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
-
- ColumnChunkMetaData(EncodingStats, ColumnChunkProperties) - Constructor for class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
-
- ColumnChunkPageWriteStore - Class in org.apache.parquet.hadoop
-
Class should be considered private
- ColumnChunkPageWriteStore(CodecFactory.BytesCompressor, MessageType, ByteBufferAllocator, int) - Constructor for class org.apache.parquet.hadoop.ColumnChunkPageWriteStore
-
Deprecated.
- ColumnChunkPageWriteStore(CompressionCodecFactory.BytesInputCompressor, MessageType, ByteBufferAllocator, int) - Constructor for class org.apache.parquet.hadoop.ColumnChunkPageWriteStore
-
- ColumnChunkPageWriteStore(CodecFactory.BytesCompressor, MessageType, ByteBufferAllocator, int, boolean) - Constructor for class org.apache.parquet.hadoop.ColumnChunkPageWriteStore
-
Deprecated.
- ColumnChunkPageWriteStore(CompressionCodecFactory.BytesInputCompressor, MessageType, ByteBufferAllocator, int, boolean) - Constructor for class org.apache.parquet.hadoop.ColumnChunkPageWriteStore
-
- ColumnChunkPageWriteStore(CodecFactory.BytesCompressor, MessageType, ByteBufferAllocator, int, boolean, InternalFileEncryptor, int) - Constructor for class org.apache.parquet.hadoop.ColumnChunkPageWriteStore
-
Deprecated.
- ColumnChunkPageWriteStore(CompressionCodecFactory.BytesInputCompressor, MessageType, ByteBufferAllocator, int, boolean, InternalFileEncryptor, int) - Constructor for class org.apache.parquet.hadoop.ColumnChunkPageWriteStore
-
- ColumnChunkProperties - Class in org.apache.parquet.hadoop.metadata
-
- ColumnDecryptionProperties - Class in org.apache.parquet.crypto
-
This class is only required for setting explicit column decryption keys -
to override key retriever (or to provide keys when key metadata and/or
key retriever are not available)
- ColumnDecryptionProperties.Builder - Class in org.apache.parquet.crypto
-
- ColumnEncryptionProperties - Class in org.apache.parquet.crypto
-
- ColumnEncryptionProperties.Builder - Class in org.apache.parquet.crypto
-
- ColumnEncryptor - Class in org.apache.parquet.hadoop.util
-
Deprecated.
- ColumnEncryptor(Configuration) - Constructor for class org.apache.parquet.hadoop.util.ColumnEncryptor
-
Deprecated.
- ColumnIndexValidator - Class in org.apache.parquet.hadoop
-
- ColumnIndexValidator() - Constructor for class org.apache.parquet.hadoop.ColumnIndexValidator
-
- ColumnIndexValidator.Contract - Enum in org.apache.parquet.hadoop
-
- ColumnIndexValidator.ContractViolation - Class in org.apache.parquet.hadoop
-
- ColumnMasker - Class in org.apache.parquet.hadoop.util
-
Deprecated.
- ColumnMasker() - Constructor for class org.apache.parquet.hadoop.util.ColumnMasker
-
Deprecated.
- ColumnMasker.MaskMode - Enum in org.apache.parquet.hadoop.util
-
Deprecated.
- ColumnPruner - Class in org.apache.parquet.hadoop.util
-
Deprecated.
- ColumnPruner() - Constructor for class org.apache.parquet.hadoop.util.ColumnPruner
-
Deprecated.
- commitJob(JobContext) - Method in class org.apache.parquet.hadoop.mapred.MapredParquetOutputCommitter
-
- commitJob(JobContext) - Method in class org.apache.parquet.hadoop.ParquetOutputCommitter
-
- COMPLETE_COLUMN_ENCRYPTION_DEFAULT - Static variable in class org.apache.parquet.crypto.keytools.PropertiesDrivenCryptoFactory
-
- COMPLETE_COLUMN_ENCRYPTION_PROPERTY_NAME - Static variable in class org.apache.parquet.crypto.keytools.PropertiesDrivenCryptoFactory
-
Encrypt unlisted columns using footer key.
- compress(ByteBuffer, ByteBuffer) - Method in class org.apache.parquet.hadoop.codec.Lz4RawCompressor
-
- compress(byte[], int, int) - Method in class org.apache.parquet.hadoop.codec.NonBlockedCompressor
-
Fills specified buffer with compressed data.
- compress(ByteBuffer, ByteBuffer) - Method in class org.apache.parquet.hadoop.codec.NonBlockedCompressor
-
Compress the content in the given input buffer.
- compress(ByteBuffer, ByteBuffer) - Method in class org.apache.parquet.hadoop.codec.SnappyCompressor
-
- compress(BytesInput) - Method in class org.apache.parquet.hadoop.CodecFactory.BytesCompressor
-
Deprecated.
- COMPRESSION - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
-
- CompressionConverter - Class in org.apache.parquet.hadoop.util
-
Deprecated.
- CompressionConverter() - Constructor for class org.apache.parquet.hadoop.util.CompressionConverter
-
Deprecated.
- CompressionConverter.TransParquetFileReader - Class in org.apache.parquet.hadoop.util
-
Deprecated.
- ConcatenatingKeyValueMetadataMergeStrategy - Class in org.apache.parquet.hadoop.metadata
-
Strategy to concatenate if there are multiple values for a given key in metadata.
- ConcatenatingKeyValueMetadataMergeStrategy() - Constructor for class org.apache.parquet.hadoop.metadata.ConcatenatingKeyValueMetadataMergeStrategy
-
Default constructor.
- ConcatenatingKeyValueMetadataMergeStrategy(String) - Constructor for class org.apache.parquet.hadoop.metadata.ConcatenatingKeyValueMetadataMergeStrategy
-
Constructor to use different delimiter for concatenation.
- conf - Variable in class org.apache.parquet.hadoop.CodecFactory
-
- conf - Variable in class org.apache.parquet.hadoop.ParquetReader.Builder
-
Deprecated.
- conf - Variable in class org.apache.parquet.ParquetReadOptions.Builder
-
- config(String, String) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
Set a property that will be available to the read path.
- configuration - Variable in class org.apache.parquet.hadoop.CodecFactory
-
Deprecated.
- configuration - Variable in class org.apache.parquet.hadoop.ParquetReader.Builder
-
- ConfigurationUtil - Class in org.apache.parquet.hadoop.util
-
- ConfigurationUtil() - Constructor for class org.apache.parquet.hadoop.util.ConfigurationUtil
-
- Container<T> - Class in org.apache.parquet.hadoop.mapred
-
A simple container of objects that you can get and set.
- Container() - Constructor for class org.apache.parquet.hadoop.mapred.Container
-
- ContextUtil - Class in org.apache.parquet.hadoop.util
-
Utility methods to allow applications to deal with inconsistencies between
MapReduce Context Objects API between hadoop-0.20 and later versions.
- ContextUtil() - Constructor for class org.apache.parquet.hadoop.util.ContextUtil
-
- ContractViolation(ColumnIndexValidator.Contract, String, String, int, int, ColumnPath, int) - Constructor for class org.apache.parquet.hadoop.ColumnIndexValidator.ContractViolation
-
- convertEncodingStats(List<PageEncodingStats>) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
-
- convertEncodingStats(EncodingStats) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
-
- convertToColumnPaths(List<String>) - Static method in class org.apache.parquet.hadoop.util.ColumnEncryptor
-
Deprecated.
- convertToColumnPaths(List<String>) - Static method in class org.apache.parquet.hadoop.util.ColumnMasker
-
Deprecated.
- copy(ParquetReadOptions) - Method in class org.apache.parquet.ParquetReadOptions.Builder
-
- CounterLoader - Interface in org.apache.parquet.hadoop.util.counters
-
Factory interface for CounterLoaders, will load the counter according to groupName, counterName,
and if in the configuration, flag with name counterFlag is false, the counter will not be loaded
- create(ParquetFileReader, Set<ColumnPath>, IndexCache.CacheStrategy, boolean) - Static method in interface org.apache.parquet.hadoop.IndexCache
-
Create an index cache for the given file reader
- create(long) - Method in class org.apache.parquet.hadoop.util.HadoopOutputFile
-
- createCompressor() - Method in class org.apache.parquet.hadoop.codec.Lz4RawCodec
-
- createCompressor() - Method in class org.apache.parquet.hadoop.codec.SnappyCodec
-
- createCompressor() - Method in class org.apache.parquet.hadoop.codec.ZstandardCodec
-
- createCompressor(CompressionCodecName) - Method in class org.apache.parquet.hadoop.CodecFactory
-
- createDecompressor() - Method in class org.apache.parquet.hadoop.codec.Lz4RawCodec
-
- createDecompressor() - Method in class org.apache.parquet.hadoop.codec.SnappyCodec
-
- createDecompressor() - Method in class org.apache.parquet.hadoop.codec.ZstandardCodec
-
- createDecompressor(CompressionCodecName) - Method in class org.apache.parquet.hadoop.CodecFactory
-
- createDirectCodecFactory(Configuration, ByteBufferAllocator, int) - Static method in class org.apache.parquet.hadoop.CodecFactory
-
Create a codec factory that will provide compressors and decompressors
that will work natively with ByteBuffers backed by direct memory.
- createDirectDecompressor() - Method in class org.apache.parquet.hadoop.codec.Lz4RawCodec
-
- createEncryptionProperties(Configuration, Path, WriteSupport.WriteContext) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
-
- createFooterAAD(byte[]) - Static method in class org.apache.parquet.crypto.AesCipher
-
- createHadoopConfiguration(ParquetConfiguration) - Static method in class org.apache.parquet.hadoop.util.ConfigurationUtil
-
- createInputStream(InputStream) - Method in class org.apache.parquet.hadoop.codec.Lz4RawCodec
-
- createInputStream(InputStream, Decompressor) - Method in class org.apache.parquet.hadoop.codec.Lz4RawCodec
-
- createInputStream(InputStream) - Method in class org.apache.parquet.hadoop.codec.SnappyCodec
-
- createInputStream(InputStream, Decompressor) - Method in class org.apache.parquet.hadoop.codec.SnappyCodec
-
- createInputStream(InputStream, Decompressor) - Method in class org.apache.parquet.hadoop.codec.ZstandardCodec
-
- createInputStream(InputStream) - Method in class org.apache.parquet.hadoop.codec.ZstandardCodec
-
- createModuleAAD(byte[], ModuleCipherFactory.ModuleType, int, int, int) - Static method in class org.apache.parquet.crypto.AesCipher
-
- createOrOverwrite(long) - Method in class org.apache.parquet.hadoop.util.HadoopOutputFile
-
- createOutputStream(OutputStream) - Method in class org.apache.parquet.hadoop.codec.Lz4RawCodec
-
- createOutputStream(OutputStream, Compressor) - Method in class org.apache.parquet.hadoop.codec.Lz4RawCodec
-
- createOutputStream(OutputStream) - Method in class org.apache.parquet.hadoop.codec.SnappyCodec
-
- createOutputStream(OutputStream, Compressor) - Method in class org.apache.parquet.hadoop.codec.SnappyCodec
-
- createOutputStream(OutputStream, Compressor) - Method in class org.apache.parquet.hadoop.codec.ZstandardCodec
-
- createOutputStream(OutputStream) - Method in class org.apache.parquet.hadoop.codec.ZstandardCodec
-
- createRecordReader(InputSplit, TaskAttemptContext) - Method in class org.apache.parquet.hadoop.ParquetInputFormat
- createSignedFooterEncryptor() - Method in class org.apache.parquet.crypto.InternalFileDecryptor
-
- CRYPTO_FACTORY_CLASS_PROPERTY_NAME - Static variable in interface org.apache.parquet.crypto.DecryptionPropertiesFactory
-
- CRYPTO_FACTORY_CLASS_PROPERTY_NAME - Static variable in interface org.apache.parquet.crypto.EncryptionPropertiesFactory
-
- CTR_IV_LENGTH - Static variable in class org.apache.parquet.crypto.AesCipher
-
- CTR_RANDOM_IV_SAME_KEY_MAX_OPS - Static variable in class org.apache.parquet.crypto.AesCipher
-
- CURRENT_VERSION - Static variable in class org.apache.parquet.hadoop.ParquetFileWriter
-
- EF_MAGIC_STR - Static variable in class org.apache.parquet.hadoop.ParquetFileWriter
-
- EFMAGIC - Static variable in class org.apache.parquet.hadoop.ParquetFileWriter
-
- ENABLE_DICTIONARY - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
-
- ENABLE_JOB_SUMMARY - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
-
Deprecated.
- enableDictionaryEncoding() - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
Enables dictionary encoding for the constructed writer.
- enablePageWriteChecksum() - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
Enables writing page level checksums for the constructed writer.
- enableValidation() - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
Enables validation for the constructed writer.
- EncodingList - Class in org.apache.parquet.hadoop.metadata
-
- encrypt(byte[], byte[]) - Method in class org.apache.parquet.crypto.AesCtrEncryptor
-
- encrypt(boolean, byte[], byte[]) - Method in class org.apache.parquet.crypto.AesCtrEncryptor
-
- encrypt(boolean, byte[], byte[], byte[]) - Method in class org.apache.parquet.crypto.AesCtrEncryptor
-
- encrypt(byte[], byte[]) - Method in class org.apache.parquet.crypto.AesGcmEncryptor
-
- encrypt(boolean, byte[], byte[]) - Method in class org.apache.parquet.crypto.AesGcmEncryptor
-
- encrypt(boolean, byte[], byte[], byte[]) - Method in class org.apache.parquet.crypto.AesGcmEncryptor
-
- encrypt(List<String>) - Method in class org.apache.parquet.hadoop.rewrite.RewriteOptions.Builder
-
Set the columns to encrypt.
- encryptColumnMetaData(InternalColumnEncryptionSetup) - Method in class org.apache.parquet.crypto.InternalFileEncryptor
-
- encryptColumns(String, String, List<String>, FileEncryptionProperties) - Method in class org.apache.parquet.hadoop.util.ColumnEncryptor
-
Deprecated.
Given the input file, encrypt the columns specified by paths, and output the file.
- encryptedFooter() - Method in class org.apache.parquet.crypto.FileEncryptionProperties
-
- ENCRYPTION_ALGORITHM_DEFAULT - Static variable in class org.apache.parquet.crypto.keytools.PropertiesDrivenCryptoFactory
-
- ENCRYPTION_ALGORITHM_PROPERTY_NAME - Static variable in class org.apache.parquet.crypto.keytools.PropertiesDrivenCryptoFactory
-
Parquet encryption algorithm.
- encryptionProperties(FileEncryptionProperties) - Method in class org.apache.parquet.hadoop.rewrite.RewriteOptions.Builder
-
Set the encryption properties to use for the output file.
- EncryptionPropertiesFactory - Interface in org.apache.parquet.crypto
-
EncryptionPropertiesFactory interface enables transparent activation of Parquet encryption.
- encryptKeyLocally(byte[], byte[], byte[]) - Static method in class org.apache.parquet.crypto.keytools.KeyToolkit
-
Encrypts "key" with "masterKey", using AES-GCM and the "AAD"
- end() - Method in class org.apache.parquet.hadoop.codec.NonBlockedCompressor
-
- end() - Method in class org.apache.parquet.hadoop.codec.NonBlockedDecompressor
-
- end(Map<String, String>) - Method in class org.apache.parquet.hadoop.ParquetFileWriter
-
ends a file once all blocks have been written.
- endBlock() - Method in class org.apache.parquet.hadoop.ParquetFileWriter
-
ends a block once all column chunks have been written
- endColumn() - Method in class org.apache.parquet.hadoop.ParquetFileWriter
-
end a column (once all rep, def and data have been written)
- equals(Object) - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkProperties
-
- equals(Object) - Method in class org.apache.parquet.hadoop.metadata.EncodingList
-
- ESTIMATE_PAGE_SIZE_CHECK - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
-
- ExampleInputFormat - Class in org.apache.parquet.hadoop.example
-
Example input format to read Parquet files
- ExampleInputFormat() - Constructor for class org.apache.parquet.hadoop.example.ExampleInputFormat
-
- ExampleOutputFormat - Class in org.apache.parquet.hadoop.example
-
An example output format
- ExampleOutputFormat() - Constructor for class org.apache.parquet.hadoop.example.ExampleOutputFormat
-
- ExampleParquetWriter - Class in org.apache.parquet.hadoop.example
-
An example file writer class.
- ExampleParquetWriter.Builder - Class in org.apache.parquet.hadoop.example
-
- GCM_RANDOM_IV_SAME_KEY_MAX_OPS - Static variable in class org.apache.parquet.crypto.AesCipher
-
- GCM_TAG_LENGTH - Static variable in class org.apache.parquet.crypto.AesCipher
-
- GCM_TAG_LENGTH_BITS - Static variable in class org.apache.parquet.crypto.AesCipher
-
- get(String) - Method in class org.apache.parquet.conf.HadoopParquetConfiguration
-
- get(String, String) - Method in class org.apache.parquet.conf.HadoopParquetConfiguration
-
- get() - Method in class org.apache.parquet.hadoop.mapred.Container
-
- get(ColumnPath, PrimitiveType.PrimitiveTypeName, CompressionCodecName, Set<Encoding>, long, long, long, long, long) - Static method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
-
Deprecated.
- get(ColumnPath, PrimitiveType.PrimitiveTypeName, CompressionCodecName, Set<Encoding>, Statistics, long, long, long, long, long) - Static method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
-
Deprecated.
- get(ColumnPath, PrimitiveType.PrimitiveTypeName, CompressionCodecName, EncodingStats, Set<Encoding>, Statistics, long, long, long, long, long) - Static method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
-
- get(ColumnPath, PrimitiveType, CompressionCodecName, EncodingStats, Set<Encoding>, Statistics, long, long, long, long, long) - Static method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
-
- get(ColumnPath, PrimitiveType, CompressionCodecName, EncodingStats, Set<Encoding>, Statistics, long, long, long, long, long, SizeStatistics) - Static method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
-
- get(ColumnPath, PrimitiveType.PrimitiveTypeName, CompressionCodecName, Set<Encoding>) - Static method in class org.apache.parquet.hadoop.metadata.ColumnChunkProperties
-
- get(ColumnPath, PrimitiveType, CompressionCodecName, Set<Encoding>) - Static method in class org.apache.parquet.hadoop.metadata.ColumnChunkProperties
-
- getAADPrefix() - Method in class org.apache.parquet.crypto.FileDecryptionProperties
-
- getAdaptiveBloomFilterEnabled(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
-
- getAlgorithm() - Method in class org.apache.parquet.crypto.FileEncryptionProperties
-
- getAllocator() - Method in class org.apache.parquet.ParquetReadOptions
-
- getBlockFileSystems() - Static method in class org.apache.parquet.hadoop.util.HadoopOutputFile
-
- getBlocks() - Method in class org.apache.parquet.hadoop.metadata.ParquetMetadata
-
- getBlocks() - Method in class org.apache.parquet.hadoop.ParquetInputSplit
-
- getBlockSize(JobContext) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
-
- getBlockSize(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
-
Deprecated.
- getBlocksRead() - Method in class org.apache.parquet.hadoop.util.wrapped.io.VectorIoBridge
-
How many blocks were read?
- getBloomFilter(ColumnChunkMetaData) - Method in interface org.apache.parquet.hadoop.IndexCache
-
Get the BloomFilter for the given column in the set row group.
- getBloomFilterDataReader(int) - Method in class org.apache.parquet.hadoop.ParquetFileReader
-
- getBloomFilterDataReader(BlockMetaData) - Method in class org.apache.parquet.hadoop.ParquetFileReader
-
- getBloomFilterEnabled(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
-
- getBloomFilterLength() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
-
- getBloomFilterMaxBytes(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
-
- getBloomFilterOffset() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
-
- getBloomFilterWriter(ColumnDescriptor) - Method in class org.apache.parquet.hadoop.ColumnChunkPageWriteStore
-
- getBoolean(String, boolean) - Method in class org.apache.parquet.conf.HadoopParquetConfiguration
-
- getBytesRead() - Method in class org.apache.parquet.hadoop.codec.NonBlockedCompressor
-
- getBytesRead() - Static method in class org.apache.parquet.hadoop.util.counters.BenchmarkCounter
-
- getBytesRead() - Method in class org.apache.parquet.hadoop.util.wrapped.io.VectorIoBridge
-
How many bytes of data have been read.
- getBytesWritten() - Method in class org.apache.parquet.hadoop.codec.NonBlockedCompressor
-
- getCipherName() - Method in enum org.apache.parquet.crypto.AesMode
-
- getClass(String, Class<?>) - Method in class org.apache.parquet.conf.HadoopParquetConfiguration
-
- getClass(String, Class<? extends U>, Class<U>) - Method in class org.apache.parquet.conf.HadoopParquetConfiguration
-
- getClassByName(String) - Method in class org.apache.parquet.conf.HadoopParquetConfiguration
-
- getClassFromConfig(Configuration, String, Class<?>) - Static method in class org.apache.parquet.hadoop.util.ConfigurationUtil
-
- getClassFromConfig(ParquetConfiguration, String, Class<?>) - Static method in class org.apache.parquet.hadoop.util.ConfigurationUtil
-
- getCodec() - Method in class org.apache.parquet.hadoop.codec.CodecConfig
-
- getCodec(CompressionCodecName) - Method in class org.apache.parquet.hadoop.CodecFactory
-
- getCodec() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
-
- getCodec() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkProperties
-
- getCodecFactory() - Method in class org.apache.parquet.ParquetReadOptions
-
- getCodecName() - Method in class org.apache.parquet.hadoop.CodecFactory.BytesCompressor
-
Deprecated.
- getColumnCryptoMetaData() - Method in class org.apache.parquet.crypto.InternalColumnEncryptionSetup
-
- getColumnIndex(ColumnChunkMetaData) - Method in interface org.apache.parquet.hadoop.IndexCache
-
Get the ColumnIndex for the given column in the set row group.
- getColumnIndexReference() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
-
Method should be considered private
- getColumnIndexStore(int) - Method in class org.apache.parquet.hadoop.ParquetFileReader
-
- getColumnKey(ColumnPath) - Method in class org.apache.parquet.crypto.FileDecryptionProperties
-
- getColumnProperties(ColumnPath) - Method in class org.apache.parquet.crypto.FileEncryptionProperties
-
- getColumns() - Method in class org.apache.parquet.hadoop.metadata.BlockMetaData
-
- getColumnSetup(ColumnPath) - Method in class org.apache.parquet.crypto.InternalFileDecryptor
-
- getColumnSetup(ColumnPath, boolean, int) - Method in class org.apache.parquet.crypto.InternalFileEncryptor
-
- getCompressedSize() - Method in class org.apache.parquet.hadoop.metadata.BlockMetaData
-
- getCompression(JobContext) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
-
- getCompression(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
-
- getCompressor(CompressionCodecName) - Method in class org.apache.parquet.hadoop.CodecFactory
-
- getCompressorType() - Method in class org.apache.parquet.hadoop.codec.Lz4RawCodec
-
- getCompressorType() - Method in class org.apache.parquet.hadoop.codec.SnappyCodec
-
- getCompressorType() - Method in class org.apache.parquet.hadoop.codec.ZstandardCodec
-
- getConf() - Method in class org.apache.parquet.hadoop.codec.Lz4RawCodec
-
- getConf() - Method in class org.apache.parquet.hadoop.codec.SnappyCodec
-
- getConf() - Method in class org.apache.parquet.hadoop.codec.ZstandardCodec
-
- getConf() - Method in class org.apache.parquet.hadoop.rewrite.RewriteOptions
-
Gets the Configuration
part of the rewrite options.
- getConf() - Method in class org.apache.parquet.HadoopReadOptions
-
- getConfiguration() - Method in class org.apache.parquet.conf.HadoopParquetConfiguration
-
- getConfiguration() - Method in class org.apache.parquet.hadoop.api.InitContext
-
- getConfiguration() - Method in class org.apache.parquet.hadoop.codec.CodecConfig
-
- getConfiguration(JobContext) - Static method in class org.apache.parquet.hadoop.util.ContextUtil
-
Invoke getConfiguration() method on JobContext.
- getConfiguration() - Method in class org.apache.parquet.hadoop.util.HadoopInputFile
-
- getConfiguration() - Method in class org.apache.parquet.hadoop.util.HadoopOutputFile
-
- getConfiguration() - Method in class org.apache.parquet.ParquetReadOptions
-
- getCount() - Method in class org.apache.parquet.hadoop.util.counters.BenchmarkCounter.NullCounter
-
- getCount() - Method in interface org.apache.parquet.hadoop.util.counters.ICounter
-
- getCount() - Method in class org.apache.parquet.hadoop.util.counters.mapred.MapRedCounterAdapter
-
- getCount() - Method in class org.apache.parquet.hadoop.util.counters.mapreduce.MapReduceCounterAdapter
-
- getCounter(TaskAttemptContext, String, String) - Static method in class org.apache.parquet.hadoop.util.ContextUtil
-
- getCounterByNameAndFlag(String, String, String) - Method in interface org.apache.parquet.hadoop.util.counters.CounterLoader
-
- getCounterByNameAndFlag(String, String, String) - Method in class org.apache.parquet.hadoop.util.counters.mapred.MapRedCounterLoader
-
- getCounterByNameAndFlag(String, String, String) - Method in class org.apache.parquet.hadoop.util.counters.mapreduce.MapReduceCounterLoader
-
- getCreatedBy() - Method in class org.apache.parquet.hadoop.metadata.FileMetaData
-
- getCreatedBy() - Method in class org.apache.parquet.hadoop.metadata.GlobalMetaData
-
- getCurrentKey() - Method in class org.apache.parquet.hadoop.ParquetRecordReader
-
always returns null
- getCurrentRowIndex() - Method in class org.apache.parquet.hadoop.ParquetReader
-
- getCurrentRowIndex() - Method in class org.apache.parquet.hadoop.ParquetRecordReader
-
- getCurrentValue() - Method in class org.apache.parquet.hadoop.ParquetRecordReader
- getDataDecryptor() - Method in class org.apache.parquet.crypto.InternalColumnDecryptionSetup
-
- getDataEncryptor() - Method in class org.apache.parquet.crypto.InternalColumnEncryptionSetup
-
- getDataSize() - Method in class org.apache.parquet.hadoop.ParquetWriter
-
- getDecompressor(CompressionCodecName) - Method in class org.apache.parquet.hadoop.CodecFactory
-
- getDecompressorType() - Method in class org.apache.parquet.hadoop.codec.Lz4RawCodec
-
- getDecompressorType() - Method in class org.apache.parquet.hadoop.codec.SnappyCodec
-
- getDecompressorType() - Method in class org.apache.parquet.hadoop.codec.ZstandardCodec
-
- getDecryptionProperties() - Method in class org.apache.parquet.crypto.InternalFileDecryptor
-
- getDecryptionProperties() - Method in class org.apache.parquet.ParquetReadOptions
-
- getDecryptor(AesMode, byte[]) - Static method in class org.apache.parquet.crypto.ModuleCipherFactory
-
- getDefaultExtension() - Method in class org.apache.parquet.hadoop.codec.Lz4RawCodec
-
- getDefaultExtension() - Method in class org.apache.parquet.hadoop.codec.SnappyCodec
-
- getDefaultExtension() - Method in class org.apache.parquet.hadoop.codec.ZstandardCodec
-
- getDictionaryPageOffset() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
-
- getDictionaryPageSize(JobContext) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
-
- getDictionaryPageSize(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
-
- getDictionaryReader(int) - Method in class org.apache.parquet.hadoop.ParquetFileReader
-
- getDictionaryReader(BlockMetaData) - Method in class org.apache.parquet.hadoop.ParquetFileReader
-
- getEnableDictionary(JobContext) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
-
- getEnableDictionary(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
-
- getEncoding(Encoding) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
-
- getEncoding(Encoding) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
-
- getEncodingList(List<Encoding>) - Static method in class org.apache.parquet.hadoop.metadata.EncodingList
-
- getEncodings() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
-
- getEncodings() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkProperties
-
- getEncodingStats() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
-
- getEncryptColumns() - Method in class org.apache.parquet.hadoop.rewrite.RewriteOptions
-
- getEncryptedColumns() - Method in class org.apache.parquet.crypto.FileEncryptionProperties
-
- getEncryptionAlgorithm() - Method in class org.apache.parquet.crypto.InternalFileEncryptor
-
- getEncryptionAlgorithm() - Method in enum org.apache.parquet.crypto.ParquetCipher
-
- getEncryptionProperties() - Method in class org.apache.parquet.crypto.InternalFileEncryptor
-
- getEncryptionType() - Method in class org.apache.parquet.hadoop.metadata.FileMetaData
-
- getEncryptor(AesMode, byte[]) - Static method in class org.apache.parquet.crypto.ModuleCipherFactory
-
- getEncryptor() - Method in class org.apache.parquet.hadoop.ParquetFileWriter
-
- getEnd() - Method in class org.apache.parquet.hadoop.ParquetInputSplit
-
Deprecated.
- getEstimatePageSizeCheck(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
-
- getExtraMetaData() - Method in class org.apache.parquet.hadoop.api.WriteSupport.FinalizedWriteContext
-
- getExtraMetaData() - Method in class org.apache.parquet.hadoop.api.WriteSupport.WriteContext
-
- getExtraMetadata() - Method in class org.apache.parquet.hadoop.ParquetInputSplit
-
- getFile() - Method in class org.apache.parquet.hadoop.Footer
-
- getFile() - Method in class org.apache.parquet.hadoop.ParquetFileReader
-
- getFileAAD() - Method in class org.apache.parquet.crypto.FileEncryptionProperties
-
- getFileAAD() - Method in class org.apache.parquet.crypto.InternalFileDecryptor
-
- getFileAAD() - Method in class org.apache.parquet.crypto.InternalFileEncryptor
-
- getFileCryptoMetaData() - Method in class org.apache.parquet.crypto.InternalFileEncryptor
-
- getFileDecryptionProperties(Configuration, Path) - Method in interface org.apache.parquet.crypto.DecryptionPropertiesFactory
-
Get FileDecryptionProperties object which is created by the implementation of this interface.
- getFileDecryptionProperties(Configuration, Path) - Method in class org.apache.parquet.crypto.keytools.PropertiesDrivenCryptoFactory
-
- getFileDecryptor() - Method in class org.apache.parquet.hadoop.metadata.FileMetaData
-
- getFileEncryptionProperties(Configuration, Path, WriteSupport.WriteContext) - Method in interface org.apache.parquet.crypto.EncryptionPropertiesFactory
-
Get FileEncryptionProperties object which is created by the implementation of this interface.
- getFileEncryptionProperties(Configuration, Path, WriteSupport.WriteContext) - Method in class org.apache.parquet.crypto.keytools.PropertiesDrivenCryptoFactory
-
- getFileEncryptionProperties() - Method in class org.apache.parquet.hadoop.rewrite.RewriteOptions
-
- getFileMetaData() - Method in class org.apache.parquet.hadoop.metadata.ParquetMetadata
-
- getFileMetaData() - Method in class org.apache.parquet.hadoop.ParquetFileReader
-
- getFileSchema() - Method in class org.apache.parquet.hadoop.api.InitContext
-
this is the union of all the schemas when reading multiple files.
- getFileSchema() - Method in class org.apache.parquet.hadoop.ParquetInputSplit
-
- getFilter(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetInputFormat
-
Returns a non-null Filter, which is a wrapper around either a
FilterPredicate, an UnboundRecordFilter, or a no-op filter.
- getFilter(ParquetConfiguration) - Static method in class org.apache.parquet.hadoop.ParquetInputFormat
-
- getFilteredRecordCount() - Method in class org.apache.parquet.hadoop.ParquetFileReader
-
- getFirstDataPageOffset() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
-
- getFooter() - Method in class org.apache.parquet.hadoop.ParquetFileReader
-
- getFooter() - Method in class org.apache.parquet.hadoop.ParquetFileWriter
-
- getFooter() - Method in class org.apache.parquet.hadoop.ParquetWriter
-
- getFooterEncryptor() - Method in class org.apache.parquet.crypto.InternalFileEncryptor
-
- getFooterKey() - Method in class org.apache.parquet.crypto.FileDecryptionProperties
-
- getFooterKey() - Method in class org.apache.parquet.crypto.FileEncryptionProperties
-
- getFooterKeyMetadata() - Method in class org.apache.parquet.crypto.FileEncryptionProperties
-
- getFooters(JobConf) - Method in class org.apache.parquet.hadoop.mapred.DeprecatedParquetInputFormat
-
- getFooters(JobContext) - Method in class org.apache.parquet.hadoop.ParquetInputFormat
-
- getFooters(Configuration, List<FileStatus>) - Method in class org.apache.parquet.hadoop.ParquetInputFormat
-
- getFooters(Configuration, Collection<FileStatus>) - Method in class org.apache.parquet.hadoop.ParquetInputFormat
-
the footers for the files
- getFooterSigningKeyMetaData() - Method in class org.apache.parquet.crypto.InternalFileEncryptor
-
- getGlobalMetaData(JobContext) - Method in class org.apache.parquet.hadoop.ParquetInputFormat
-
- getHadoopOutputCompressorClass(Class) - Method in class org.apache.parquet.hadoop.codec.CodecConfig
-
- getIndexCacheStrategy() - Method in class org.apache.parquet.hadoop.rewrite.RewriteOptions
-
- getInputFiles() - Method in class org.apache.parquet.hadoop.rewrite.RewriteOptions
-
Gets the input
Path
s for the rewrite if they exist for all input files,
otherwise throws a
RuntimeException
.
- getInt(String, int) - Method in class org.apache.parquet.conf.HadoopParquetConfiguration
-
- getJobSummaryLevel(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
-
- getKey(byte[]) - Method in interface org.apache.parquet.crypto.DecryptionKeyRetriever
-
Returns encryption key using the key metadata.
- getKey(byte[]) - Method in class org.apache.parquet.crypto.keytools.FileKeyUnwrapper
-
- getKeyBytes() - Method in class org.apache.parquet.crypto.ColumnDecryptionProperties
-
- getKeyBytes() - Method in class org.apache.parquet.crypto.ColumnEncryptionProperties
-
- getKeyIDSet() - Method in interface org.apache.parquet.crypto.keytools.FileKeyMaterialStore
-
- getKeyIDSet() - Method in class org.apache.parquet.crypto.keytools.HadoopFSKeyMaterialStore
-
- getKeyMaterial(String) - Method in interface org.apache.parquet.crypto.keytools.FileKeyMaterialStore
-
Get key material
- getKeyMaterial(String) - Method in class org.apache.parquet.crypto.keytools.HadoopFSKeyMaterialStore
-
- getKeyMetaData() - Method in class org.apache.parquet.crypto.ColumnEncryptionProperties
-
- getKeyRetriever() - Method in class org.apache.parquet.crypto.FileDecryptionProperties
-
- getKeyValueMetadata() - Method in class org.apache.parquet.hadoop.api.InitContext
-
each key is associated with the list of distinct values found in footers
- getKeyValueMetaData() - Method in class org.apache.parquet.hadoop.metadata.FileMetaData
-
- getKeyValueMetaData() - Method in class org.apache.parquet.hadoop.metadata.GlobalMetaData
-
- getLength() - Method in class org.apache.parquet.hadoop.util.HadoopInputFile
-
- getLength() - Method in class org.apache.parquet.internal.hadoop.metadata.IndexReference
-
- getLong(String, long) - Method in class org.apache.parquet.conf.HadoopParquetConfiguration
-
- getLongBlockSize(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
-
- getMaskColumns() - Method in class org.apache.parquet.hadoop.rewrite.RewriteOptions
-
- getMasterKeyFromServer(String) - Method in class org.apache.parquet.crypto.keytools.LocalWrapKmsClient
-
Get master key from the remote KMS server.
- getMaxAllocationSize() - Method in class org.apache.parquet.ParquetReadOptions
-
- getMaxRowCountForPageSizeCheck(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
-
- getMemoryManager() - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
-
- getMergedKeyValueMetaData() - Method in class org.apache.parquet.hadoop.api.InitContext
-
Deprecated.
- getMetaDataDecryptor() - Method in class org.apache.parquet.crypto.InternalColumnDecryptionSetup
-
- getMetaDataEncryptor() - Method in class org.apache.parquet.crypto.InternalColumnEncryptionSetup
-
- getMetadataFilter() - Method in class org.apache.parquet.ParquetReadOptions
-
- getMetricsCallback() - Method in class org.apache.parquet.ParquetReadOptions
-
- getMinRowCountForPageSizeCheck(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
-
- getMode() - Method in enum org.apache.parquet.hadoop.rewrite.MaskMode
-
- getMode() - Method in enum org.apache.parquet.hadoop.util.ColumnMasker.MaskMode
-
Deprecated.
- getName() - Method in class org.apache.parquet.hadoop.api.DelegatingWriteSupport
-
- getName() - Method in class org.apache.parquet.hadoop.api.WriteSupport
-
Called to get a name to identify the WriteSupport object model.
- getName() - Method in class org.apache.parquet.hadoop.example.GroupWriteSupport
-
- getNewCodecName() - Method in class org.apache.parquet.hadoop.rewrite.RewriteOptions
-
- getNextDictionaryReader() - Method in class org.apache.parquet.hadoop.ParquetFileReader
-
- getNextRowGroupSize() - Method in class org.apache.parquet.hadoop.ParquetFileWriter
-
- getOffset() - Method in class org.apache.parquet.internal.hadoop.metadata.IndexReference
-
- getOffsetIndex(ColumnChunkMetaData) - Method in interface org.apache.parquet.hadoop.IndexCache
-
Get the OffsetIndex for the given column in the set row group.
- getOffsetIndexReference() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
-
Method should be considered private
- getOrdinal() - Method in class org.apache.parquet.crypto.InternalColumnDecryptionSetup
-
- getOrdinal() - Method in class org.apache.parquet.crypto.InternalColumnEncryptionSetup
-
- getOrdinal() - Method in class org.apache.parquet.hadoop.metadata.BlockMetaData
-
- getOutputCommitter(TaskAttemptContext) - Method in class org.apache.parquet.hadoop.ParquetOutputFormat
-
- getOutputFile() - Method in class org.apache.parquet.hadoop.rewrite.RewriteOptions
-
- getPageSize(JobContext) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
-
- getPageSize(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
-
- getPageWriteChecksumEnabled(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
-
- getPageWriter(ColumnDescriptor) - Method in class org.apache.parquet.hadoop.ColumnChunkPageWriteStore
-
- getParquetCompressionCodec(Configuration) - Static method in class org.apache.parquet.hadoop.codec.CodecConfig
-
- getParquetConfiguration() - Method in class org.apache.parquet.hadoop.api.InitContext
-
- getParquetConfiguration() - Method in class org.apache.parquet.hadoop.rewrite.RewriteOptions
-
- getParquetInputFiles() - Method in class org.apache.parquet.hadoop.rewrite.RewriteOptions
-
- getParquetMetadata() - Method in class org.apache.parquet.hadoop.Footer
-
- getParquetOutputFile() - Method in class org.apache.parquet.hadoop.rewrite.RewriteOptions
-
- getPath() - Method in class org.apache.parquet.crypto.ColumnDecryptionProperties
-
- getPath() - Method in class org.apache.parquet.crypto.ColumnEncryptionProperties
-
- getPath() - Method in class org.apache.parquet.hadoop.metadata.BlockMetaData
-
- getPath() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
-
- getPath() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkProperties
-
- getPath() - Method in class org.apache.parquet.hadoop.ParquetFileReader
-
- getPath() - Method in class org.apache.parquet.hadoop.util.HadoopInputFile
-
- getPath() - Method in class org.apache.parquet.hadoop.util.HadoopOutputFile
-
- getPos() - Method in class org.apache.parquet.hadoop.ParquetFileWriter
-
- getPos() - Method in class org.apache.parquet.hadoop.util.CompressionConverter.TransParquetFileReader
-
Deprecated.
- getPos() - Method in class org.apache.parquet.hadoop.util.HadoopPositionOutputStream
-
- getPrimitive(Type) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
-
- getPrimitiveType() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
-
- getPrimitiveType() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkProperties
-
- getProgress() - Method in class org.apache.parquet.hadoop.ParquetRecordReader
- getProperty(String) - Method in class org.apache.parquet.HadoopReadOptions
-
- getProperty(String) - Method in class org.apache.parquet.ParquetReadOptions
-
- getPropertyNames() - Method in class org.apache.parquet.ParquetReadOptions
-
- getPruneColumns() - Method in class org.apache.parquet.hadoop.rewrite.RewriteOptions
-
- getReadSupport() - Method in class org.apache.parquet.hadoop.ParquetReader.Builder
-
- getReadSupportClass(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetInputFormat
-
- getReadSupportInstance(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetInputFormat
-
- getReadSupportMetadata() - Method in class org.apache.parquet.hadoop.api.ReadSupport.ReadContext
-
- getRecordCount() - Method in class org.apache.parquet.hadoop.ParquetFileReader
-
- getRecordFilter() - Method in class org.apache.parquet.ParquetReadOptions
-
- getRecordReader(InputSplit, JobConf, Reporter) - Method in class org.apache.parquet.hadoop.mapred.DeprecatedParquetInputFormat
-
- getRecordWriter(FileSystem, JobConf, String, Progressable) - Method in class org.apache.parquet.hadoop.mapred.DeprecatedParquetOutputFormat
-
- getRecordWriter(TaskAttemptContext) - Method in class org.apache.parquet.hadoop.ParquetOutputFormat
- getRecordWriter(TaskAttemptContext, ParquetFileWriter.Mode) - Method in class org.apache.parquet.hadoop.ParquetOutputFormat
-
- getRecordWriter(TaskAttemptContext, Path) - Method in class org.apache.parquet.hadoop.ParquetOutputFormat
-
- getRecordWriter(TaskAttemptContext, Path, ParquetFileWriter.Mode) - Method in class org.apache.parquet.hadoop.ParquetOutputFormat
-
- getRecordWriter(Configuration, Path, CompressionCodecName) - Method in class org.apache.parquet.hadoop.ParquetOutputFormat
-
- getRecordWriter(Configuration, Path, CompressionCodecName, ParquetFileWriter.Mode) - Method in class org.apache.parquet.hadoop.ParquetOutputFormat
-
- getRemaining() - Method in class org.apache.parquet.hadoop.codec.NonBlockedDecompressor
-
- getRequestedSchema() - Method in class org.apache.parquet.hadoop.api.ReadSupport.ReadContext
-
- getRowCount() - Method in class org.apache.parquet.hadoop.metadata.BlockMetaData
-
- getRowGroupOffsets() - Method in class org.apache.parquet.hadoop.ParquetInputSplit
-
- getRowGroupOrdinal() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
-
- getRowGroups() - Method in class org.apache.parquet.hadoop.ParquetFileReader
-
- getRowIndexOffset() - Method in class org.apache.parquet.hadoop.metadata.BlockMetaData
-
- getSchema() - Method in class org.apache.parquet.hadoop.api.WriteSupport.WriteContext
-
- getSchema(Job) - Static method in class org.apache.parquet.hadoop.example.ExampleOutputFormat
-
retrieve the schema from the conf
- getSchema(Configuration) - Static method in class org.apache.parquet.hadoop.example.GroupWriteSupport
-
- getSchema(ParquetConfiguration) - Static method in class org.apache.parquet.hadoop.example.GroupWriteSupport
-
- getSchema() - Method in class org.apache.parquet.hadoop.metadata.FileMetaData
-
- getSchema() - Method in class org.apache.parquet.hadoop.metadata.GlobalMetaData
-
- getSchemaForRead(MessageType, String) - Static method in class org.apache.parquet.hadoop.api.ReadSupport
-
attempts to validate and construct a
MessageType
from a read projection schema
- getSchemaForRead(MessageType, MessageType) - Static method in class org.apache.parquet.hadoop.api.ReadSupport
-
- getSignedFooterEncryptor() - Method in class org.apache.parquet.crypto.InternalFileEncryptor
-
- getSizeStatistics() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
-
Method should be considered private
- getSplits(JobConf, int) - Method in class org.apache.parquet.hadoop.mapred.DeprecatedParquetInputFormat
-
- getSplits(JobContext) - Method in class org.apache.parquet.hadoop.ParquetInputFormat
- getSplits(Configuration, List<Footer>) - Method in class org.apache.parquet.hadoop.ParquetInputFormat
-
- getStartingPos() - Method in class org.apache.parquet.hadoop.metadata.BlockMetaData
-
- getStartingPos() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
-
- getStatistics() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
-
- getStream() - Method in class org.apache.parquet.hadoop.util.CompressionConverter.TransParquetFileReader
-
Deprecated.
- getStrings(String, String[]) - Method in class org.apache.parquet.conf.HadoopParquetConfiguration
-
- getTime() - Static method in class org.apache.parquet.hadoop.util.counters.BenchmarkCounter
-
- getTotalBytes() - Static method in class org.apache.parquet.hadoop.util.counters.BenchmarkCounter
-
- getTotalByteSize() - Method in class org.apache.parquet.hadoop.metadata.BlockMetaData
-
- getTotalSize() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
-
- getTotalUncompressedSize() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
-
- getTrimmed(String) - Method in class org.apache.parquet.conf.HadoopParquetConfiguration
-
- getTrimmed(String, String) - Method in class org.apache.parquet.conf.HadoopParquetConfiguration
-
- getType() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
-
- getType() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkProperties
-
- getUnboundRecordFilter(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetInputFormat
-
- getValidation(JobContext) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
-
- getValidation(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
-
- getValue() - Method in enum org.apache.parquet.crypto.ModuleCipherFactory.ModuleType
-
- getValueCount() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
-
- getValueCountThreshold(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
-
- getVectorReads() - Method in class org.apache.parquet.hadoop.util.wrapped.io.VectorIoBridge
-
How many vector read calls have been made?
- getWithEncryptedMetadata(ParquetMetadataConverter, ColumnPath, PrimitiveType, byte[], byte[], InternalFileDecryptor, int, int, String) - Static method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
-
- getWriterVersion(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
-
- getWriteSupport(Configuration) - Method in class org.apache.parquet.hadoop.example.ExampleParquetWriter.Builder
-
- getWriteSupport(ParquetConfiguration) - Method in class org.apache.parquet.hadoop.example.ExampleParquetWriter.Builder
-
- getWriteSupport(Configuration) - Method in class org.apache.parquet.hadoop.ParquetOutputFormat
-
- getWriteSupport(Configuration) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
- getWriteSupport(ParquetConfiguration) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
- getWriteSupportClass(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
-
- GlobalMetaData - Class in org.apache.parquet.hadoop.metadata
-
Merged metadata when reading from multiple files.
- GlobalMetaData(MessageType, Map<String, Set<String>>, Set<String>) - Constructor for class org.apache.parquet.hadoop.metadata.GlobalMetaData
-
- GroupReadSupport - Class in org.apache.parquet.hadoop.example
-
- GroupReadSupport() - Constructor for class org.apache.parquet.hadoop.example.GroupReadSupport
-
- GroupWriteSupport - Class in org.apache.parquet.hadoop.example
-
- GroupWriteSupport() - Constructor for class org.apache.parquet.hadoop.example.GroupWriteSupport
-
- PAGE_ROW_COUNT_LIMIT - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
-
- PAGE_SIZE - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
-
- PAGE_VALUE_COUNT_THRESHOLD - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
-
- PAGE_VERIFY_CHECKSUM_ENABLED - Static variable in class org.apache.parquet.hadoop.ParquetInputFormat
-
key to configure whether page level checksum verification is enabled
- PAGE_WRITE_CHECKSUM_ENABLED - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
-
- pageSize - Variable in class org.apache.parquet.hadoop.CodecFactory
-
- PARQUET_COMMON_METADATA_FILE - Static variable in class org.apache.parquet.hadoop.ParquetFileWriter
-
- PARQUET_COMPRESS_ZSTD_BUFFERPOOL_ENABLED - Static variable in class org.apache.parquet.hadoop.codec.ZstandardCodec
-
- PARQUET_COMPRESS_ZSTD_LEVEL - Static variable in class org.apache.parquet.hadoop.codec.ZstandardCodec
-
- PARQUET_COMPRESS_ZSTD_WORKERS - Static variable in class org.apache.parquet.hadoop.codec.ZstandardCodec
-
- PARQUET_EXAMPLE_SCHEMA - Static variable in class org.apache.parquet.hadoop.example.GroupWriteSupport
-
- PARQUET_METADATA_FILE - Static variable in class org.apache.parquet.hadoop.ParquetFileWriter
-
- PARQUET_READ_PARALLELISM - Static variable in class org.apache.parquet.hadoop.ParquetFileReader
-
- PARQUET_READ_SCHEMA - Static variable in class org.apache.parquet.hadoop.api.ReadSupport
-
configuration key for a parquet read projection schema
- ParquetCipher - Enum in org.apache.parquet.crypto
-
- ParquetCryptoRuntimeException - Exception in org.apache.parquet.crypto
-
Thrown upon encryption or decryption operation problem
- ParquetCryptoRuntimeException() - Constructor for exception org.apache.parquet.crypto.ParquetCryptoRuntimeException
-
- ParquetCryptoRuntimeException(String, Throwable) - Constructor for exception org.apache.parquet.crypto.ParquetCryptoRuntimeException
-
- ParquetCryptoRuntimeException(String) - Constructor for exception org.apache.parquet.crypto.ParquetCryptoRuntimeException
-
- ParquetCryptoRuntimeException(Throwable) - Constructor for exception org.apache.parquet.crypto.ParquetCryptoRuntimeException
-
- ParquetEmptyBlockException - Exception in org.apache.parquet.hadoop
-
- ParquetEmptyBlockException() - Constructor for exception org.apache.parquet.hadoop.ParquetEmptyBlockException
-
- ParquetEmptyBlockException(String, Throwable) - Constructor for exception org.apache.parquet.hadoop.ParquetEmptyBlockException
-
- ParquetEmptyBlockException(String) - Constructor for exception org.apache.parquet.hadoop.ParquetEmptyBlockException
-
- ParquetEmptyBlockException(Throwable) - Constructor for exception org.apache.parquet.hadoop.ParquetEmptyBlockException
-
- ParquetFileReader - Class in org.apache.parquet.hadoop
-
Internal implementation of the Parquet file reader as a block container
- ParquetFileReader(Configuration, Path, List<BlockMetaData>, List<ColumnDescriptor>) - Constructor for class org.apache.parquet.hadoop.ParquetFileReader
-
- ParquetFileReader(Configuration, FileMetaData, Path, List<BlockMetaData>, List<ColumnDescriptor>) - Constructor for class org.apache.parquet.hadoop.ParquetFileReader
-
- ParquetFileReader(Configuration, Path, ParquetMetadataConverter.MetadataFilter) - Constructor for class org.apache.parquet.hadoop.ParquetFileReader
-
- ParquetFileReader(Configuration, Path, ParquetMetadata) - Constructor for class org.apache.parquet.hadoop.ParquetFileReader
-
- ParquetFileReader(Configuration, Path, ParquetMetadata, ParquetReadOptions) - Constructor for class org.apache.parquet.hadoop.ParquetFileReader
-
- ParquetFileReader(InputFile, ParquetReadOptions) - Constructor for class org.apache.parquet.hadoop.ParquetFileReader
-
- ParquetFileReaderMetrics - Enum in org.apache.parquet.hadoop
-
- ParquetFileWriter - Class in org.apache.parquet.hadoop
-
Internal implementation of the Parquet file writer as a block container
- ParquetFileWriter(Configuration, MessageType, Path) - Constructor for class org.apache.parquet.hadoop.ParquetFileWriter
-
- ParquetFileWriter(Configuration, MessageType, Path, ParquetFileWriter.Mode) - Constructor for class org.apache.parquet.hadoop.ParquetFileWriter
-
- ParquetFileWriter(Configuration, MessageType, Path, ParquetFileWriter.Mode, long, int) - Constructor for class org.apache.parquet.hadoop.ParquetFileWriter
-
- ParquetFileWriter(OutputFile, MessageType, ParquetFileWriter.Mode, long, int) - Constructor for class org.apache.parquet.hadoop.ParquetFileWriter
-
- ParquetFileWriter(OutputFile, MessageType, ParquetFileWriter.Mode, long, int, int, int, boolean) - Constructor for class org.apache.parquet.hadoop.ParquetFileWriter
-
- ParquetFileWriter(OutputFile, MessageType, ParquetFileWriter.Mode, long, int, int, int, boolean, FileEncryptionProperties) - Constructor for class org.apache.parquet.hadoop.ParquetFileWriter
-
- ParquetFileWriter(OutputFile, MessageType, ParquetFileWriter.Mode, long, int, FileEncryptionProperties, ParquetProperties) - Constructor for class org.apache.parquet.hadoop.ParquetFileWriter
-
- ParquetFileWriter(OutputFile, MessageType, ParquetFileWriter.Mode, long, int, int, int, boolean, InternalFileEncryptor) - Constructor for class org.apache.parquet.hadoop.ParquetFileWriter
-
Deprecated.
- ParquetFileWriter.Mode - Enum in org.apache.parquet.hadoop
-
- ParquetInputFormat<T> - Class in org.apache.parquet.hadoop
-
The input format to read a Parquet file.
- ParquetInputFormat() - Constructor for class org.apache.parquet.hadoop.ParquetInputFormat
-
Hadoop will instantiate using this constructor
- ParquetInputFormat(Class<S>) - Constructor for class org.apache.parquet.hadoop.ParquetInputFormat
-
Constructor for subclasses, such as AvroParquetInputFormat, or wrappers.
- ParquetInputSplit - Class in org.apache.parquet.hadoop
-
- ParquetInputSplit() - Constructor for class org.apache.parquet.hadoop.ParquetInputSplit
-
Deprecated.
Writables must have a parameterless constructor
- ParquetInputSplit(Path, long, long, String[], List<BlockMetaData>, String, String, Map<String, String>, Map<String, String>) - Constructor for class org.apache.parquet.hadoop.ParquetInputSplit
-
Deprecated.
- ParquetInputSplit(Path, long, long, long, String[], long[]) - Constructor for class org.apache.parquet.hadoop.ParquetInputSplit
-
Deprecated.
- ParquetMemoryManagerRuntimeException - Exception in org.apache.parquet.hadoop
-
Signals that an exception of some sort has occurred with the Parquet Memory
Manager.
- ParquetMemoryManagerRuntimeException(String) - Constructor for exception org.apache.parquet.hadoop.ParquetMemoryManagerRuntimeException
-
- ParquetMetadata - Class in org.apache.parquet.hadoop.metadata
-
Meta Data block stored in the footer of the file
contains file level (Codec, Schema, ...) and block level (location, columns, record count, ...) meta data
- ParquetMetadata(FileMetaData, List<BlockMetaData>) - Constructor for class org.apache.parquet.hadoop.metadata.ParquetMetadata
-
- ParquetMetadataConverter - Class in org.apache.parquet.format.converter
-
- ParquetMetadataConverter() - Constructor for class org.apache.parquet.format.converter.ParquetMetadataConverter
-
- ParquetMetadataConverter(int) - Constructor for class org.apache.parquet.format.converter.ParquetMetadataConverter
-
- ParquetMetadataConverter(Configuration) - Constructor for class org.apache.parquet.format.converter.ParquetMetadataConverter
-
- ParquetMetadataConverter(ParquetReadOptions) - Constructor for class org.apache.parquet.format.converter.ParquetMetadataConverter
-
- ParquetMetadataConverter.MetadataFilter - Class in org.apache.parquet.format.converter
-
- ParquetMetricsCallback - Interface in org.apache.parquet.hadoop
-
A simple interface to pass basic metric values by name to any implementation.
- ParquetOutputCommitter - Class in org.apache.parquet.hadoop
-
- ParquetOutputCommitter(Path, TaskAttemptContext) - Constructor for class org.apache.parquet.hadoop.ParquetOutputCommitter
-
- ParquetOutputFormat<T> - Class in org.apache.parquet.hadoop
-
OutputFormat to write to a Parquet file
- ParquetOutputFormat(S) - Constructor for class org.apache.parquet.hadoop.ParquetOutputFormat
-
constructor used when this OutputFormat in wrapped in another one (In Pig for example)
- ParquetOutputFormat() - Constructor for class org.apache.parquet.hadoop.ParquetOutputFormat
-
used when directly using the output format and configuring the write support implementation
using parquet.write.support.class
- ParquetOutputFormat.JobSummaryLevel - Enum in org.apache.parquet.hadoop
-
- ParquetReader<T> - Class in org.apache.parquet.hadoop
-
Read records from a Parquet file.
- ParquetReader(Path, ReadSupport<T>) - Constructor for class org.apache.parquet.hadoop.ParquetReader
-
- ParquetReader(Configuration, Path, ReadSupport<T>) - Constructor for class org.apache.parquet.hadoop.ParquetReader
-
- ParquetReader(Path, ReadSupport<T>, UnboundRecordFilter) - Constructor for class org.apache.parquet.hadoop.ParquetReader
-
- ParquetReader(Configuration, Path, ReadSupport<T>, UnboundRecordFilter) - Constructor for class org.apache.parquet.hadoop.ParquetReader
-
- ParquetReader.Builder<T> - Class in org.apache.parquet.hadoop
-
- ParquetReadOptions - Class in org.apache.parquet
-
- ParquetReadOptions.Builder - Class in org.apache.parquet
-
- ParquetRecordReader<T> - Class in org.apache.parquet.hadoop
-
Reads the records from a block of a Parquet file
- ParquetRecordReader(ReadSupport<T>) - Constructor for class org.apache.parquet.hadoop.ParquetRecordReader
-
- ParquetRecordReader(ReadSupport<T>, FilterCompat.Filter) - Constructor for class org.apache.parquet.hadoop.ParquetRecordReader
-
- ParquetRecordReader(ReadSupport<T>, UnboundRecordFilter) - Constructor for class org.apache.parquet.hadoop.ParquetRecordReader
-
- ParquetRecordWriter<T> - Class in org.apache.parquet.hadoop
-
Writes records to a Parquet file
- ParquetRecordWriter(ParquetFileWriter, WriteSupport<T>, MessageType, Map<String, String>, int, int, CodecFactory.BytesCompressor, int, boolean, boolean, ParquetProperties.WriterVersion) - Constructor for class org.apache.parquet.hadoop.ParquetRecordWriter
-
Deprecated.
- ParquetRecordWriter(ParquetFileWriter, WriteSupport<T>, MessageType, Map<String, String>, int, int, CompressionCodecFactory.BytesInputCompressor, int, boolean, boolean, ParquetProperties.WriterVersion) - Constructor for class org.apache.parquet.hadoop.ParquetRecordWriter
-
Deprecated.
- ParquetRecordWriter(ParquetFileWriter, WriteSupport<T>, MessageType, Map<String, String>, long, int, CodecFactory.BytesCompressor, int, boolean, boolean, ParquetProperties.WriterVersion, MemoryManager) - Constructor for class org.apache.parquet.hadoop.ParquetRecordWriter
-
Deprecated.
- ParquetRecordWriter(ParquetFileWriter, WriteSupport<T>, MessageType, Map<String, String>, long, int, CompressionCodecFactory.BytesInputCompressor, int, boolean, boolean, ParquetProperties.WriterVersion, MemoryManager) - Constructor for class org.apache.parquet.hadoop.ParquetRecordWriter
-
Deprecated.
- ParquetRewriter - Class in org.apache.parquet.hadoop.rewrite
-
- ParquetRewriter(RewriteOptions) - Constructor for class org.apache.parquet.hadoop.rewrite.ParquetRewriter
-
- ParquetRewriter(CompressionConverter.TransParquetFileReader, ParquetFileWriter, ParquetMetadata, MessageType, String, CompressionCodecName, List<String>, MaskMode) - Constructor for class org.apache.parquet.hadoop.rewrite.ParquetRewriter
-
- ParquetWriter<T> - Class in org.apache.parquet.hadoop
-
Write records to a Parquet file.
- ParquetWriter(Path, WriteSupport<T>, CompressionCodecName, int, int) - Constructor for class org.apache.parquet.hadoop.ParquetWriter
-
- ParquetWriter(Path, WriteSupport<T>, CompressionCodecName, int, int, boolean, boolean) - Constructor for class org.apache.parquet.hadoop.ParquetWriter
-
- ParquetWriter(Path, WriteSupport<T>, CompressionCodecName, int, int, int, boolean, boolean) - Constructor for class org.apache.parquet.hadoop.ParquetWriter
-
- ParquetWriter(Path, WriteSupport<T>, CompressionCodecName, int, int, int, boolean, boolean, ParquetProperties.WriterVersion) - Constructor for class org.apache.parquet.hadoop.ParquetWriter
-
- ParquetWriter(Path, WriteSupport<T>, CompressionCodecName, int, int, int, boolean, boolean, ParquetProperties.WriterVersion, Configuration) - Constructor for class org.apache.parquet.hadoop.ParquetWriter
-
- ParquetWriter(Path, ParquetFileWriter.Mode, WriteSupport<T>, CompressionCodecName, int, int, int, boolean, boolean, ParquetProperties.WriterVersion, Configuration) - Constructor for class org.apache.parquet.hadoop.ParquetWriter
-
- ParquetWriter(Path, WriteSupport<T>) - Constructor for class org.apache.parquet.hadoop.ParquetWriter
-
- ParquetWriter(Path, Configuration, WriteSupport<T>) - Constructor for class org.apache.parquet.hadoop.ParquetWriter
-
Deprecated.
- ParquetWriter.Builder<T,SELF extends ParquetWriter.Builder<T,SELF>> - Class in org.apache.parquet.hadoop
-
An abstract builder class for ParquetWriter instances.
- PLAINTEXT_FOOTER_DEFAULT - Static variable in class org.apache.parquet.crypto.keytools.PropertiesDrivenCryptoFactory
-
- PLAINTEXT_FOOTER_PROPERTY_NAME - Static variable in class org.apache.parquet.crypto.keytools.PropertiesDrivenCryptoFactory
-
Write files with plaintext footer.
- plaintextFile() - Method in class org.apache.parquet.crypto.InternalFileDecryptor
-
- plaintextFilesAllowed() - Method in class org.apache.parquet.crypto.InternalFileDecryptor
-
- positiveLongFitsInAnInt(long) - Static method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
-
checks that a positive long value fits in an int.
- prepareForRead(Configuration, Map<String, String>, MessageType, ReadSupport.ReadContext) - Method in class org.apache.parquet.hadoop.api.DelegatingReadSupport
-
- prepareForRead(ParquetConfiguration, Map<String, String>, MessageType, ReadSupport.ReadContext) - Method in class org.apache.parquet.hadoop.api.DelegatingReadSupport
-
- prepareForRead(Configuration, Map<String, String>, MessageType, ReadSupport.ReadContext) - Method in class org.apache.parquet.hadoop.api.ReadSupport
-
- prepareForRead(ParquetConfiguration, Map<String, String>, MessageType, ReadSupport.ReadContext) - Method in class org.apache.parquet.hadoop.api.ReadSupport
-
called in RecordReader.initialize(org.apache.hadoop.mapreduce.InputSplit, org.apache.hadoop.mapreduce.TaskAttemptContext)
in the back end
the returned RecordMaterializer will materialize the records and add them to the destination
- prepareForRead(Configuration, Map<String, String>, MessageType, ReadSupport.ReadContext) - Method in class org.apache.parquet.hadoop.example.GroupReadSupport
-
- prepareForRead(ParquetConfiguration, Map<String, String>, MessageType, ReadSupport.ReadContext) - Method in class org.apache.parquet.hadoop.example.GroupReadSupport
-
- prepareForWrite(RecordConsumer) - Method in class org.apache.parquet.hadoop.api.DelegatingWriteSupport
-
- prepareForWrite(RecordConsumer) - Method in class org.apache.parquet.hadoop.api.WriteSupport
-
This will be called once per row group
- prepareForWrite(RecordConsumer) - Method in class org.apache.parquet.hadoop.example.GroupWriteSupport
-
- PrintFooter - Class in org.apache.parquet.hadoop
-
Utility to print footer information
- PrintFooter() - Constructor for class org.apache.parquet.hadoop.PrintFooter
-
- processBlocks() - Method in class org.apache.parquet.hadoop.rewrite.ParquetRewriter
-
- processBlocks(CompressionConverter.TransParquetFileReader, ParquetFileWriter, ParquetMetadata, MessageType, List<String>, ColumnMasker.MaskMode) - Method in class org.apache.parquet.hadoop.util.ColumnMasker
-
Deprecated.
- processBlocks(CompressionConverter.TransParquetFileReader, ParquetFileWriter, ParquetMetadata, MessageType, String, CompressionCodecName) - Method in class org.apache.parquet.hadoop.util.CompressionConverter
-
Deprecated.
- properties - Variable in class org.apache.parquet.ParquetReadOptions.Builder
-
- PropertiesDrivenCryptoFactory - Class in org.apache.parquet.crypto.keytools
-
- PropertiesDrivenCryptoFactory() - Constructor for class org.apache.parquet.crypto.keytools.PropertiesDrivenCryptoFactory
-
- prune(List<String>) - Method in class org.apache.parquet.hadoop.rewrite.RewriteOptions.Builder
-
Set the columns to prune.
- pruneColumns(Configuration, Path, Path, List<String>) - Method in class org.apache.parquet.hadoop.util.ColumnPruner
-
Deprecated.
- randomGenerator - Variable in class org.apache.parquet.crypto.AesCipher
-
- range(long, long) - Static method in class org.apache.parquet.format.converter.ParquetMetadataConverter
-
[ startOffset, endOffset )
- read(byte[], int, int) - Method in class org.apache.parquet.hadoop.codec.NonBlockedDecompressorStream
-
- read(byte[], int, int) - Method in class org.apache.parquet.hadoop.codec.ZstdDecompressorStream
-
- read() - Method in class org.apache.parquet.hadoop.codec.ZstdDecompressorStream
-
- read() - Method in class org.apache.parquet.hadoop.ParquetReader
-
- read(InputFile) - Static method in class org.apache.parquet.hadoop.ParquetReader
-
- read(InputFile, ParquetConfiguration) - Static method in class org.apache.parquet.hadoop.ParquetReader
-
- READ_SUPPORT_CLASS - Static variable in class org.apache.parquet.hadoop.ParquetInputFormat
-
key to configure the ReadSupport implementation
- readAllFootersInParallel(Configuration, List<FileStatus>) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
-
- readAllFootersInParallel(Configuration, List<FileStatus>, boolean) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
-
- readAllFootersInParallel(Configuration, FileStatus, boolean) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
-
- readAllFootersInParallel(Configuration, FileStatus) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
-
- readAllFootersInParallelUsingSummaryFiles(Configuration, List<FileStatus>) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
-
- readAllFootersInParallelUsingSummaryFiles(Configuration, Collection<FileStatus>, boolean) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
-
- readBlock(int, CompressionConverter.TransParquetFileReader) - Method in class org.apache.parquet.hadoop.rewrite.ParquetRewriter
-
- readBlock(int, CompressionConverter.TransParquetFileReader) - Method in class org.apache.parquet.hadoop.util.ColumnEncryptor
-
Deprecated.
- readBlock(int, CompressionConverter.TransParquetFileReader) - Method in class org.apache.parquet.hadoop.util.CompressionConverter
-
Deprecated.
- readBlockAllocate(int, CompressionConverter.TransParquetFileReader) - Method in class org.apache.parquet.hadoop.rewrite.ParquetRewriter
-
- readBlockAllocate(int, CompressionConverter.TransParquetFileReader) - Method in class org.apache.parquet.hadoop.util.ColumnEncryptor
-
Deprecated.
- readBlockAllocate(int, CompressionConverter.TransParquetFileReader) - Method in class org.apache.parquet.hadoop.util.CompressionConverter
-
Deprecated.
- readBloomFilter(ColumnChunkMetaData) - Method in class org.apache.parquet.hadoop.BloomFilterReader
-
- readBloomFilter(ColumnChunkMetaData) - Method in class org.apache.parquet.hadoop.ParquetFileReader
-
Reads Bloom filter data for the given column chunk.
- readColumnIndex(ColumnChunkMetaData) - Method in class org.apache.parquet.hadoop.ParquetFileReader
-
Class should be considered private
- ReadContext(MessageType) - Constructor for class org.apache.parquet.hadoop.api.ReadSupport.ReadContext
-
- ReadContext(MessageType, Map<String, String>) - Constructor for class org.apache.parquet.hadoop.api.ReadSupport.ReadContext
-
- readFields(DataInput) - Method in class org.apache.parquet.hadoop.ParquetInputSplit
-
Deprecated.
- readFilteredRowGroup(int) - Method in class org.apache.parquet.hadoop.ParquetFileReader
-
Reads all the columns requested from the specified row group.
- readFilteredRowGroup(int, RowRanges) - Method in class org.apache.parquet.hadoop.ParquetFileReader
-
Reads all the columns requested from the specified row group.
- readFooter(Configuration, Path) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
-
- readFooter(Configuration, Path, ParquetMetadataConverter.MetadataFilter) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
-
- readFooter(Configuration, FileStatus) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
-
- readFooter(Configuration, FileStatus, ParquetMetadataConverter.MetadataFilter) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
-
- readFooter(InputFile, ParquetMetadataConverter.MetadataFilter) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
-
- readFooter(InputFile, ParquetReadOptions, SeekableInputStream) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
-
- readFooters(Configuration, Path) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
-
- readFooters(Configuration, FileStatus) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
-
- readFooters(Configuration, FileStatus, boolean) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
-
- readNextFilteredRowGroup() - Method in class org.apache.parquet.hadoop.ParquetFileReader
-
Reads all the columns requested from the row group at the current file position.
- readNextRowGroup() - Method in class org.apache.parquet.hadoop.ParquetFileReader
-
Reads all the columns requested from the row group at the current file position.
- readObjectFromConfAsBase64(String, Configuration) - Static method in class org.apache.parquet.hadoop.util.SerializationUtil
-
- readObjectFromConfAsBase64(String, ParquetConfiguration) - Static method in class org.apache.parquet.hadoop.util.SerializationUtil
-
- readOffsetIndex(ColumnChunkMetaData) - Method in class org.apache.parquet.hadoop.ParquetFileReader
-
Class should be considered private
- readPageHeader() - Method in class org.apache.parquet.hadoop.util.CompressionConverter.TransParquetFileReader
-
Deprecated.
- readParquetMetadata(InputStream) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
-
Deprecated.
- readParquetMetadata(InputStream, ParquetMetadataConverter.MetadataFilter) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
-
- readParquetMetadata(InputStream, ParquetMetadataConverter.MetadataFilter, InternalFileDecryptor, boolean, int) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
-
- readRowGroup(int) - Method in class org.apache.parquet.hadoop.ParquetFileReader
-
Reads all the columns requested from the row group at the specified block.
- readSummaryFile(Configuration, FileStatus) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
-
- ReadSupport<T> - Class in org.apache.parquet.hadoop.api
-
- ReadSupport() - Constructor for class org.apache.parquet.hadoop.api.ReadSupport
-
- ReadSupport.ReadContext - Class in org.apache.parquet.hadoop.api
-
information to read the file
- readVectoredAvailable(FSDataInputStream, ByteBufferAllocator) - Method in class org.apache.parquet.hadoop.util.wrapped.io.VectorIoBridge
-
Is the vectored IO API available for the given stream
and allocator in this Hadoop runtime?
- readVectoredRanges(FSDataInputStream, List<ParquetFileRange>, ByteBufferAllocator) - Method in class org.apache.parquet.hadoop.util.wrapped.io.VectorIoBridge
-
Read fully a list of file ranges asynchronously from this file.
- realInputFormat - Variable in class org.apache.parquet.hadoop.mapred.DeprecatedParquetInputFormat
-
- realOutputFormat - Variable in class org.apache.parquet.hadoop.mapred.DeprecatedParquetOutputFormat
-
- RECORD_FILTERING_ENABLED - Static variable in class org.apache.parquet.hadoop.ParquetInputFormat
-
key to configure whether record-level filtering is enabled
- recordFilter - Variable in class org.apache.parquet.ParquetReadOptions.Builder
-
- registerScaleCallBack(String, Runnable) - Method in class org.apache.parquet.hadoop.MemoryManager
-
Register callback and deduplicate it if any.
- reinit(Configuration) - Method in class org.apache.parquet.hadoop.codec.NonBlockedCompressor
-
- release() - Method in class org.apache.parquet.hadoop.CodecFactory.BytesCompressor
-
Deprecated.
- release() - Method in class org.apache.parquet.hadoop.CodecFactory.BytesDecompressor
-
Deprecated.
- release() - Method in class org.apache.parquet.hadoop.CodecFactory
-
- removeCacheEntriesForAllTokens() - Static method in class org.apache.parquet.crypto.keytools.KeyToolkit
-
- removeCacheEntriesForToken(String) - Static method in class org.apache.parquet.crypto.keytools.KeyToolkit
-
Flush any caches that are tied to the (compromised) accessToken
- removeMaterial() - Method in interface org.apache.parquet.crypto.keytools.FileKeyMaterialStore
-
Remove key material from persistent store.
- removeMaterial() - Method in class org.apache.parquet.crypto.keytools.HadoopFSKeyMaterialStore
-
- reset() - Method in class org.apache.parquet.hadoop.codec.NonBlockedCompressor
-
- reset() - Method in class org.apache.parquet.hadoop.codec.NonBlockedDecompressor
-
- resetState() - Method in class org.apache.parquet.hadoop.codec.ZstdCompressorStream
-
- resetState() - Method in class org.apache.parquet.hadoop.codec.ZstdDecompressorStream
-
- RewriteOptions - Class in org.apache.parquet.hadoop.rewrite
-
A set of options to create a ParquetRewriter.
- RewriteOptions.Builder - Class in org.apache.parquet.hadoop.rewrite
-
- rotateMasterKeys(String, Configuration) - Static method in class org.apache.parquet.crypto.keytools.KeyToolkit
-
Key rotation.
- RowGroupFilter - Class in org.apache.parquet.filter2.compat
-
- RowGroupFilter.FilterLevel - Enum in org.apache.parquet.filter2.compat
-
- rowGroupOrdinal - Variable in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
-
- validateBuffer(byte[], int, int) - Static method in class org.apache.parquet.hadoop.codec.SnappyUtil
-
- VALIDATION - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
-
- valueOf(String) - Static method in enum org.apache.parquet.crypto.AesMode
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum org.apache.parquet.crypto.ModuleCipherFactory.ModuleType
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum org.apache.parquet.crypto.ParquetCipher
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum org.apache.parquet.filter2.compat.RowGroupFilter.FilterLevel
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum org.apache.parquet.hadoop.ColumnIndexValidator.Contract
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum org.apache.parquet.hadoop.IndexCache.CacheStrategy
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum org.apache.parquet.hadoop.metadata.FileMetaData.EncryptionType
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum org.apache.parquet.hadoop.ParquetFileReaderMetrics
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum org.apache.parquet.hadoop.ParquetFileWriter.Mode
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum org.apache.parquet.hadoop.ParquetOutputFormat.JobSummaryLevel
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum org.apache.parquet.hadoop.rewrite.MaskMode
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum org.apache.parquet.hadoop.util.ColumnMasker.MaskMode
-
Deprecated.
Returns the enum constant of this type with the specified name.
- values() - Static method in enum org.apache.parquet.crypto.AesMode
-
Returns an array containing the constants of this enum type, in
the order they are declared.
- values() - Static method in enum org.apache.parquet.crypto.ModuleCipherFactory.ModuleType
-
Returns an array containing the constants of this enum type, in
the order they are declared.
- values() - Static method in enum org.apache.parquet.crypto.ParquetCipher
-
Returns an array containing the constants of this enum type, in
the order they are declared.
- values() - Static method in enum org.apache.parquet.filter2.compat.RowGroupFilter.FilterLevel
-
Returns an array containing the constants of this enum type, in
the order they are declared.
- values() - Static method in enum org.apache.parquet.hadoop.ColumnIndexValidator.Contract
-
Returns an array containing the constants of this enum type, in
the order they are declared.
- values() - Static method in enum org.apache.parquet.hadoop.IndexCache.CacheStrategy
-
Returns an array containing the constants of this enum type, in
the order they are declared.
- values() - Static method in enum org.apache.parquet.hadoop.metadata.FileMetaData.EncryptionType
-
Returns an array containing the constants of this enum type, in
the order they are declared.
- values() - Static method in enum org.apache.parquet.hadoop.ParquetFileReaderMetrics
-
Returns an array containing the constants of this enum type, in
the order they are declared.
- values() - Static method in enum org.apache.parquet.hadoop.ParquetFileWriter.Mode
-
Returns an array containing the constants of this enum type, in
the order they are declared.
- values() - Static method in enum org.apache.parquet.hadoop.ParquetOutputFormat.JobSummaryLevel
-
Returns an array containing the constants of this enum type, in
the order they are declared.
- values() - Static method in enum org.apache.parquet.hadoop.rewrite.MaskMode
-
Returns an array containing the constants of this enum type, in
the order they are declared.
- values() - Static method in enum org.apache.parquet.hadoop.util.ColumnMasker.MaskMode
-
Deprecated.
Returns an array containing the constants of this enum type, in
the order they are declared.
- VectorIoBridge - Class in org.apache.parquet.hadoop.util.wrapped.io
-
Vector IO bridge.
- verify(byte[]) - Method in interface org.apache.parquet.crypto.AADPrefixVerifier
-
Verifies identity (AAD Prefix) of individual file, or of file collection in a data set.
- visit(Operators.Eq<T>) - Method in class org.apache.parquet.filter2.bloomfilterlevel.BloomFilterImpl
-
- visit(Operators.NotEq<T>) - Method in class org.apache.parquet.filter2.bloomfilterlevel.BloomFilterImpl
-
- visit(Operators.Lt<T>) - Method in class org.apache.parquet.filter2.bloomfilterlevel.BloomFilterImpl
-
- visit(Operators.LtEq<T>) - Method in class org.apache.parquet.filter2.bloomfilterlevel.BloomFilterImpl
-
- visit(Operators.Gt<T>) - Method in class org.apache.parquet.filter2.bloomfilterlevel.BloomFilterImpl
-
- visit(Operators.GtEq<T>) - Method in class org.apache.parquet.filter2.bloomfilterlevel.BloomFilterImpl
-
- visit(Operators.In<T>) - Method in class org.apache.parquet.filter2.bloomfilterlevel.BloomFilterImpl
-
- visit(Operators.NotIn<T>) - Method in class org.apache.parquet.filter2.bloomfilterlevel.BloomFilterImpl
-
- visit(Operators.And) - Method in class org.apache.parquet.filter2.bloomfilterlevel.BloomFilterImpl
-
- visit(Operators.Or) - Method in class org.apache.parquet.filter2.bloomfilterlevel.BloomFilterImpl
-
- visit(Operators.Not) - Method in class org.apache.parquet.filter2.bloomfilterlevel.BloomFilterImpl
-
- visit(Operators.UserDefined<T, U>) - Method in class org.apache.parquet.filter2.bloomfilterlevel.BloomFilterImpl
-
- visit(Operators.LogicalNotUserDefined<T, U>) - Method in class org.apache.parquet.filter2.bloomfilterlevel.BloomFilterImpl
-
- visit(FilterCompat.FilterPredicateCompat) - Method in class org.apache.parquet.filter2.compat.RowGroupFilter
-
- visit(FilterCompat.UnboundRecordFilterCompat) - Method in class org.apache.parquet.filter2.compat.RowGroupFilter
-
- visit(FilterCompat.NoOpFilter) - Method in class org.apache.parquet.filter2.compat.RowGroupFilter
-
- visit(Operators.Eq<T>) - Method in class org.apache.parquet.filter2.dictionarylevel.DictionaryFilter
-
- visit(Operators.NotEq<T>) - Method in class org.apache.parquet.filter2.dictionarylevel.DictionaryFilter
-
- visit(Operators.Lt<T>) - Method in class org.apache.parquet.filter2.dictionarylevel.DictionaryFilter
-
- visit(Operators.LtEq<T>) - Method in class org.apache.parquet.filter2.dictionarylevel.DictionaryFilter
-
- visit(Operators.Gt<T>) - Method in class org.apache.parquet.filter2.dictionarylevel.DictionaryFilter
-
- visit(Operators.GtEq<T>) - Method in class org.apache.parquet.filter2.dictionarylevel.DictionaryFilter
-
- visit(Operators.In<T>) - Method in class org.apache.parquet.filter2.dictionarylevel.DictionaryFilter
-
- visit(Operators.NotIn<T>) - Method in class org.apache.parquet.filter2.dictionarylevel.DictionaryFilter
-
- visit(Operators.And) - Method in class org.apache.parquet.filter2.dictionarylevel.DictionaryFilter
-
- visit(Operators.Or) - Method in class org.apache.parquet.filter2.dictionarylevel.DictionaryFilter
-
- visit(Operators.Not) - Method in class org.apache.parquet.filter2.dictionarylevel.DictionaryFilter
-
- visit(Operators.UserDefined<T, U>) - Method in class org.apache.parquet.filter2.dictionarylevel.DictionaryFilter
-
- visit(Operators.LogicalNotUserDefined<T, U>) - Method in class org.apache.parquet.filter2.dictionarylevel.DictionaryFilter
-
- visit(Operators.Eq<T>) - Method in class org.apache.parquet.filter2.statisticslevel.StatisticsFilter
-
- visit(Operators.In<T>) - Method in class org.apache.parquet.filter2.statisticslevel.StatisticsFilter
-
- visit(Operators.NotIn<T>) - Method in class org.apache.parquet.filter2.statisticslevel.StatisticsFilter
-
- visit(Operators.NotEq<T>) - Method in class org.apache.parquet.filter2.statisticslevel.StatisticsFilter
-
- visit(Operators.Lt<T>) - Method in class org.apache.parquet.filter2.statisticslevel.StatisticsFilter
-
- visit(Operators.LtEq<T>) - Method in class org.apache.parquet.filter2.statisticslevel.StatisticsFilter
-
- visit(Operators.Gt<T>) - Method in class org.apache.parquet.filter2.statisticslevel.StatisticsFilter
-
- visit(Operators.GtEq<T>) - Method in class org.apache.parquet.filter2.statisticslevel.StatisticsFilter
-
- visit(Operators.And) - Method in class org.apache.parquet.filter2.statisticslevel.StatisticsFilter
-
- visit(Operators.Or) - Method in class org.apache.parquet.filter2.statisticslevel.StatisticsFilter
-
- visit(Operators.Not) - Method in class org.apache.parquet.filter2.statisticslevel.StatisticsFilter
-
- visit(Operators.UserDefined<T, U>) - Method in class org.apache.parquet.filter2.statisticslevel.StatisticsFilter
-
- visit(Operators.LogicalNotUserDefined<T, U>) - Method in class org.apache.parquet.filter2.statisticslevel.StatisticsFilter
-
- withAADPrefix(byte[]) - Method in class org.apache.parquet.crypto.FileDecryptionProperties.Builder
-
Explicitly supply the file AAD prefix.
- withAADPrefix(byte[]) - Method in class org.apache.parquet.crypto.FileEncryptionProperties.Builder
-
Set the file AAD Prefix.
- withAADPrefixVerifier(AADPrefixVerifier) - Method in class org.apache.parquet.crypto.FileDecryptionProperties.Builder
-
Set callback for verification of AAD Prefixes stored in file.
- withAdaptiveBloomFilterEnabled(boolean) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
When NDV (number of distinct values) for a specified column is not set, whether to use
`AdaptiveBloomFilter` to automatically adjust the BloomFilter size according to `parquet.bloom.filter.max.bytes`
- withAlgorithm(ParquetCipher) - Method in class org.apache.parquet.crypto.FileEncryptionProperties.Builder
-
Set encryption algorithm.
- withAllocator(ByteBufferAllocator) - Method in class org.apache.parquet.hadoop.ParquetReader.Builder
-
- withAllocator(ByteBufferAllocator) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
Sets the ByteBuffer allocator instance to be used for allocating memory for writing.
- withAllocator(ByteBufferAllocator) - Method in class org.apache.parquet.ParquetReadOptions.Builder
-
- withBloomFilterCandidateNumber(String, int) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
When `AdaptiveBloomFilter` is enabled, set how many bloom filter candidates to use.
- withBloomFilterEnabled(boolean) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
Sets the bloom filter enabled/disabled
- withBloomFilterEnabled(String, boolean) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
Sets the bloom filter enabled/disabled for the specified column.
- withBloomFilterFPP(String, double) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
- withBloomFilterNDV(String, long) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
Sets the NDV (number of distinct values) for the specified column.
- withByteStreamSplitEncoding(boolean) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
- withCodecFactory(CompressionCodecFactory) - Method in class org.apache.parquet.hadoop.ParquetReader.Builder
-
- withCodecFactory(CompressionCodecFactory) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
- withCodecFactory(CompressionCodecFactory) - Method in class org.apache.parquet.ParquetReadOptions.Builder
-
- withColumnIndexTruncateLength(int) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
Sets the length to be used for truncating binary values in a binary column index.
- withColumnKeys(Map<ColumnPath, ColumnDecryptionProperties>) - Method in class org.apache.parquet.crypto.FileDecryptionProperties.Builder
-
Set explicit column keys (decryption properties).
- withCompleteColumnEncryption() - Method in class org.apache.parquet.crypto.FileEncryptionProperties.Builder
-
- withCompressionCodec(CompressionCodecName) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
- withConf(Configuration) - Method in class org.apache.parquet.hadoop.ParquetReader.Builder
-
- withConf(ParquetConfiguration) - Method in class org.apache.parquet.hadoop.ParquetReader.Builder
-
- withConf(Configuration) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
Set the Configuration
used by the constructed writer.
- withConf(ParquetConfiguration) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
- withDecryption(FileDecryptionProperties) - Method in class org.apache.parquet.hadoop.ParquetReader.Builder
-
- withDecryption(FileDecryptionProperties) - Method in class org.apache.parquet.ParquetReadOptions.Builder
-
- withDictionaryEncoding(boolean) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
Enable or disable dictionary encoding for the constructed writer.
- withDictionaryEncoding(String, boolean) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
Enable or disable dictionary encoding of the specified column for the constructed writer.
- withDictionaryPageSize(int) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
Set the Parquet format dictionary page size used by the constructed
writer.
- withEncryptedColumns(Map<ColumnPath, ColumnEncryptionProperties>) - Method in class org.apache.parquet.crypto.FileEncryptionProperties.Builder
-
Set the list of encrypted columns and their properties (keys etc).
- withEncryption(FileEncryptionProperties) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
- withExtraMetaData(Map<String, String>) - Method in class org.apache.parquet.hadoop.example.ExampleParquetWriter.Builder
-
- withExtraMetaData(Map<String, String>) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
Sets additional metadata entries to be included in the file footer.
- withFileRange(long, long) - Method in class org.apache.parquet.hadoop.ParquetReader.Builder
-
- withFilter(FilterCompat.Filter) - Method in class org.apache.parquet.hadoop.ParquetReader.Builder
-
- withFooterKey(byte[]) - Method in class org.apache.parquet.crypto.FileDecryptionProperties.Builder
-
Set an explicit footer key.
- withFooterKeyID(String) - Method in class org.apache.parquet.crypto.FileEncryptionProperties.Builder
-
Set a key retrieval metadata (converted from String).
- withFooterKeyMetadata(byte[]) - Method in class org.apache.parquet.crypto.FileEncryptionProperties.Builder
-
Set a key retrieval metadata.
- withKey(byte[]) - Method in class org.apache.parquet.crypto.ColumnDecryptionProperties.Builder
-
Set an explicit column key.
- withKey(byte[]) - Method in class org.apache.parquet.crypto.ColumnEncryptionProperties.Builder
-
Set a column-specific key.
- withKeyID(String) - Method in class org.apache.parquet.crypto.ColumnEncryptionProperties.Builder
-
Set a key retrieval metadata (converted from String).
- withKeyMetaData(byte[]) - Method in class org.apache.parquet.crypto.ColumnEncryptionProperties.Builder
-
Set a key retrieval metadata.
- withKeyRetriever(DecryptionKeyRetriever) - Method in class org.apache.parquet.crypto.FileDecryptionProperties.Builder
-
Set a key retriever callback.
- withMaxAllocationInBytes(int) - Method in class org.apache.parquet.ParquetReadOptions.Builder
-
- withMaxBloomFilterBytes(int) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
Set max Bloom filter bytes for related columns.
- withMaxPaddingSize(int) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
Set the maximum amount of padding, in bytes, that will be used to align
row groups with blocks in the underlying filesystem.
- withMaxRowCountForPageSizeCheck(int) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
Sets the maximum number of rows to write before a page size check is done.
- withMetadataFilter(ParquetMetadataConverter.MetadataFilter) - Method in class org.apache.parquet.ParquetReadOptions.Builder
-
- withMetricsCallback(ParquetMetricsCallback) - Method in class org.apache.parquet.ParquetReadOptions.Builder
-
- withMinRowCountForPageSizeCheck(int) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
Sets the minimum number of rows to write before a page size check is done.
- withOffsets(long...) - Method in class org.apache.parquet.ParquetReadOptions.Builder
-
- withoutAADPrefixStorage() - Method in class org.apache.parquet.crypto.FileEncryptionProperties.Builder
-
Skip storing AAD Prefix in file metadata.
- withoutFooterSignatureVerification() - Method in class org.apache.parquet.crypto.FileDecryptionProperties.Builder
-
Skip integrity verification of plaintext footers.
- withPageChecksumVerification(boolean) - Method in class org.apache.parquet.ParquetReadOptions.Builder
-
- withPageRowCountLimit(int) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
Sets the Parquet format page row count limit used by the constructed writer.
- withPageSize(int) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
Set the Parquet format page size used by the constructed writer.
- withPageWriteChecksumEnabled(boolean) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
Enables writing page level checksums for the constructed writer.
- withPlaintextFilesAllowed() - Method in class org.apache.parquet.crypto.FileDecryptionProperties.Builder
-
By default, reading plaintext (unencrypted) files is not allowed when using a decryptor
- in order to detect files that were not encrypted by mistake.
- withPlaintextFooter() - Method in class org.apache.parquet.crypto.FileEncryptionProperties.Builder
-
Create files with plaintext footer.
- withRange(long, long) - Method in class org.apache.parquet.ParquetReadOptions.Builder
-
- withRecordFilter(FilterCompat.Filter) - Method in class org.apache.parquet.ParquetReadOptions.Builder
-
- withRowGroupSize(int) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
- withRowGroupSize(long) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
Set the Parquet format row group size used by the constructed writer.
- withStatisticsTruncateLength(int) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
Sets the length which the min/max binary values in row groups are truncated to.
- withType(MessageType) - Method in class org.apache.parquet.hadoop.example.ExampleParquetWriter.Builder
-
- withUseHadoopVectoredIo(boolean) - Method in class org.apache.parquet.ParquetReadOptions.Builder
-
- withValidation(boolean) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
Enable or disable validation for the constructed writer.
- withWriteMode(ParquetFileWriter.Mode) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
Set the
write mode
used when creating the
backing file for this writer.
- withWriterVersion(ParquetProperties.WriterVersion) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
- wrap(FSDataInputStream) - Static method in class org.apache.parquet.hadoop.util.HadoopStreams
-
- wrap(FSDataOutputStream) - Static method in class org.apache.parquet.hadoop.util.HadoopStreams
-
- wrapKey(byte[], String) - Method in interface org.apache.parquet.crypto.keytools.KmsClient
-
Wraps a key - encrypts it with the master key, encodes the result
and potentially adds a KMS-specific metadata.
- wrapKey(byte[], String) - Method in class org.apache.parquet.crypto.keytools.LocalWrapKmsClient
-
- write(T) - Method in class org.apache.parquet.hadoop.api.DelegatingWriteSupport
-
- write(T) - Method in class org.apache.parquet.hadoop.api.WriteSupport
-
called once per record
- write(byte[], int, int) - Method in class org.apache.parquet.hadoop.codec.NonBlockedCompressorStream
-
- write(byte[], int, int) - Method in class org.apache.parquet.hadoop.codec.ZstdCompressorStream
-
- write(int) - Method in class org.apache.parquet.hadoop.codec.ZstdCompressorStream
-
- write(Group) - Method in class org.apache.parquet.hadoop.example.GroupWriteSupport
-
- write(DataOutput) - Method in class org.apache.parquet.hadoop.ParquetInputSplit
-
Deprecated.
- write(Void, T) - Method in class org.apache.parquet.hadoop.ParquetRecordWriter
- write(T) - Method in class org.apache.parquet.hadoop.ParquetWriter
-
- write(int) - Method in class org.apache.parquet.hadoop.util.HadoopPositionOutputStream
-
- write(byte[]) - Method in class org.apache.parquet.hadoop.util.HadoopPositionOutputStream
-
- write(byte[], int, int) - Method in class org.apache.parquet.hadoop.util.HadoopPositionOutputStream
-
- WRITE_SUPPORT_CLASS - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
-
- WriteContext(MessageType, Map<String, String>) - Constructor for class org.apache.parquet.hadoop.api.WriteSupport.WriteContext
-
- writeDataPage(int, int, BytesInput, Encoding, Encoding, Encoding) - Method in class org.apache.parquet.hadoop.ParquetFileWriter
-
Deprecated.
- writeDataPage(int, int, BytesInput, Statistics<?>, Encoding, Encoding, Encoding) - Method in class org.apache.parquet.hadoop.ParquetFileWriter
-
- writeDataPage(int, int, BytesInput, Statistics<?>, long, Encoding, Encoding, Encoding) - Method in class org.apache.parquet.hadoop.ParquetFileWriter
-
Writes a single page
- writeDataPage(int, int, BytesInput, Statistics<?>, long, Encoding, Encoding, Encoding, BlockCipher.Encryptor, byte[]) - Method in class org.apache.parquet.hadoop.ParquetFileWriter
-
Writes a single page
- writeDataPage(int, int, BytesInput, Statistics<?>, long, Encoding, Encoding, Encoding, BlockCipher.Encryptor, byte[], SizeStatistics) - Method in class org.apache.parquet.hadoop.ParquetFileWriter
-
Writes a single page
- writeDataPage(int, int, BytesInput, Statistics<?>, Encoding, Encoding, Encoding, BlockCipher.Encryptor, byte[]) - Method in class org.apache.parquet.hadoop.ParquetFileWriter
-
writes a single page
- writeDataPage(int, int, BytesInput, Statistics<?>, Encoding, Encoding, Encoding, BlockCipher.Encryptor, byte[], SizeStatistics) - Method in class org.apache.parquet.hadoop.ParquetFileWriter
-
writes a single page
- writeDataPageHeader(int, int, int, Encoding, Encoding, Encoding, OutputStream) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
-
Deprecated.
- writeDataPageHeader(int, int, int, Statistics, Encoding, Encoding, Encoding, OutputStream) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
-
Deprecated.
- writeDataPageV1Header(int, int, int, Encoding, Encoding, Encoding, OutputStream) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
-
- writeDataPageV1Header(int, int, int, Encoding, Encoding, Encoding, OutputStream, BlockCipher.Encryptor, byte[]) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
-
- writeDataPageV1Header(int, int, int, Encoding, Encoding, Encoding, int, OutputStream) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
-
- writeDataPageV1Header(int, int, int, Encoding, Encoding, Encoding, int, OutputStream, BlockCipher.Encryptor, byte[]) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
-
- writeDataPageV2(int, int, int, BytesInput, BytesInput, Encoding, BytesInput, int, Statistics<?>) - Method in class org.apache.parquet.hadoop.ParquetFileWriter
-
Writes a single v2 data page
- writeDataPageV2(int, int, int, BytesInput, BytesInput, Encoding, BytesInput, int, Statistics<?>, BlockCipher.Encryptor, byte[]) - Method in class org.apache.parquet.hadoop.ParquetFileWriter
-
Writes a single v2 data page
- writeDataPageV2(int, int, int, BytesInput, BytesInput, Encoding, BytesInput, int, Statistics<?>, BlockCipher.Encryptor, byte[], SizeStatistics) - Method in class org.apache.parquet.hadoop.ParquetFileWriter
-
Writes a single v2 data page
- writeDataPageV2Header(int, int, int, int, int, Statistics, Encoding, int, int, OutputStream) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
-
Deprecated.
- writeDataPageV2Header(int, int, int, int, int, Encoding, int, int, OutputStream) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
-
- writeDataPageV2Header(int, int, int, int, int, Encoding, int, int, OutputStream, BlockCipher.Encryptor, byte[]) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
-
- writeDataPageV2Header(int, int, int, int, int, Encoding, int, int, int, OutputStream, BlockCipher.Encryptor, byte[]) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
-
- writeDictionaryPage(DictionaryPage) - Method in class org.apache.parquet.hadoop.ParquetFileWriter
-
writes a dictionary page
- writeDictionaryPage(DictionaryPage, BlockCipher.Encryptor, byte[]) - Method in class org.apache.parquet.hadoop.ParquetFileWriter
-
- writeDictionaryPageHeader(int, int, int, Encoding, OutputStream) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
-
- writeDictionaryPageHeader(int, int, int, Encoding, OutputStream, BlockCipher.Encryptor, byte[]) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
-
- writeDictionaryPageHeader(int, int, int, Encoding, int, OutputStream) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
-
- writeDictionaryPageHeader(int, int, int, Encoding, int, OutputStream, BlockCipher.Encryptor, byte[]) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
-
- writeMergedMetadataFile(List<Path>, Path, Configuration) - Static method in class org.apache.parquet.hadoop.ParquetFileWriter
-
- writeMetadataFile(Configuration, Path, List<Footer>) - Static method in class org.apache.parquet.hadoop.ParquetFileWriter
-
- writeMetadataFile(Configuration, Path, List<Footer>, ParquetOutputFormat.JobSummaryLevel) - Static method in class org.apache.parquet.hadoop.ParquetFileWriter
-
- writeMetaDataFile(Configuration, Path) - Static method in class org.apache.parquet.hadoop.ParquetOutputCommitter
-
- writeObjectToConfAsBase64(String, Object, Configuration) - Static method in class org.apache.parquet.hadoop.util.SerializationUtil
-
Writes an object to a configuration.
- WRITER_VERSION - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
-
- WriteSupport<T> - Class in org.apache.parquet.hadoop.api
-
- WriteSupport() - Constructor for class org.apache.parquet.hadoop.api.WriteSupport
-
- WriteSupport.FinalizedWriteContext - Class in org.apache.parquet.hadoop.api
-
Information to be added in the file once all the records have been written
- WriteSupport.WriteContext - Class in org.apache.parquet.hadoop.api
-
information to be persisted in the file