A B C D E F G H I J K L M N O P Q R S T U V W Z
All Classes All Packages
All Classes All Packages
All Classes All Packages
A
- AADPrefixVerifier - Interface in org.apache.parquet.crypto
- accept(Path) - Method in class org.apache.parquet.hadoop.util.HiddenFileFilter
- addColumn(ColumnChunkMetaData) - Method in class org.apache.parquet.hadoop.metadata.BlockMetaData
- addKeyMaterial(String, String) - Method in interface org.apache.parquet.crypto.keytools.FileKeyMaterialStore
-
Add key material for one encryption key.
- addKeyMaterial(String, String) - Method in class org.apache.parquet.crypto.keytools.HadoopFSKeyMaterialStore
- AES_GCM_CTR_V1 - org.apache.parquet.crypto.ParquetCipher
- AES_GCM_V1 - org.apache.parquet.crypto.ParquetCipher
- AesCipher - Class in org.apache.parquet.crypto
- AesCtrDecryptor - Class in org.apache.parquet.crypto
- AesCtrEncryptor - Class in org.apache.parquet.crypto
- AesGcmDecryptor - Class in org.apache.parquet.crypto
- AesGcmEncryptor - Class in org.apache.parquet.crypto
- aesKey - Variable in class org.apache.parquet.crypto.AesCipher
- AesMode - Enum in org.apache.parquet.crypto
- ALL - org.apache.parquet.hadoop.ParquetOutputFormat.JobSummaryLevel
-
Write both summary file with row group info and summary file without (both _metadata and _common_metadata)
- allocator - Variable in class org.apache.parquet.ParquetReadOptions.Builder
- appendColumnChunk(ColumnDescriptor, SeekableInputStream, ColumnChunkMetaData, BloomFilter, ColumnIndex, OffsetIndex) - Method in class org.apache.parquet.hadoop.ParquetFileWriter
- appendFile(Configuration, Path) - Method in class org.apache.parquet.hadoop.ParquetFileWriter
-
Deprecated.will be removed in 2.0.0; use
ParquetFileWriter.appendFile(InputFile)
instead - appendFile(InputFile) - Method in class org.apache.parquet.hadoop.ParquetFileWriter
- appendRowGroup(FSDataInputStream, BlockMetaData, boolean) - Method in class org.apache.parquet.hadoop.ParquetFileWriter
-
Deprecated.will be removed in 2.0.0; use
ParquetFileWriter.appendRowGroup(SeekableInputStream,BlockMetaData,boolean)
instead - appendRowGroup(SeekableInputStream, BlockMetaData, boolean) - Method in class org.apache.parquet.hadoop.ParquetFileWriter
- appendRowGroups(FSDataInputStream, List<BlockMetaData>, boolean) - Method in class org.apache.parquet.hadoop.ParquetFileWriter
-
Deprecated.will be removed in 2.0.0; use
ParquetFileWriter.appendRowGroups(SeekableInputStream,List,boolean)
instead - appendRowGroups(SeekableInputStream, List<BlockMetaData>, boolean) - Method in class org.apache.parquet.hadoop.ParquetFileWriter
- appendTo(ParquetFileWriter) - Method in class org.apache.parquet.hadoop.ParquetFileReader
B
- BAD_RECORD_THRESHOLD_CONF_KEY - Static variable in class org.apache.parquet.hadoop.UnmaterializableRecordCounter
- BadConfigurationException - Exception in org.apache.parquet.hadoop
-
Thrown when the input/output formats are misconfigured
- BadConfigurationException() - Constructor for exception org.apache.parquet.hadoop.BadConfigurationException
- BadConfigurationException(String) - Constructor for exception org.apache.parquet.hadoop.BadConfigurationException
- BadConfigurationException(String, Throwable) - Constructor for exception org.apache.parquet.hadoop.BadConfigurationException
- BadConfigurationException(Throwable) - Constructor for exception org.apache.parquet.hadoop.BadConfigurationException
- BenchmarkCounter - Class in org.apache.parquet.hadoop.util.counters
-
Encapsulate counter operations, compatible with Hadoop1/2, mapred/mapreduce API
- BenchmarkCounter() - Constructor for class org.apache.parquet.hadoop.util.counters.BenchmarkCounter
- BenchmarkCounter.NullCounter - Class in org.apache.parquet.hadoop.util.counters
- BLOCK_SIZE - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
- BlockMetaData - Class in org.apache.parquet.hadoop.metadata
-
Block metadata stored in the footer and passed in an InputSplit
- BlockMetaData() - Constructor for class org.apache.parquet.hadoop.metadata.BlockMetaData
- blockRead(byte[], int, int) - Method in class org.apache.parquet.hadoop.util.CompressionConverter.TransParquetFileReader
- BLOOM_FILTER_ENABLED - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
- BLOOM_FILTER_EXPECTED_NDV - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
- BLOOM_FILTER_MAX_BYTES - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
- BLOOM_FILTERING_ENABLED - Static variable in class org.apache.parquet.hadoop.ParquetInputFormat
-
key to configure whether row group bloom filtering is enabled
- BLOOMFILTER - org.apache.parquet.filter2.compat.RowGroupFilter.FilterLevel
- BloomFilterBitset - org.apache.parquet.crypto.ModuleCipherFactory.ModuleType
- BloomFilterHeader - org.apache.parquet.crypto.ModuleCipherFactory.ModuleType
- BloomFilterImpl - Class in org.apache.parquet.filter2.bloomfilterlevel
- BloomFilterReader - Class in org.apache.parquet.hadoop
-
Bloom filter reader that reads Bloom filter data from an open
ParquetFileReader
. - BloomFilterReader(ParquetFileReader, BlockMetaData) - Constructor for class org.apache.parquet.hadoop.BloomFilterReader
- build() - Method in class org.apache.parquet.crypto.ColumnDecryptionProperties.Builder
- build() - Method in class org.apache.parquet.crypto.ColumnEncryptionProperties.Builder
- build() - Method in class org.apache.parquet.crypto.FileDecryptionProperties.Builder
- build() - Method in class org.apache.parquet.crypto.FileEncryptionProperties.Builder
- build() - Method in class org.apache.parquet.hadoop.ParquetReader.Builder
- build() - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
Build a
ParquetWriter
with the accumulated configuration. - build() - Method in class org.apache.parquet.HadoopReadOptions.Builder
- build() - Method in class org.apache.parquet.ParquetReadOptions.Builder
- buildColumnChunkMetaData(ColumnMetaData, ColumnPath, PrimitiveType, String) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
- builder() - Static method in class org.apache.parquet.crypto.FileDecryptionProperties
- builder() - Static method in class org.apache.parquet.ParquetReadOptions
- builder(byte[]) - Static method in class org.apache.parquet.crypto.FileEncryptionProperties
- builder(String) - Static method in class org.apache.parquet.crypto.ColumnDecryptionProperties
-
Convenience builder for regular (not nested) columns.
- builder(String) - Static method in class org.apache.parquet.crypto.ColumnEncryptionProperties
-
Convenience builder for regular (not nested) columns.
- builder(Configuration) - Static method in class org.apache.parquet.HadoopReadOptions
- builder(Configuration, Path) - Static method in class org.apache.parquet.HadoopReadOptions
- builder(Path) - Static method in class org.apache.parquet.hadoop.example.ExampleParquetWriter
-
Creates a Builder for configuring ParquetWriter with the example object model.
- builder(ReadSupport<T>, Path) - Static method in class org.apache.parquet.hadoop.ParquetReader
- builder(ColumnPath) - Static method in class org.apache.parquet.crypto.ColumnDecryptionProperties
- builder(ColumnPath) - Static method in class org.apache.parquet.crypto.ColumnEncryptionProperties
-
Builder for encrypted columns.
- builder(OutputFile) - Static method in class org.apache.parquet.hadoop.example.ExampleParquetWriter
-
Creates a Builder for configuring ParquetWriter with the example object model.
- Builder() - Constructor for class org.apache.parquet.ParquetReadOptions.Builder
- Builder(Configuration) - Constructor for class org.apache.parquet.HadoopReadOptions.Builder
- Builder(Configuration, Path) - Constructor for class org.apache.parquet.HadoopReadOptions.Builder
- Builder(Path) - Constructor for class org.apache.parquet.hadoop.ParquetReader.Builder
-
Deprecated.
- Builder(Path) - Constructor for class org.apache.parquet.hadoop.ParquetWriter.Builder
- Builder(InputFile) - Constructor for class org.apache.parquet.hadoop.ParquetReader.Builder
- Builder(OutputFile) - Constructor for class org.apache.parquet.hadoop.ParquetWriter.Builder
- BytesCompressor() - Constructor for class org.apache.parquet.hadoop.CodecFactory.BytesCompressor
-
Deprecated.
- BytesDecompressor() - Constructor for class org.apache.parquet.hadoop.CodecFactory.BytesDecompressor
-
Deprecated.
C
- CACHE_LIFETIME_DEFAULT_SECONDS - Static variable in class org.apache.parquet.crypto.keytools.KeyToolkit
- CACHE_LIFETIME_PROPERTY_NAME - Static variable in class org.apache.parquet.crypto.keytools.KeyToolkit
-
Lifetime of cached entities (key encryption keys, local wrapping keys, KMS client objects).
- canDrop(FilterPredicate, List<ColumnChunkMetaData>) - Static method in class org.apache.parquet.filter2.statisticslevel.StatisticsFilter
- canDrop(FilterPredicate, List<ColumnChunkMetaData>, DictionaryPageReadStore) - Static method in class org.apache.parquet.filter2.dictionarylevel.DictionaryFilter
- canDrop(FilterPredicate, List<ColumnChunkMetaData>, BloomFilterReader) - Static method in class org.apache.parquet.filter2.bloomfilterlevel.BloomFilterImpl
- checkContractViolations(InputFile) - Static method in class org.apache.parquet.hadoop.ColumnIndexValidator
- checkFooterIntegrity() - Method in class org.apache.parquet.crypto.FileDecryptionProperties
- checkFooterIntegrity() - Method in class org.apache.parquet.crypto.InternalFileDecryptor
- CHUNK_LENGTH - Static variable in class org.apache.parquet.crypto.AesCipher
- cipher - Variable in class org.apache.parquet.crypto.AesCipher
- cleanDirectBuffer(ByteBuffer) - Static method in class org.apache.parquet.hadoop.codec.CleanUtil
- CleanUtil - Class in org.apache.parquet.hadoop.codec
-
A Helper class which use reflections to clean up DirectBuffer.
- close() - Method in class org.apache.parquet.hadoop.codec.ZstdCompressorStream
- close() - Method in class org.apache.parquet.hadoop.codec.ZstdDecompressorStream
- close() - Method in class org.apache.parquet.hadoop.ParquetFileReader
- close() - Method in class org.apache.parquet.hadoop.ParquetReader
- close() - Method in class org.apache.parquet.hadoop.ParquetRecordReader
- close() - Method in class org.apache.parquet.hadoop.ParquetWriter
- close() - Method in class org.apache.parquet.hadoop.util.HadoopPositionOutputStream
- close(TaskAttemptContext) - Method in class org.apache.parquet.hadoop.ParquetRecordWriter
- CODEC_BY_NAME - Static variable in class org.apache.parquet.hadoop.CodecFactory
- CodecConfig - Class in org.apache.parquet.hadoop.codec
-
Template class and factory for accessing codec related configurations in different APIs(mapreduce or mapred), use
CodecConfig.from(org.apache.hadoop.mapred.JobConf)
for mapred API, useCodecConfig.from(org.apache.hadoop.mapreduce.TaskAttemptContext)
for mapreduce API - CodecConfig() - Constructor for class org.apache.parquet.hadoop.codec.CodecConfig
- codecFactory - Variable in class org.apache.parquet.ParquetReadOptions.Builder
- CodecFactory - Class in org.apache.parquet.hadoop
- CodecFactory(Configuration, int) - Constructor for class org.apache.parquet.hadoop.CodecFactory
-
Create a new codec factory.
- CodecFactory.BytesCompressor - Class in org.apache.parquet.hadoop
-
Deprecated.will be removed in 2.0.0; use CompressionCodecFactory.BytesInputCompressor instead.
- CodecFactory.BytesDecompressor - Class in org.apache.parquet.hadoop
-
Deprecated.will be removed in 2.0.0; use CompressionCodecFactory.BytesInputDecompressor instead.
- COLUMN_INDEX_FILTERING_ENABLED - Static variable in class org.apache.parquet.hadoop.ParquetInputFormat
-
key to configure whether column index filtering of pages is enabled
- COLUMN_INDEX_TRUNCATE_LENGTH - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
- COLUMN_KEYS_PROPERTY_NAME - Static variable in class org.apache.parquet.crypto.keytools.PropertiesDrivenCryptoFactory
-
List of columns to encrypt, with master key IDs (see HIVE-21848).
- ColumnChunkMetaData - Class in org.apache.parquet.hadoop.metadata
-
Column meta data for a block stored in the file footer and passed in the InputSplit
- ColumnChunkMetaData(EncodingStats, ColumnChunkProperties) - Constructor for class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
- ColumnChunkMetaData(ColumnChunkProperties) - Constructor for class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
- ColumnChunkPageWriteStore - Class in org.apache.parquet.hadoop
- ColumnChunkPageWriteStore(CodecFactory.BytesCompressor, MessageType, ByteBufferAllocator, int) - Constructor for class org.apache.parquet.hadoop.ColumnChunkPageWriteStore
- ColumnChunkPageWriteStore(CodecFactory.BytesCompressor, MessageType, ByteBufferAllocator, int, boolean) - Constructor for class org.apache.parquet.hadoop.ColumnChunkPageWriteStore
- ColumnChunkPageWriteStore(CodecFactory.BytesCompressor, MessageType, ByteBufferAllocator, int, boolean, InternalFileEncryptor, int) - Constructor for class org.apache.parquet.hadoop.ColumnChunkPageWriteStore
- ColumnChunkProperties - Class in org.apache.parquet.hadoop.metadata
- ColumnDecryptionProperties - Class in org.apache.parquet.crypto
-
This class is only required for setting explicit column decryption keys - to override key retriever (or to provide keys when key metadata and/or key retriever are not available)
- ColumnDecryptionProperties.Builder - Class in org.apache.parquet.crypto
- ColumnEncryptionProperties - Class in org.apache.parquet.crypto
- ColumnEncryptionProperties.Builder - Class in org.apache.parquet.crypto
- ColumnIndex - org.apache.parquet.crypto.ModuleCipherFactory.ModuleType
- ColumnIndexValidator - Class in org.apache.parquet.hadoop
- ColumnIndexValidator() - Constructor for class org.apache.parquet.hadoop.ColumnIndexValidator
- ColumnIndexValidator.Contract - Enum in org.apache.parquet.hadoop
- ColumnIndexValidator.ContractViolation - Class in org.apache.parquet.hadoop
- ColumnMasker - Class in org.apache.parquet.hadoop.util
- ColumnMasker() - Constructor for class org.apache.parquet.hadoop.util.ColumnMasker
- ColumnMasker.MaskMode - Enum in org.apache.parquet.hadoop.util
- ColumnMetaData - org.apache.parquet.crypto.ModuleCipherFactory.ModuleType
- ColumnPruner - Class in org.apache.parquet.hadoop.util
- ColumnPruner() - Constructor for class org.apache.parquet.hadoop.util.ColumnPruner
- commitJob(JobContext) - Method in class org.apache.parquet.hadoop.mapred.MapredParquetOutputCommitter
- commitJob(JobContext) - Method in class org.apache.parquet.hadoop.ParquetOutputCommitter
- COMMON_ONLY - org.apache.parquet.hadoop.ParquetOutputFormat.JobSummaryLevel
-
Write only the summary file without the row group info (_common_metadata only)
- compress(byte[], int, int) - Method in class org.apache.parquet.hadoop.codec.SnappyCompressor
-
Fills specified buffer with compressed data.
- compress(BytesInput) - Method in class org.apache.parquet.hadoop.CodecFactory.BytesCompressor
-
Deprecated.
- COMPRESSION - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
- CompressionConverter - Class in org.apache.parquet.hadoop.util
- CompressionConverter() - Constructor for class org.apache.parquet.hadoop.util.CompressionConverter
- CompressionConverter.TransParquetFileReader - Class in org.apache.parquet.hadoop.util
- ConcatenatingKeyValueMetadataMergeStrategy - Class in org.apache.parquet.hadoop.metadata
-
Strategy to concatenate if there are multiple values for a given key in metadata.
- ConcatenatingKeyValueMetadataMergeStrategy() - Constructor for class org.apache.parquet.hadoop.metadata.ConcatenatingKeyValueMetadataMergeStrategy
-
Default constructor.
- ConcatenatingKeyValueMetadataMergeStrategy(String) - Constructor for class org.apache.parquet.hadoop.metadata.ConcatenatingKeyValueMetadataMergeStrategy
-
Constructor to use different delimiter for concatenation.
- conf - Variable in class org.apache.parquet.hadoop.ParquetReader.Builder
- config(String, String) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
Set a property that will be available to the read path.
- configuration - Variable in class org.apache.parquet.hadoop.CodecFactory
- ConfigurationUtil - Class in org.apache.parquet.hadoop.util
- ConfigurationUtil() - Constructor for class org.apache.parquet.hadoop.util.ConfigurationUtil
- Container<T> - Class in org.apache.parquet.hadoop.mapred
-
A simple container of objects that you can get and set.
- Container() - Constructor for class org.apache.parquet.hadoop.mapred.Container
- ContextUtil - Class in org.apache.parquet.hadoop.util
-
Utility methods to allow applications to deal with inconsistencies between MapReduce Context Objects API between hadoop-0.20 and later versions.
- ContextUtil() - Constructor for class org.apache.parquet.hadoop.util.ContextUtil
- ContractViolation(ColumnIndexValidator.Contract, String, String, int, int, ColumnPath, int) - Constructor for class org.apache.parquet.hadoop.ColumnIndexValidator.ContractViolation
- convertEncodingStats(List<PageEncodingStats>) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
- convertEncodingStats(EncodingStats) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
- convertToColumnPaths(List<String>) - Static method in class org.apache.parquet.hadoop.util.ColumnMasker
- copy(ParquetReadOptions) - Method in class org.apache.parquet.ParquetReadOptions.Builder
- CounterLoader - Interface in org.apache.parquet.hadoop.util.counters
-
Factory interface for CounterLoaders, will load the counter according to groupName, counterName, and if in the configuration, flag with name counterFlag is false, the counter will not be loaded
- create(long) - Method in class org.apache.parquet.hadoop.util.HadoopOutputFile
- CREATE - org.apache.parquet.hadoop.ParquetFileWriter.Mode
- createCompressor() - Method in class org.apache.parquet.hadoop.codec.SnappyCodec
- createCompressor() - Method in class org.apache.parquet.hadoop.codec.ZstandardCodec
- createCompressor(CompressionCodecName) - Method in class org.apache.parquet.hadoop.CodecFactory
- createDecompressor() - Method in class org.apache.parquet.hadoop.codec.SnappyCodec
- createDecompressor() - Method in class org.apache.parquet.hadoop.codec.ZstandardCodec
- createDecompressor(CompressionCodecName) - Method in class org.apache.parquet.hadoop.CodecFactory
- createDirectCodecFactory(Configuration, ByteBufferAllocator, int) - Static method in class org.apache.parquet.hadoop.CodecFactory
-
Create a codec factory that will provide compressors and decompressors that will work natively with ByteBuffers backed by direct memory.
- createEncryptionProperties(Configuration, Path, WriteSupport.WriteContext) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
- createFooterAAD(byte[]) - Static method in class org.apache.parquet.crypto.AesCipher
- createInputStream(InputStream) - Method in class org.apache.parquet.hadoop.codec.SnappyCodec
- createInputStream(InputStream) - Method in class org.apache.parquet.hadoop.codec.ZstandardCodec
- createInputStream(InputStream, Decompressor) - Method in class org.apache.parquet.hadoop.codec.SnappyCodec
- createInputStream(InputStream, Decompressor) - Method in class org.apache.parquet.hadoop.codec.ZstandardCodec
- createModuleAAD(byte[], ModuleCipherFactory.ModuleType, int, int, int) - Static method in class org.apache.parquet.crypto.AesCipher
- createOrOverwrite(long) - Method in class org.apache.parquet.hadoop.util.HadoopOutputFile
- createOutputStream(OutputStream) - Method in class org.apache.parquet.hadoop.codec.SnappyCodec
- createOutputStream(OutputStream) - Method in class org.apache.parquet.hadoop.codec.ZstandardCodec
- createOutputStream(OutputStream, Compressor) - Method in class org.apache.parquet.hadoop.codec.SnappyCodec
- createOutputStream(OutputStream, Compressor) - Method in class org.apache.parquet.hadoop.codec.ZstandardCodec
- createRecordReader(InputSplit, TaskAttemptContext) - Method in class org.apache.parquet.hadoop.ParquetInputFormat
- createSignedFooterEncryptor() - Method in class org.apache.parquet.crypto.InternalFileDecryptor
- CRYPTO_FACTORY_CLASS_PROPERTY_NAME - Static variable in interface org.apache.parquet.crypto.DecryptionPropertiesFactory
- CRYPTO_FACTORY_CLASS_PROPERTY_NAME - Static variable in interface org.apache.parquet.crypto.EncryptionPropertiesFactory
- CTR - org.apache.parquet.crypto.AesMode
- CTR_IV_LENGTH - Static variable in class org.apache.parquet.crypto.AesCipher
- CURRENT_VERSION - Static variable in class org.apache.parquet.hadoop.ParquetFileWriter
D
- DATA_KEY_LENGTH_DEFAULT - Static variable in class org.apache.parquet.crypto.keytools.KeyToolkit
- DATA_KEY_LENGTH_PROPERTY_NAME - Static variable in class org.apache.parquet.crypto.keytools.KeyToolkit
-
Length of data encryption keys (DEKs), randomly generated by parquet key management tools.
- DataPage - org.apache.parquet.crypto.ModuleCipherFactory.ModuleType
- DataPageHeader - org.apache.parquet.crypto.ModuleCipherFactory.ModuleType
- decompress(byte[], int, int) - Method in class org.apache.parquet.hadoop.codec.SnappyDecompressor
-
Fills specified buffer with uncompressed data.
- decompress(ByteBuffer, int, ByteBuffer, int) - Method in class org.apache.parquet.hadoop.CodecFactory.BytesDecompressor
-
Deprecated.
- decompress(BytesInput, int) - Method in class org.apache.parquet.hadoop.CodecFactory.BytesDecompressor
-
Deprecated.
- decrypt(byte[], byte[]) - Method in class org.apache.parquet.crypto.AesCtrDecryptor
- decrypt(byte[], byte[]) - Method in class org.apache.parquet.crypto.AesGcmDecryptor
- decrypt(byte[], int, int, byte[]) - Method in class org.apache.parquet.crypto.AesCtrDecryptor
- decrypt(byte[], int, int, byte[]) - Method in class org.apache.parquet.crypto.AesGcmDecryptor
- decrypt(InputStream, byte[]) - Method in class org.apache.parquet.crypto.AesCtrDecryptor
- decrypt(InputStream, byte[]) - Method in class org.apache.parquet.crypto.AesGcmDecryptor
- decryptIfNeeded() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
- DecryptionKeyRetriever - Interface in org.apache.parquet.crypto
-
Interface for classes retrieving encryption keys using the key metadata.
- DecryptionPropertiesFactory - Interface in org.apache.parquet.crypto
-
DecryptionPropertiesFactory interface enables transparent activation of Parquet decryption.
- decryptKeyLocally(String, byte[], byte[]) - Static method in class org.apache.parquet.crypto.keytools.KeyToolkit
-
Decrypts encrypted key with "masterKey", using AES-GCM and the "AAD"
- DEFAULT_BLOCK_SIZE - Static variable in class org.apache.parquet.hadoop.ParquetWriter
- DEFAULT_COMPRESSION_CODEC_NAME - Static variable in class org.apache.parquet.hadoop.ParquetWriter
- DEFAULT_IS_DICTIONARY_ENABLED - Static variable in class org.apache.parquet.hadoop.ParquetWriter
- DEFAULT_IS_VALIDATING_ENABLED - Static variable in class org.apache.parquet.hadoop.ParquetWriter
- DEFAULT_PAGE_SIZE - Static variable in class org.apache.parquet.hadoop.ParquetWriter
- DEFAULT_PARQUET_COMPRESS_ZSTD_BUFFERPOOL_ENABLED - Static variable in class org.apache.parquet.hadoop.codec.ZstandardCodec
- DEFAULT_PARQUET_COMPRESS_ZSTD_LEVEL - Static variable in class org.apache.parquet.hadoop.codec.ZstandardCodec
- DEFAULT_WRITER_VERSION - Static variable in class org.apache.parquet.hadoop.ParquetWriter
- defaultBlockSize() - Method in class org.apache.parquet.hadoop.util.HadoopOutputFile
- DEFAULTPARQUET_COMPRESS_ZSTD_WORKERS - Static variable in class org.apache.parquet.hadoop.codec.ZstandardCodec
- DelegatingReadSupport<T> - Class in org.apache.parquet.hadoop.api
-
Helps composing read supports
- DelegatingReadSupport(ReadSupport<T>) - Constructor for class org.apache.parquet.hadoop.api.DelegatingReadSupport
- DelegatingWriteSupport<T> - Class in org.apache.parquet.hadoop.api
-
Helps composing write supports
- DelegatingWriteSupport(WriteSupport<T>) - Constructor for class org.apache.parquet.hadoop.api.DelegatingWriteSupport
- DeprecatedParquetInputFormat<V> - Class in org.apache.parquet.hadoop.mapred
- DeprecatedParquetInputFormat() - Constructor for class org.apache.parquet.hadoop.mapred.DeprecatedParquetInputFormat
- DeprecatedParquetOutputFormat<V> - Class in org.apache.parquet.hadoop.mapred
- DeprecatedParquetOutputFormat() - Constructor for class org.apache.parquet.hadoop.mapred.DeprecatedParquetOutputFormat
- description - Variable in enum org.apache.parquet.hadoop.ColumnIndexValidator.Contract
- DICTIONARY - org.apache.parquet.filter2.compat.RowGroupFilter.FilterLevel
- DICTIONARY_FILTERING_ENABLED - Static variable in class org.apache.parquet.hadoop.ParquetInputFormat
-
key to configure whether row group dictionary filtering is enabled
- DICTIONARY_PAGE_SIZE - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
- DictionaryFilter - Class in org.apache.parquet.filter2.dictionarylevel
-
Applies filters based on the contents of column dictionaries.
- DictionaryPage - org.apache.parquet.crypto.ModuleCipherFactory.ModuleType
- DictionaryPageHeader - org.apache.parquet.crypto.ModuleCipherFactory.ModuleType
- DOUBLE_WRAPPING_DEFAULT - Static variable in class org.apache.parquet.crypto.keytools.KeyToolkit
- DOUBLE_WRAPPING_PROPERTY_NAME - Static variable in class org.apache.parquet.crypto.keytools.KeyToolkit
-
Use double wrapping - where data encryption keys (DEKs) are encrypted with key encryption keys (KEKs), which in turn are encrypted with master keys.
E
- EF_MAGIC_STR - Static variable in class org.apache.parquet.hadoop.ParquetFileWriter
- EFMAGIC - Static variable in class org.apache.parquet.hadoop.ParquetFileWriter
- ENABLE_DICTIONARY - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
- ENABLE_JOB_SUMMARY - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
-
Deprecated.
- enableDictionaryEncoding() - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
Enables dictionary encoding for the constructed writer.
- enablePageWriteChecksum() - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
Enables writing page level checksums for the constructed writer.
- enableValidation() - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
Enables validation for the constructed writer.
- EncodingList - Class in org.apache.parquet.hadoop.metadata
- encrypt(boolean, byte[], byte[]) - Method in class org.apache.parquet.crypto.AesCtrEncryptor
- encrypt(boolean, byte[], byte[]) - Method in class org.apache.parquet.crypto.AesGcmEncryptor
- encrypt(boolean, byte[], byte[], byte[]) - Method in class org.apache.parquet.crypto.AesCtrEncryptor
- encrypt(boolean, byte[], byte[], byte[]) - Method in class org.apache.parquet.crypto.AesGcmEncryptor
- encrypt(byte[], byte[]) - Method in class org.apache.parquet.crypto.AesCtrEncryptor
- encrypt(byte[], byte[]) - Method in class org.apache.parquet.crypto.AesGcmEncryptor
- encryptColumnMetaData(InternalColumnEncryptionSetup) - Method in class org.apache.parquet.crypto.InternalFileEncryptor
- encryptedFooter() - Method in class org.apache.parquet.crypto.FileEncryptionProperties
- ENCRYPTION_ALGORITHM_DEFAULT - Static variable in class org.apache.parquet.crypto.keytools.PropertiesDrivenCryptoFactory
- ENCRYPTION_ALGORITHM_PROPERTY_NAME - Static variable in class org.apache.parquet.crypto.keytools.PropertiesDrivenCryptoFactory
-
Parquet encryption algorithm.
- EncryptionPropertiesFactory - Interface in org.apache.parquet.crypto
-
EncryptionPropertiesFactory interface enables transparent activation of Parquet encryption.
- encryptKeyLocally(byte[], byte[], byte[]) - Static method in class org.apache.parquet.crypto.keytools.KeyToolkit
-
Encrypts "key" with "masterKey", using AES-GCM and the "AAD"
- end() - Method in class org.apache.parquet.hadoop.codec.SnappyCompressor
- end() - Method in class org.apache.parquet.hadoop.codec.SnappyDecompressor
- end(Map<String, String>) - Method in class org.apache.parquet.hadoop.ParquetFileWriter
-
ends a file once all blocks have been written.
- endBlock() - Method in class org.apache.parquet.hadoop.ParquetFileWriter
-
ends a block once all column chunks have been written
- endColumn() - Method in class org.apache.parquet.hadoop.ParquetFileWriter
-
end a column (once all rep, def and data have been written)
- equals(Object) - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkProperties
- equals(Object) - Method in class org.apache.parquet.hadoop.metadata.EncodingList
- ESTIMATE_PAGE_SIZE_CHECK - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
- ExampleInputFormat - Class in org.apache.parquet.hadoop.example
-
Example input format to read Parquet files This Input format uses a rather inefficient data model but works independently of higher level abstractions.
- ExampleInputFormat() - Constructor for class org.apache.parquet.hadoop.example.ExampleInputFormat
- ExampleOutputFormat - Class in org.apache.parquet.hadoop.example
-
An example output format must be provided the schema up front
- ExampleOutputFormat() - Constructor for class org.apache.parquet.hadoop.example.ExampleOutputFormat
- ExampleParquetWriter - Class in org.apache.parquet.hadoop.example
-
An example file writer class.
- ExampleParquetWriter.Builder - Class in org.apache.parquet.hadoop.example
F
- f - Variable in class org.apache.parquet.hadoop.ParquetFileReader
- fetchFooterDecryptor() - Method in class org.apache.parquet.crypto.InternalFileDecryptor
- fileDecryptionProperties - Variable in class org.apache.parquet.ParquetReadOptions.Builder
- FileDecryptionProperties - Class in org.apache.parquet.crypto
- FileDecryptionProperties.Builder - Class in org.apache.parquet.crypto
- FileEncryptionProperties - Class in org.apache.parquet.crypto
- FileEncryptionProperties.Builder - Class in org.apache.parquet.crypto
- FileKeyMaterialStore - Interface in org.apache.parquet.crypto.keytools
- FileKeyUnwrapper - Class in org.apache.parquet.crypto.keytools
- FileKeyWrapper - Class in org.apache.parquet.crypto.keytools
- FileMetaData - Class in org.apache.parquet.hadoop.metadata
-
File level meta data (Schema, codec, ...)
- FileMetaData(MessageType, Map<String, String>, String) - Constructor for class org.apache.parquet.hadoop.metadata.FileMetaData
- FileMetaData(MessageType, Map<String, String>, String, InternalFileDecryptor) - Constructor for class org.apache.parquet.hadoop.metadata.FileMetaData
- FILTER_PREDICATE - Static variable in class org.apache.parquet.hadoop.ParquetInputFormat
-
key to configure the filter predicate
- filterRowGroups(List<RowGroupFilter.FilterLevel>, FilterCompat.Filter, List<BlockMetaData>, ParquetFileReader) - Static method in class org.apache.parquet.filter2.compat.RowGroupFilter
- filterRowGroups(FilterCompat.Filter, List<BlockMetaData>, MessageType) - Static method in class org.apache.parquet.filter2.compat.RowGroupFilter
-
Deprecated.will be removed in 2.0.0.
- FinalizedWriteContext(Map<String, String>) - Constructor for class org.apache.parquet.hadoop.api.WriteSupport.FinalizedWriteContext
- finalizeWrite() - Method in class org.apache.parquet.hadoop.api.DelegatingWriteSupport
- finalizeWrite() - Method in class org.apache.parquet.hadoop.api.WriteSupport
-
called once in the end after the last record was written
- finish() - Method in class org.apache.parquet.hadoop.codec.SnappyCompressor
- finish() - Method in class org.apache.parquet.hadoop.codec.ZstdCompressorStream
- finished() - Method in class org.apache.parquet.hadoop.codec.SnappyCompressor
- finished() - Method in class org.apache.parquet.hadoop.codec.SnappyDecompressor
- flush() - Method in class org.apache.parquet.hadoop.codec.ZstdCompressorStream
- flush() - Method in class org.apache.parquet.hadoop.util.HadoopPositionOutputStream
- flushToFileWriter(ParquetFileWriter) - Method in class org.apache.parquet.hadoop.ColumnChunkPageWriteStore
- Footer - Class in org.apache.parquet.hadoop
-
Represent the footer for a given file
- Footer - org.apache.parquet.crypto.ModuleCipherFactory.ModuleType
- Footer(Path, ParquetMetadata) - Constructor for class org.apache.parquet.hadoop.Footer
- FOOTER_KEY_PROPERTY_NAME - Static variable in class org.apache.parquet.crypto.keytools.PropertiesDrivenCryptoFactory
-
Master key ID for footer encryption/signing.
- from(JobConf) - Static method in class org.apache.parquet.hadoop.codec.CodecConfig
-
use mapred api to read codec config
- from(TaskAttemptContext) - Static method in class org.apache.parquet.hadoop.codec.CodecConfig
-
use mapreduce api to read codec config
- fromJSON(String) - Static method in class org.apache.parquet.hadoop.metadata.ParquetMetadata
- fromParquetColumnIndex(PrimitiveType, ColumnIndex) - Static method in class org.apache.parquet.format.converter.ParquetMetadataConverter
- fromParquetMetadata(FileMetaData) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
- fromParquetMetadata(FileMetaData, InternalFileDecryptor, boolean) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
- fromParquetOffsetIndex(OffsetIndex) - Static method in class org.apache.parquet.format.converter.ParquetMetadataConverter
- fromParquetStatistics(String, Statistics, PrimitiveType) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
- fromParquetStatistics(String, Statistics, PrimitiveType.PrimitiveTypeName) - Static method in class org.apache.parquet.format.converter.ParquetMetadataConverter
-
Deprecated.will be removed in 2.0.0.
- fromParquetStatistics(Statistics, PrimitiveType.PrimitiveTypeName) - Static method in class org.apache.parquet.format.converter.ParquetMetadataConverter
-
Deprecated.will be removed in 2.0.0.
- fromPath(Path, Configuration) - Static method in class org.apache.parquet.hadoop.util.HadoopInputFile
- fromPath(Path, Configuration) - Static method in class org.apache.parquet.hadoop.util.HadoopOutputFile
- fromStatus(FileStatus, Configuration) - Static method in class org.apache.parquet.hadoop.util.HadoopInputFile
- fromString(String) - Static method in enum org.apache.parquet.hadoop.util.ColumnMasker.MaskMode
G
- GCM - org.apache.parquet.crypto.AesMode
- GCM_TAG_LENGTH - Static variable in class org.apache.parquet.crypto.AesCipher
- GCM_TAG_LENGTH_BITS - Static variable in class org.apache.parquet.crypto.AesCipher
- get() - Method in class org.apache.parquet.hadoop.mapred.Container
- get(ColumnPath, PrimitiveType.PrimitiveTypeName, CompressionCodecName, Set<Encoding>) - Static method in class org.apache.parquet.hadoop.metadata.ColumnChunkProperties
-
Deprecated.will be removed in 2.0.0. Use
ColumnChunkProperties.get(ColumnPath, PrimitiveType, CompressionCodecName, Set)
instead. - get(ColumnPath, PrimitiveType.PrimitiveTypeName, CompressionCodecName, Set<Encoding>, long, long, long, long, long) - Static method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
-
Deprecated.
- get(ColumnPath, PrimitiveType.PrimitiveTypeName, CompressionCodecName, Set<Encoding>, Statistics, long, long, long, long, long) - Static method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
-
Deprecated.
- get(ColumnPath, PrimitiveType.PrimitiveTypeName, CompressionCodecName, EncodingStats, Set<Encoding>, Statistics, long, long, long, long, long) - Static method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
-
Deprecated.will be removed in 2.0.0. Use
ColumnChunkMetaData.get(ColumnPath, PrimitiveType, CompressionCodecName, EncodingStats, Set, Statistics, long, long, long, long, long)
instead. - get(ColumnPath, PrimitiveType, CompressionCodecName, Set<Encoding>) - Static method in class org.apache.parquet.hadoop.metadata.ColumnChunkProperties
- get(ColumnPath, PrimitiveType, CompressionCodecName, EncodingStats, Set<Encoding>, Statistics, long, long, long, long, long) - Static method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
- getAADPrefix() - Method in class org.apache.parquet.crypto.FileDecryptionProperties
- getAlgorithm() - Method in class org.apache.parquet.crypto.FileEncryptionProperties
- getAllocator() - Method in class org.apache.parquet.ParquetReadOptions
- getBlockFileSystems() - Static method in class org.apache.parquet.hadoop.util.HadoopOutputFile
- getBlocks() - Method in class org.apache.parquet.hadoop.metadata.ParquetMetadata
- getBlocks() - Method in class org.apache.parquet.hadoop.ParquetInputSplit
-
Deprecated.the file footer is no longer read before creating input splits
- getBlockSize(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
-
Deprecated.
- getBlockSize(JobContext) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
- getBloomFilterDataReader(BlockMetaData) - Method in class org.apache.parquet.hadoop.ParquetFileReader
- getBloomFilterEnabled(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
- getBloomFilterMaxBytes(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
- getBloomFilterOffset() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
- getBloomFilterWriter(ColumnDescriptor) - Method in class org.apache.parquet.hadoop.ColumnChunkPageWriteStore
- getBytesRead() - Method in class org.apache.parquet.hadoop.codec.SnappyCompressor
- getBytesRead() - Static method in class org.apache.parquet.hadoop.util.counters.BenchmarkCounter
- getBytesWritten() - Method in class org.apache.parquet.hadoop.codec.SnappyCompressor
- getCipherName() - Method in enum org.apache.parquet.crypto.AesMode
- getClassFromConfig(Configuration, String, Class<?>) - Static method in class org.apache.parquet.hadoop.util.ConfigurationUtil
- getCodec() - Method in class org.apache.parquet.hadoop.codec.CodecConfig
- getCodec() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
- getCodec() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkProperties
- getCodec(CompressionCodecName) - Method in class org.apache.parquet.hadoop.CodecFactory
- getCodecFactory() - Method in class org.apache.parquet.ParquetReadOptions
- getCodecName() - Method in class org.apache.parquet.hadoop.CodecFactory.BytesCompressor
-
Deprecated.
- getColumnCryptoMetaData() - Method in class org.apache.parquet.crypto.InternalColumnEncryptionSetup
- getColumnIndexReference() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
- getColumnKey(ColumnPath) - Method in class org.apache.parquet.crypto.FileDecryptionProperties
- getColumnProperties(ColumnPath) - Method in class org.apache.parquet.crypto.FileEncryptionProperties
- getColumns() - Method in class org.apache.parquet.hadoop.metadata.BlockMetaData
- getColumnSetup(ColumnPath) - Method in class org.apache.parquet.crypto.InternalFileDecryptor
- getColumnSetup(ColumnPath, boolean, int) - Method in class org.apache.parquet.crypto.InternalFileEncryptor
- getCompressedSize() - Method in class org.apache.parquet.hadoop.metadata.BlockMetaData
- getCompression(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
- getCompression(JobContext) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
- getCompressor(CompressionCodecName) - Method in class org.apache.parquet.hadoop.CodecFactory
- getCompressorType() - Method in class org.apache.parquet.hadoop.codec.SnappyCodec
- getCompressorType() - Method in class org.apache.parquet.hadoop.codec.ZstandardCodec
- getConf() - Method in class org.apache.parquet.hadoop.codec.SnappyCodec
- getConf() - Method in class org.apache.parquet.hadoop.codec.ZstandardCodec
- getConf() - Method in class org.apache.parquet.HadoopReadOptions
- getConfiguration() - Method in class org.apache.parquet.hadoop.api.InitContext
- getConfiguration() - Method in class org.apache.parquet.hadoop.codec.CodecConfig
- getConfiguration() - Method in class org.apache.parquet.hadoop.util.HadoopInputFile
- getConfiguration() - Method in class org.apache.parquet.hadoop.util.HadoopOutputFile
- getConfiguration(JobContext) - Static method in class org.apache.parquet.hadoop.util.ContextUtil
-
Invoke getConfiguration() method on JobContext.
- getCount() - Method in class org.apache.parquet.hadoop.util.counters.BenchmarkCounter.NullCounter
- getCount() - Method in interface org.apache.parquet.hadoop.util.counters.ICounter
- getCount() - Method in class org.apache.parquet.hadoop.util.counters.mapred.MapRedCounterAdapter
- getCount() - Method in class org.apache.parquet.hadoop.util.counters.mapreduce.MapReduceCounterAdapter
- getCounter(TaskAttemptContext, String, String) - Static method in class org.apache.parquet.hadoop.util.ContextUtil
- getCounterByNameAndFlag(String, String, String) - Method in interface org.apache.parquet.hadoop.util.counters.CounterLoader
- getCounterByNameAndFlag(String, String, String) - Method in class org.apache.parquet.hadoop.util.counters.mapred.MapRedCounterLoader
- getCounterByNameAndFlag(String, String, String) - Method in class org.apache.parquet.hadoop.util.counters.mapreduce.MapReduceCounterLoader
- getCreatedBy() - Method in class org.apache.parquet.hadoop.metadata.FileMetaData
- getCreatedBy() - Method in class org.apache.parquet.hadoop.metadata.GlobalMetaData
- getCurrentKey() - Method in class org.apache.parquet.hadoop.ParquetRecordReader
-
always returns null
- getCurrentValue() - Method in class org.apache.parquet.hadoop.ParquetRecordReader
- getDataDecryptor() - Method in class org.apache.parquet.crypto.InternalColumnDecryptionSetup
- getDataEncryptor() - Method in class org.apache.parquet.crypto.InternalColumnEncryptionSetup
- getDataSize() - Method in class org.apache.parquet.hadoop.ParquetWriter
- getDecompressor(CompressionCodecName) - Method in class org.apache.parquet.hadoop.CodecFactory
- getDecompressorType() - Method in class org.apache.parquet.hadoop.codec.SnappyCodec
- getDecompressorType() - Method in class org.apache.parquet.hadoop.codec.ZstandardCodec
- getDecryptionProperties() - Method in class org.apache.parquet.crypto.InternalFileDecryptor
- getDecryptionProperties() - Method in class org.apache.parquet.ParquetReadOptions
- getDecryptor(AesMode, byte[]) - Static method in class org.apache.parquet.crypto.ModuleCipherFactory
- getDefaultExtension() - Method in class org.apache.parquet.hadoop.codec.SnappyCodec
- getDefaultExtension() - Method in class org.apache.parquet.hadoop.codec.ZstandardCodec
- getDictionaryPageOffset() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
- getDictionaryPageSize(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
- getDictionaryPageSize(JobContext) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
- getDictionaryReader(BlockMetaData) - Method in class org.apache.parquet.hadoop.ParquetFileReader
- getEnableDictionary(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
- getEnableDictionary(JobContext) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
- getEncoding(Encoding) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
- getEncoding(Encoding) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
- getEncodingList(List<Encoding>) - Static method in class org.apache.parquet.hadoop.metadata.EncodingList
- getEncodings() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
- getEncodings() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkProperties
- getEncodingStats() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
- getEncryptedColumns() - Method in class org.apache.parquet.crypto.FileEncryptionProperties
- getEncryptionAlgorithm() - Method in class org.apache.parquet.crypto.InternalFileEncryptor
- getEncryptionAlgorithm() - Method in enum org.apache.parquet.crypto.ParquetCipher
- getEncryptor(AesMode, byte[]) - Static method in class org.apache.parquet.crypto.ModuleCipherFactory
- getEnd() - Method in class org.apache.parquet.hadoop.ParquetInputSplit
-
Deprecated.
- getEstimatePageSizeCheck(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
- getExtraMetadata() - Method in class org.apache.parquet.hadoop.ParquetInputSplit
-
Deprecated.will be removed in 2.0.0. the file footer is no longer read before creating input splits
- getExtraMetaData() - Method in class org.apache.parquet.hadoop.api.WriteSupport.FinalizedWriteContext
- getExtraMetaData() - Method in class org.apache.parquet.hadoop.api.WriteSupport.WriteContext
- getFile() - Method in class org.apache.parquet.hadoop.Footer
- getFile() - Method in class org.apache.parquet.hadoop.ParquetFileReader
- getFileAAD() - Method in class org.apache.parquet.crypto.FileEncryptionProperties
- getFileAAD() - Method in class org.apache.parquet.crypto.InternalFileDecryptor
- getFileAAD() - Method in class org.apache.parquet.crypto.InternalFileEncryptor
- getFileCryptoMetaData() - Method in class org.apache.parquet.crypto.InternalFileEncryptor
- getFileDecryptionProperties(Configuration, Path) - Method in interface org.apache.parquet.crypto.DecryptionPropertiesFactory
-
Get FileDecryptionProperties object which is created by the implementation of this interface.
- getFileDecryptionProperties(Configuration, Path) - Method in class org.apache.parquet.crypto.keytools.PropertiesDrivenCryptoFactory
- getFileDecryptor() - Method in class org.apache.parquet.hadoop.metadata.FileMetaData
- getFileEncryptionProperties(Configuration, Path, WriteSupport.WriteContext) - Method in interface org.apache.parquet.crypto.EncryptionPropertiesFactory
-
Get FileEncryptionProperties object which is created by the implementation of this interface.
- getFileEncryptionProperties(Configuration, Path, WriteSupport.WriteContext) - Method in class org.apache.parquet.crypto.keytools.PropertiesDrivenCryptoFactory
- getFileMetaData() - Method in class org.apache.parquet.hadoop.metadata.ParquetMetadata
- getFileMetaData() - Method in class org.apache.parquet.hadoop.ParquetFileReader
- getFileSchema() - Method in class org.apache.parquet.hadoop.api.InitContext
-
this is the union of all the schemas when reading multiple files.
- getFileSchema() - Method in class org.apache.parquet.hadoop.ParquetInputSplit
-
Deprecated.the file footer is no longer read before creating input splits
- getFilter(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetInputFormat
-
Returns a non-null Filter, which is a wrapper around either a FilterPredicate, an UnboundRecordFilter, or a no-op filter.
- getFilteredRecordCount() - Method in class org.apache.parquet.hadoop.ParquetFileReader
- getFirstDataPageOffset() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
- getFooter() - Method in class org.apache.parquet.hadoop.ParquetFileReader
- getFooter() - Method in class org.apache.parquet.hadoop.ParquetFileWriter
- getFooter() - Method in class org.apache.parquet.hadoop.ParquetWriter
- getFooterEncryptor() - Method in class org.apache.parquet.crypto.InternalFileEncryptor
- getFooterKey() - Method in class org.apache.parquet.crypto.FileDecryptionProperties
- getFooterKey() - Method in class org.apache.parquet.crypto.FileEncryptionProperties
- getFooterKeyMetadata() - Method in class org.apache.parquet.crypto.FileEncryptionProperties
- getFooters(Configuration, Collection<FileStatus>) - Method in class org.apache.parquet.hadoop.ParquetInputFormat
-
the footers for the files
- getFooters(Configuration, List<FileStatus>) - Method in class org.apache.parquet.hadoop.ParquetInputFormat
- getFooters(JobConf) - Method in class org.apache.parquet.hadoop.mapred.DeprecatedParquetInputFormat
- getFooters(JobContext) - Method in class org.apache.parquet.hadoop.ParquetInputFormat
- getFooterSigningKeyMetaData() - Method in class org.apache.parquet.crypto.InternalFileEncryptor
- getGlobalMetaData(JobContext) - Method in class org.apache.parquet.hadoop.ParquetInputFormat
- getHadoopOutputCompressorClass(Class) - Method in class org.apache.parquet.hadoop.codec.CodecConfig
- getJobSummaryLevel(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
- getKey(byte[]) - Method in interface org.apache.parquet.crypto.DecryptionKeyRetriever
-
Returns encryption key using the key metadata.
- getKey(byte[]) - Method in class org.apache.parquet.crypto.keytools.FileKeyUnwrapper
- getKeyBytes() - Method in class org.apache.parquet.crypto.ColumnDecryptionProperties
- getKeyBytes() - Method in class org.apache.parquet.crypto.ColumnEncryptionProperties
- getKeyIDSet() - Method in interface org.apache.parquet.crypto.keytools.FileKeyMaterialStore
- getKeyIDSet() - Method in class org.apache.parquet.crypto.keytools.HadoopFSKeyMaterialStore
- getKeyMaterial(String) - Method in interface org.apache.parquet.crypto.keytools.FileKeyMaterialStore
-
Get key material
- getKeyMaterial(String) - Method in class org.apache.parquet.crypto.keytools.HadoopFSKeyMaterialStore
- getKeyMetaData() - Method in class org.apache.parquet.crypto.ColumnEncryptionProperties
- getKeyRetriever() - Method in class org.apache.parquet.crypto.FileDecryptionProperties
- getKeyValueMetadata() - Method in class org.apache.parquet.hadoop.api.InitContext
-
each key is associated with the list of distinct values found in footers
- getKeyValueMetaData() - Method in class org.apache.parquet.hadoop.metadata.FileMetaData
- getKeyValueMetaData() - Method in class org.apache.parquet.hadoop.metadata.GlobalMetaData
- getLength() - Method in class org.apache.parquet.hadoop.util.HadoopInputFile
- getLength() - Method in class org.apache.parquet.internal.hadoop.metadata.IndexReference
- getLongBlockSize(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
- getMasterKeyFromServer(String) - Method in class org.apache.parquet.crypto.keytools.LocalWrapKmsClient
-
Get master key from the remote KMS server.
- getMaxAllocationSize() - Method in class org.apache.parquet.ParquetReadOptions
- getMaxRowCountForPageSizeCheck(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
- getMemoryManager() - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
- getMergedKeyValueMetaData() - Method in class org.apache.parquet.hadoop.api.InitContext
-
Deprecated.
- getMetaDataDecryptor() - Method in class org.apache.parquet.crypto.InternalColumnDecryptionSetup
- getMetaDataEncryptor() - Method in class org.apache.parquet.crypto.InternalColumnEncryptionSetup
- getMetadataFilter() - Method in class org.apache.parquet.ParquetReadOptions
- getMinRowCountForPageSizeCheck(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
- getMode() - Method in enum org.apache.parquet.hadoop.util.ColumnMasker.MaskMode
- getName() - Method in class org.apache.parquet.hadoop.api.DelegatingWriteSupport
- getName() - Method in class org.apache.parquet.hadoop.api.WriteSupport
-
Called to get a name to identify the WriteSupport object model.
- getName() - Method in class org.apache.parquet.hadoop.example.GroupWriteSupport
- getNextDictionaryReader() - Method in class org.apache.parquet.hadoop.ParquetFileReader
-
Returns a
DictionaryPageReadStore
for the row group that would be returned by callingParquetFileReader.readNextRowGroup()
or skipped by callingParquetFileReader.skipNextRowGroup()
. - getNextRowGroupSize() - Method in class org.apache.parquet.hadoop.ParquetFileWriter
- getOffset() - Method in class org.apache.parquet.internal.hadoop.metadata.IndexReference
- getOffsetIndexReference() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
- getOrdinal() - Method in class org.apache.parquet.crypto.InternalColumnDecryptionSetup
- getOrdinal() - Method in class org.apache.parquet.crypto.InternalColumnEncryptionSetup
- getOrdinal() - Method in class org.apache.parquet.hadoop.metadata.BlockMetaData
- getOutputCommitter(TaskAttemptContext) - Method in class org.apache.parquet.hadoop.ParquetOutputFormat
- getPageSize(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
- getPageSize(JobContext) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
- getPageWriteChecksumEnabled(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
- getPageWriter(ColumnDescriptor) - Method in class org.apache.parquet.hadoop.ColumnChunkPageWriteStore
- getParquetCompressionCodec(Configuration) - Static method in class org.apache.parquet.hadoop.codec.CodecConfig
- getParquetMetadata() - Method in class org.apache.parquet.hadoop.Footer
- getPath() - Method in class org.apache.parquet.crypto.ColumnDecryptionProperties
- getPath() - Method in class org.apache.parquet.crypto.ColumnEncryptionProperties
- getPath() - Method in class org.apache.parquet.hadoop.metadata.BlockMetaData
- getPath() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
- getPath() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkProperties
- getPath() - Method in class org.apache.parquet.hadoop.ParquetFileReader
-
Deprecated.will be removed in 2.0.0; use
ParquetFileReader.getFile()
instead - getPath() - Method in class org.apache.parquet.hadoop.util.HadoopInputFile
- getPath() - Method in class org.apache.parquet.hadoop.util.HadoopOutputFile
- getPos() - Method in class org.apache.parquet.hadoop.ParquetFileWriter
- getPos() - Method in class org.apache.parquet.hadoop.util.CompressionConverter.TransParquetFileReader
- getPos() - Method in class org.apache.parquet.hadoop.util.HadoopPositionOutputStream
- getPrimitive(Type) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
- getPrimitiveType() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
- getPrimitiveType() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkProperties
- getProgress() - Method in class org.apache.parquet.hadoop.ParquetRecordReader
- getProperty(String) - Method in class org.apache.parquet.HadoopReadOptions
- getProperty(String) - Method in class org.apache.parquet.ParquetReadOptions
- getPropertyNames() - Method in class org.apache.parquet.ParquetReadOptions
- getReadSupport() - Method in class org.apache.parquet.hadoop.ParquetReader.Builder
- getReadSupportClass(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetInputFormat
- getReadSupportInstance(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetInputFormat
- getReadSupportMetadata() - Method in class org.apache.parquet.hadoop.api.ReadSupport.ReadContext
- getRecordCount() - Method in class org.apache.parquet.hadoop.ParquetFileReader
- getRecordFilter() - Method in class org.apache.parquet.ParquetReadOptions
- getRecordReader(InputSplit, JobConf, Reporter) - Method in class org.apache.parquet.hadoop.mapred.DeprecatedParquetInputFormat
- getRecordWriter(Configuration, Path, CompressionCodecName) - Method in class org.apache.parquet.hadoop.ParquetOutputFormat
- getRecordWriter(Configuration, Path, CompressionCodecName, ParquetFileWriter.Mode) - Method in class org.apache.parquet.hadoop.ParquetOutputFormat
- getRecordWriter(FileSystem, JobConf, String, Progressable) - Method in class org.apache.parquet.hadoop.mapred.DeprecatedParquetOutputFormat
- getRecordWriter(TaskAttemptContext) - Method in class org.apache.parquet.hadoop.ParquetOutputFormat
- getRecordWriter(TaskAttemptContext, Path) - Method in class org.apache.parquet.hadoop.ParquetOutputFormat
- getRecordWriter(TaskAttemptContext, Path, ParquetFileWriter.Mode) - Method in class org.apache.parquet.hadoop.ParquetOutputFormat
- getRecordWriter(TaskAttemptContext, ParquetFileWriter.Mode) - Method in class org.apache.parquet.hadoop.ParquetOutputFormat
- getRemaining() - Method in class org.apache.parquet.hadoop.codec.SnappyDecompressor
- getRequestedSchema() - Method in class org.apache.parquet.hadoop.api.ReadSupport.ReadContext
- getRowCount() - Method in class org.apache.parquet.hadoop.metadata.BlockMetaData
- getRowGroupOffsets() - Method in class org.apache.parquet.hadoop.ParquetInputSplit
-
Deprecated.will be removed in 2.0.0.
- getRowGroupOrdinal() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
- getRowGroups() - Method in class org.apache.parquet.hadoop.ParquetFileReader
- getSchema() - Method in class org.apache.parquet.hadoop.api.WriteSupport.WriteContext
- getSchema() - Method in class org.apache.parquet.hadoop.metadata.FileMetaData
- getSchema() - Method in class org.apache.parquet.hadoop.metadata.GlobalMetaData
- getSchema(Configuration) - Static method in class org.apache.parquet.hadoop.example.GroupWriteSupport
- getSchema(Job) - Static method in class org.apache.parquet.hadoop.example.ExampleOutputFormat
-
retrieve the schema from the conf
- getSchemaForRead(MessageType, String) - Static method in class org.apache.parquet.hadoop.api.ReadSupport
-
attempts to validate and construct a
MessageType
from a read projection schema - getSchemaForRead(MessageType, MessageType) - Static method in class org.apache.parquet.hadoop.api.ReadSupport
- getSignedFooterEncryptor() - Method in class org.apache.parquet.crypto.InternalFileEncryptor
- getSplits(Configuration, List<Footer>) - Method in class org.apache.parquet.hadoop.ParquetInputFormat
-
Deprecated.split planning using file footers will be removed
- getSplits(JobConf, int) - Method in class org.apache.parquet.hadoop.mapred.DeprecatedParquetInputFormat
- getSplits(JobContext) - Method in class org.apache.parquet.hadoop.ParquetInputFormat
- getStartingPos() - Method in class org.apache.parquet.hadoop.metadata.BlockMetaData
- getStartingPos() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
- getStatistics() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
- getStream() - Method in class org.apache.parquet.hadoop.util.CompressionConverter.TransParquetFileReader
- getTime() - Static method in class org.apache.parquet.hadoop.util.counters.BenchmarkCounter
- getTotalBytes() - Static method in class org.apache.parquet.hadoop.util.counters.BenchmarkCounter
- getTotalByteSize() - Method in class org.apache.parquet.hadoop.metadata.BlockMetaData
- getTotalSize() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
- getTotalUncompressedSize() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
- getType() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
-
Deprecated.will be removed in 2.0.0. Use
ColumnChunkMetaData.getPrimitiveType()
instead. - getType() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkProperties
-
Deprecated.will be removed in 2.0.0. Use
ColumnChunkProperties.getPrimitiveType()
instead. - getUnboundRecordFilter(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetInputFormat
-
Deprecated.
- getValidation(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
- getValidation(JobContext) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
- getValue() - Method in enum org.apache.parquet.crypto.ModuleCipherFactory.ModuleType
- getValueCount() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
- getWithEncryptedMetadata(ParquetMetadataConverter, ColumnPath, PrimitiveType, byte[], byte[], InternalFileDecryptor, int, int, String) - Static method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
- getWriterVersion(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
- getWriteSupport(Configuration) - Method in class org.apache.parquet.hadoop.example.ExampleParquetWriter.Builder
- getWriteSupport(Configuration) - Method in class org.apache.parquet.hadoop.ParquetOutputFormat
- getWriteSupport(Configuration) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
- getWriteSupportClass(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
- GlobalMetaData - Class in org.apache.parquet.hadoop.metadata
-
Merged metadata when reading from multiple files.
- GlobalMetaData(MessageType, Map<String, Set<String>>, Set<String>) - Constructor for class org.apache.parquet.hadoop.metadata.GlobalMetaData
- GroupReadSupport - Class in org.apache.parquet.hadoop.example
- GroupReadSupport() - Constructor for class org.apache.parquet.hadoop.example.GroupReadSupport
- GroupWriteSupport - Class in org.apache.parquet.hadoop.example
- GroupWriteSupport() - Constructor for class org.apache.parquet.hadoop.example.GroupWriteSupport
H
- HadoopCodecs - Class in org.apache.parquet.hadoop.util
- HadoopCodecs() - Constructor for class org.apache.parquet.hadoop.util.HadoopCodecs
- hadoopConfiguration - Variable in class org.apache.parquet.crypto.keytools.LocalWrapKmsClient
- HadoopFSKeyMaterialStore - Class in org.apache.parquet.crypto.keytools
- HadoopInputFile - Class in org.apache.parquet.hadoop.util
- HadoopOutputFile - Class in org.apache.parquet.hadoop.util
- HadoopPositionOutputStream - Class in org.apache.parquet.hadoop.util
- HadoopReadOptions - Class in org.apache.parquet
- HadoopReadOptions.Builder - Class in org.apache.parquet
- HadoopStreams - Class in org.apache.parquet.hadoop.util
-
Convenience methods to get Parquet abstractions for Hadoop data streams.
- HadoopStreams() - Constructor for class org.apache.parquet.hadoop.util.HadoopStreams
- hasCounterMethod(TaskAttemptContext) - Static method in class org.apache.parquet.hadoop.util.ContextUtil
- hasDictionaryPage() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
- HASH - org.apache.parquet.hadoop.util.ColumnMasker.MaskMode
- hashCode() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkProperties
- hashCode() - Method in class org.apache.parquet.hadoop.metadata.EncodingList
- HiddenFileFilter - Class in org.apache.parquet.hadoop.util
-
A
PathFilter
that filters out hidden files.
I
- ICounter - Interface in org.apache.parquet.hadoop.util.counters
-
Interface for counters in mapred/mapreduce package of hadoop
- incErrors(RecordMaterializer.RecordMaterializationException) - Method in class org.apache.parquet.hadoop.UnmaterializableRecordCounter
- increment(long) - Method in class org.apache.parquet.hadoop.util.counters.BenchmarkCounter.NullCounter
- increment(long) - Method in interface org.apache.parquet.hadoop.util.counters.ICounter
- increment(long) - Method in class org.apache.parquet.hadoop.util.counters.mapred.MapRedCounterAdapter
- increment(long) - Method in class org.apache.parquet.hadoop.util.counters.mapreduce.MapReduceCounterAdapter
- incrementBytesRead(long) - Static method in class org.apache.parquet.hadoop.util.counters.BenchmarkCounter
- incrementCounter(Counter, long) - Static method in class org.apache.parquet.hadoop.util.ContextUtil
- incrementTime(long) - Static method in class org.apache.parquet.hadoop.util.counters.BenchmarkCounter
- incrementTotalBytes(long) - Static method in class org.apache.parquet.hadoop.util.counters.BenchmarkCounter
- IndexReference - Class in org.apache.parquet.internal.hadoop.metadata
-
Reference to an index (OffsetIndex and ColumnIndex) for a row-group containing the offset and length values so the reader can read the referenced data.
- IndexReference(long, int) - Constructor for class org.apache.parquet.internal.hadoop.metadata.IndexReference
- init(Configuration) - Method in class org.apache.parquet.hadoop.api.DelegatingWriteSupport
- init(Configuration) - Method in class org.apache.parquet.hadoop.api.WriteSupport
-
called first in the task
- init(Configuration) - Method in class org.apache.parquet.hadoop.example.GroupWriteSupport
- init(Configuration, Map<String, String>, MessageType) - Method in class org.apache.parquet.hadoop.api.ReadSupport
-
Deprecated.override
ReadSupport.init(InitContext)
instead - init(Configuration, Map<String, String>, MessageType) - Method in class org.apache.parquet.hadoop.example.GroupReadSupport
- init(InitContext) - Method in class org.apache.parquet.hadoop.api.DelegatingReadSupport
- init(InitContext) - Method in class org.apache.parquet.hadoop.api.ReadSupport
-
called in
InputFormat.getSplits(org.apache.hadoop.mapreduce.JobContext)
in the front end - InitContext - Class in org.apache.parquet.hadoop.api
-
Context passed to ReadSupport when initializing for read
- InitContext(Configuration, Map<String, Set<String>>, MessageType) - Constructor for class org.apache.parquet.hadoop.api.InitContext
- initCounterFromContext(TaskAttemptContext) - Static method in class org.apache.parquet.hadoop.util.counters.BenchmarkCounter
-
Init counters in hadoop's mapreduce API, support both 1.x and 2.x
- initCounterFromReporter(Reporter, Configuration) - Static method in class org.apache.parquet.hadoop.util.counters.BenchmarkCounter
-
Init counters in hadoop's mapred API, which is used by cascading and Hive.
- initialize(Configuration, String, String, String) - Method in interface org.apache.parquet.crypto.keytools.KmsClient
-
Pass configuration with KMS-specific parameters.
- initialize(Configuration, String, String, String) - Method in class org.apache.parquet.crypto.keytools.LocalWrapKmsClient
- initialize(Path, Configuration, boolean) - Method in interface org.apache.parquet.crypto.keytools.FileKeyMaterialStore
-
Initializes key material store for a parquet file.
- initialize(Path, Configuration, boolean) - Method in class org.apache.parquet.crypto.keytools.HadoopFSKeyMaterialStore
- initialize(InputSplit, Configuration, Reporter) - Method in class org.apache.parquet.hadoop.ParquetRecordReader
- initialize(InputSplit, TaskAttemptContext) - Method in class org.apache.parquet.hadoop.ParquetRecordReader
- initializeInternal() - Method in class org.apache.parquet.crypto.keytools.LocalWrapKmsClient
-
Pass configuration with KMS-specific parameters.
- INSTANCE - Static variable in class org.apache.parquet.hadoop.util.HiddenFileFilter
- InternalColumnDecryptionSetup - Class in org.apache.parquet.crypto
- InternalColumnEncryptionSetup - Class in org.apache.parquet.crypto
- InternalFileDecryptor - Class in org.apache.parquet.crypto
- InternalFileDecryptor(FileDecryptionProperties) - Constructor for class org.apache.parquet.crypto.InternalFileDecryptor
- InternalFileEncryptor - Class in org.apache.parquet.crypto
- InternalFileEncryptor(FileEncryptionProperties) - Constructor for class org.apache.parquet.crypto.InternalFileEncryptor
- isCompressionSet(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
- isCompressionSet(JobContext) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
- isEnabled(String, boolean) - Method in class org.apache.parquet.ParquetReadOptions
- isEncrypted() - Method in class org.apache.parquet.crypto.ColumnEncryptionProperties
- isEncrypted() - Method in class org.apache.parquet.crypto.InternalColumnDecryptionSetup
- isEncrypted() - Method in class org.apache.parquet.crypto.InternalColumnEncryptionSetup
- isEncryptedWithFooterKey() - Method in class org.apache.parquet.crypto.ColumnEncryptionProperties
- isEncryptedWithFooterKey() - Method in class org.apache.parquet.crypto.InternalColumnEncryptionSetup
- isFooterEncrypted() - Method in class org.apache.parquet.crypto.InternalFileEncryptor
- isHadoopCompressionSet() - Method in class org.apache.parquet.hadoop.codec.CodecConfig
- isParquetCompressionSet(Configuration) - Static method in class org.apache.parquet.hadoop.codec.CodecConfig
- isSplitable(JobContext, Path) - Method in class org.apache.parquet.hadoop.ParquetInputFormat
- isTaskSideMetaData(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetInputFormat
- isTaskSideMetaData(JobConf) - Static method in class org.apache.parquet.hadoop.mapred.DeprecatedParquetInputFormat
- iterator() - Method in class org.apache.parquet.hadoop.metadata.EncodingList
J
- JOB_SUMMARY_LEVEL - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
-
Must be one of the values in
ParquetOutputFormat.JobSummaryLevel
(case insensitive)
K
- KEK_ID_LENGTH - Static variable in class org.apache.parquet.crypto.keytools.FileKeyWrapper
- KEK_LENGTH_DEFAULT - Static variable in class org.apache.parquet.crypto.keytools.KeyToolkit
- KEK_LENGTH_PROPERTY_NAME - Static variable in class org.apache.parquet.crypto.keytools.KeyToolkit
-
Length of key encryption keys (KEKs), randomly generated by parquet key management tools.
- KEY_ACCESS_TOKEN_DEFAULT - Static variable in interface org.apache.parquet.crypto.keytools.KmsClient
- KEY_ACCESS_TOKEN_PROPERTY_NAME - Static variable in class org.apache.parquet.crypto.keytools.KeyToolkit
-
Authorization token that will be passed to KMS.
- KEY_MATERIAL_FILE_PREFIX - Static variable in class org.apache.parquet.crypto.keytools.HadoopFSKeyMaterialStore
- KEY_MATERIAL_FILE_SUFFFIX - Static variable in class org.apache.parquet.crypto.keytools.HadoopFSKeyMaterialStore
- KEY_MATERIAL_INTERNAL_DEFAULT - Static variable in class org.apache.parquet.crypto.keytools.KeyToolkit
- KEY_MATERIAL_INTERNAL_PROPERTY_NAME - Static variable in class org.apache.parquet.crypto.keytools.KeyToolkit
-
Store key material inside Parquet file footers; this mode doesn’t produce additional files.
- KeyAccessDeniedException - Exception in org.apache.parquet.crypto
- KeyAccessDeniedException() - Constructor for exception org.apache.parquet.crypto.KeyAccessDeniedException
- KeyAccessDeniedException(String) - Constructor for exception org.apache.parquet.crypto.KeyAccessDeniedException
- KeyAccessDeniedException(String, Throwable) - Constructor for exception org.apache.parquet.crypto.KeyAccessDeniedException
- KeyAccessDeniedException(Throwable) - Constructor for exception org.apache.parquet.crypto.KeyAccessDeniedException
- KeyMaterial - Class in org.apache.parquet.crypto.keytools
-
KeyMaterial class represents the "key material", keeping the information that allows readers to recover an encryption key (see description of the KeyMetadata class).
- KeyMetadata - Class in org.apache.parquet.crypto.keytools
-
Parquet encryption specification defines "key metadata" as an arbitrary byte array, generated by file writers for each encryption key, and passed to the low level API for storage in the file footer .
- KeyToolkit - Class in org.apache.parquet.crypto.keytools
- KeyToolkit() - Constructor for class org.apache.parquet.crypto.keytools.KeyToolkit
- KeyValueMetadataMergeStrategy - Interface in org.apache.parquet.hadoop.metadata
-
Strategy to merge metadata.
- KMS_CLIENT_CLASS_PROPERTY_NAME - Static variable in class org.apache.parquet.crypto.keytools.KeyToolkit
-
Class implementing the KmsClient interface.
- KMS_INSTANCE_ID_DEFAULT - Static variable in interface org.apache.parquet.crypto.keytools.KmsClient
- KMS_INSTANCE_ID_PROPERTY_NAME - Static variable in class org.apache.parquet.crypto.keytools.KeyToolkit
-
ID of the KMS instance that will be used for encryption (if multiple KMS instances are available).
- KMS_INSTANCE_URL_DEFAULT - Static variable in interface org.apache.parquet.crypto.keytools.KmsClient
- KMS_INSTANCE_URL_PROPERTY_NAME - Static variable in class org.apache.parquet.crypto.keytools.KeyToolkit
-
URL of the KMS instance.
- KmsClient - Interface in org.apache.parquet.crypto.keytools
- kmsInstanceID - Variable in class org.apache.parquet.crypto.keytools.LocalWrapKmsClient
- kmsInstanceURL - Variable in class org.apache.parquet.crypto.keytools.LocalWrapKmsClient
- kmsToken - Variable in class org.apache.parquet.crypto.keytools.LocalWrapKmsClient
L
- listStatus(JobContext) - Method in class org.apache.parquet.hadoop.ParquetInputFormat
- loadFactory(Configuration) - Static method in interface org.apache.parquet.crypto.DecryptionPropertiesFactory
-
Load DecryptionPropertiesFactory class specified by CRYPTO_FACTORY_CLASS_PROPERTY_NAME as the path in the configuration
- loadFactory(Configuration) - Static method in interface org.apache.parquet.crypto.EncryptionPropertiesFactory
-
Load EncryptionPropertiesFactory class specified by CRYPTO_FACTORY_CLASS_PROPERTY_NAME as the path in the configuration
- LOCAL_WRAP_NO_KEY_VERSION - Static variable in class org.apache.parquet.crypto.keytools.LocalWrapKmsClient
- localNonce - Variable in class org.apache.parquet.crypto.AesCipher
- LocalWrapKmsClient - Class in org.apache.parquet.crypto.keytools
-
Typically, KMS systems support in-server key wrapping.
- LocalWrapKmsClient() - Constructor for class org.apache.parquet.crypto.keytools.LocalWrapKmsClient
- LOG - Static variable in interface org.apache.parquet.crypto.DecryptionPropertiesFactory
- LOG - Static variable in interface org.apache.parquet.crypto.EncryptionPropertiesFactory
M
- MAGIC - Static variable in class org.apache.parquet.hadoop.ParquetFileWriter
- MAGIC_STR - Static variable in class org.apache.parquet.hadoop.ParquetFileWriter
- main(String[]) - Static method in class org.apache.parquet.hadoop.PrintFooter
- MapRedCounterAdapter - Class in org.apache.parquet.hadoop.util.counters.mapred
-
Adapt a mapred counter to ICounter
- MapRedCounterAdapter(Counters.Counter) - Constructor for class org.apache.parquet.hadoop.util.counters.mapred.MapRedCounterAdapter
- MapRedCounterLoader - Class in org.apache.parquet.hadoop.util.counters.mapred
-
Concrete factory for counters in mapred API, get a counter using mapred API when the corresponding flag is set, otherwise return a NullCounter
- MapRedCounterLoader(Reporter, Configuration) - Constructor for class org.apache.parquet.hadoop.util.counters.mapred.MapRedCounterLoader
- MapredParquetOutputCommitter - Class in org.apache.parquet.hadoop.mapred
-
Adapter for supporting ParquetOutputCommitter in mapred API
- MapredParquetOutputCommitter() - Constructor for class org.apache.parquet.hadoop.mapred.MapredParquetOutputCommitter
- MapReduceCounterAdapter - Class in org.apache.parquet.hadoop.util.counters.mapreduce
-
Adapt a mapreduce counter to ICounter
- MapReduceCounterAdapter(Counter) - Constructor for class org.apache.parquet.hadoop.util.counters.mapreduce.MapReduceCounterAdapter
- MapReduceCounterLoader - Class in org.apache.parquet.hadoop.util.counters.mapreduce
-
Concrete factory for counters in mapred API, get a counter using mapreduce API when the corresponding flag is set, otherwise return a NullCounter
- MapReduceCounterLoader(TaskAttemptContext) - Constructor for class org.apache.parquet.hadoop.util.counters.mapreduce.MapReduceCounterLoader
- MAX_ASCENDING - org.apache.parquet.hadoop.ColumnIndexValidator.Contract
- MAX_DESCENDING - org.apache.parquet.hadoop.ColumnIndexValidator.Contract
- MAX_GTEQ_VALUE - org.apache.parquet.hadoop.ColumnIndexValidator.Contract
- MAX_PADDING_BYTES - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
- MAX_PADDING_SIZE_DEFAULT - Static variable in class org.apache.parquet.hadoop.ParquetWriter
- MAX_ROW_COUNT_FOR_PAGE_SIZE_CHECK - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
- MAX_STATS_SIZE - Static variable in class org.apache.parquet.format.converter.ParquetMetadataConverter
- maxAllocationSize - Variable in class org.apache.parquet.ParquetReadOptions.Builder
- MEMORY_POOL_RATIO - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
- MemoryManager - Class in org.apache.parquet.hadoop
-
Implements a memory manager that keeps a global context of how many Parquet writers there are and manages the memory between them.
- MemoryManager(float, long) - Constructor for class org.apache.parquet.hadoop.MemoryManager
- merge() - Method in class org.apache.parquet.hadoop.metadata.GlobalMetaData
-
Will merge the metadata as if it was coming from a single file.
- merge(Map<String, Set<String>>) - Method in class org.apache.parquet.hadoop.metadata.ConcatenatingKeyValueMetadataMergeStrategy
- merge(Map<String, Set<String>>) - Method in interface org.apache.parquet.hadoop.metadata.KeyValueMetadataMergeStrategy
- merge(Map<String, Set<String>>) - Method in class org.apache.parquet.hadoop.metadata.StrictKeyValueMetadataMergeStrategy
- merge(KeyValueMetadataMergeStrategy) - Method in class org.apache.parquet.hadoop.metadata.GlobalMetaData
-
Will merge the metadata as if it was coming from a single file.
- mergeMetadataFiles(List<Path>, Configuration) - Static method in class org.apache.parquet.hadoop.ParquetFileWriter
-
Deprecated.metadata files are not recommended and will be removed in 2.0.0
- mergeMetadataFiles(List<Path>, Configuration, KeyValueMetadataMergeStrategy) - Static method in class org.apache.parquet.hadoop.ParquetFileWriter
-
Deprecated.metadata files are not recommended and will be removed in 2.0.0
- metadataFilter - Variable in class org.apache.parquet.ParquetReadOptions.Builder
- MIN_ASCENDING - org.apache.parquet.hadoop.ColumnIndexValidator.Contract
- MIN_DESCENDING - org.apache.parquet.hadoop.ColumnIndexValidator.Contract
- MIN_LTEQ_VALUE - org.apache.parquet.hadoop.ColumnIndexValidator.Contract
- MIN_MEMORY_ALLOCATION - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
- MIN_ROW_COUNT_FOR_PAGE_SIZE_CHECK - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
- ModuleCipherFactory - Class in org.apache.parquet.crypto
- ModuleCipherFactory() - Constructor for class org.apache.parquet.crypto.ModuleCipherFactory
- ModuleCipherFactory.ModuleType - Enum in org.apache.parquet.crypto
- moveMaterialTo(FileKeyMaterialStore) - Method in interface org.apache.parquet.crypto.keytools.FileKeyMaterialStore
-
Move key material to another store.
- moveMaterialTo(FileKeyMaterialStore) - Method in class org.apache.parquet.crypto.keytools.HadoopFSKeyMaterialStore
N
- needsDictionary() - Method in class org.apache.parquet.hadoop.codec.SnappyDecompressor
- needsInput() - Method in class org.apache.parquet.hadoop.codec.SnappyCompressor
- needsInput() - Method in class org.apache.parquet.hadoop.codec.SnappyDecompressor
- newDirectFactory(Configuration, ByteBufferAllocator, int) - Static method in class org.apache.parquet.hadoop.util.HadoopCodecs
- newFactory(int) - Static method in class org.apache.parquet.hadoop.util.HadoopCodecs
- newFactory(Configuration, int) - Static method in class org.apache.parquet.hadoop.util.HadoopCodecs
- newGenericCounter(String, String, long) - Static method in class org.apache.parquet.hadoop.util.ContextUtil
- newJobContext(Configuration, JobID) - Static method in class org.apache.parquet.hadoop.util.ContextUtil
-
Creates JobContext from a JobConf and jobId using the correct constructor for based on Hadoop version.
- newStream() - Method in class org.apache.parquet.hadoop.util.HadoopInputFile
- newTaskAttemptContext(Configuration, TaskAttemptID) - Static method in class org.apache.parquet.hadoop.util.ContextUtil
-
Creates TaskAttemptContext from a JobConf and jobId using the correct constructor for based on Hadoop version.
- nextKeyValue() - Method in class org.apache.parquet.hadoop.ParquetRecordReader
- NO_FILTER - Static variable in class org.apache.parquet.format.converter.ParquetMetadataConverter
- NonBlockedCompressorStream - Class in org.apache.parquet.hadoop.codec
-
CompressorStream class that should be used instead of the default hadoop CompressorStream object.
- NonBlockedCompressorStream(OutputStream, Compressor, int) - Constructor for class org.apache.parquet.hadoop.codec.NonBlockedCompressorStream
- NonBlockedDecompressorStream - Class in org.apache.parquet.hadoop.codec
-
DecompressorStream class that should be used instead of the default hadoop DecompressorStream object.
- NonBlockedDecompressorStream(InputStream, Decompressor, int) - Constructor for class org.apache.parquet.hadoop.codec.NonBlockedDecompressorStream
- NONCE_LENGTH - Static variable in class org.apache.parquet.crypto.AesCipher
- NONE - org.apache.parquet.hadoop.ParquetOutputFormat.JobSummaryLevel
-
Write no summary files
- NULL_COUNT_CORRECT - org.apache.parquet.hadoop.ColumnIndexValidator.Contract
- NULL_PAGE_HAS_NO_MAX - org.apache.parquet.hadoop.ColumnIndexValidator.Contract
- NULL_PAGE_HAS_NO_MIN - org.apache.parquet.hadoop.ColumnIndexValidator.Contract
- NULL_PAGE_HAS_NO_VALUES - org.apache.parquet.hadoop.ColumnIndexValidator.Contract
- NullCounter() - Constructor for class org.apache.parquet.hadoop.util.counters.BenchmarkCounter.NullCounter
- NULLIFY - org.apache.parquet.hadoop.util.ColumnMasker.MaskMode
O
- OBJECT_MODEL_NAME_PROP - Static variable in class org.apache.parquet.hadoop.ParquetWriter
- OffsetIndex - org.apache.parquet.crypto.ModuleCipherFactory.ModuleType
- offsets(long...) - Static method in class org.apache.parquet.format.converter.ParquetMetadataConverter
- open(Configuration, Path) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
-
Deprecated.will be removed in 2.0.0; use
ParquetFileReader.open(InputFile)
- open(Configuration, Path, ParquetMetadataConverter.MetadataFilter) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
-
Deprecated.will be removed in 2.0.0; use
ParquetFileReader.open(InputFile,ParquetReadOptions)
- open(Configuration, Path, ParquetMetadata) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
-
Deprecated.will be removed in 2.0.0
- open(InputFile) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
-
Open a
file
. - open(InputFile, ParquetReadOptions) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
- org.apache.parquet - package org.apache.parquet
- org.apache.parquet.crypto - package org.apache.parquet.crypto
- org.apache.parquet.crypto.keytools - package org.apache.parquet.crypto.keytools
- org.apache.parquet.filter2.bloomfilterlevel - package org.apache.parquet.filter2.bloomfilterlevel
- org.apache.parquet.filter2.compat - package org.apache.parquet.filter2.compat
- org.apache.parquet.filter2.dictionarylevel - package org.apache.parquet.filter2.dictionarylevel
- org.apache.parquet.filter2.statisticslevel - package org.apache.parquet.filter2.statisticslevel
- org.apache.parquet.format.converter - package org.apache.parquet.format.converter
- org.apache.parquet.hadoop - package org.apache.parquet.hadoop
-
Provides classes to store use Parquet files in Hadoop In a map reduce job:
- org.apache.parquet.hadoop.api - package org.apache.parquet.hadoop.api
-
APIs to integrate various type systems with Parquet
- org.apache.parquet.hadoop.codec - package org.apache.parquet.hadoop.codec
- org.apache.parquet.hadoop.example - package org.apache.parquet.hadoop.example
- org.apache.parquet.hadoop.mapred - package org.apache.parquet.hadoop.mapred
- org.apache.parquet.hadoop.metadata - package org.apache.parquet.hadoop.metadata
- org.apache.parquet.hadoop.util - package org.apache.parquet.hadoop.util
- org.apache.parquet.hadoop.util.counters - package org.apache.parquet.hadoop.util.counters
- org.apache.parquet.hadoop.util.counters.mapred - package org.apache.parquet.hadoop.util.counters.mapred
- org.apache.parquet.hadoop.util.counters.mapreduce - package org.apache.parquet.hadoop.util.counters.mapreduce
- org.apache.parquet.internal.hadoop.metadata - package org.apache.parquet.internal.hadoop.metadata
- out - Variable in class org.apache.parquet.hadoop.ParquetFileWriter
- OVERWRITE - org.apache.parquet.hadoop.ParquetFileWriter.Mode
P
- PAGE_ROW_COUNT_LIMIT - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
- PAGE_SIZE - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
- PAGE_VERIFY_CHECKSUM_ENABLED - Static variable in class org.apache.parquet.hadoop.ParquetInputFormat
-
key to configure whether page level checksum verification is enabled
- PAGE_WRITE_CHECKSUM_ENABLED - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
- pageSize - Variable in class org.apache.parquet.hadoop.CodecFactory
- PARQUET_COMMON_METADATA_FILE - Static variable in class org.apache.parquet.hadoop.ParquetFileWriter
- PARQUET_COMPRESS_ZSTD_BUFFERPOOL_ENABLED - Static variable in class org.apache.parquet.hadoop.codec.ZstandardCodec
- PARQUET_COMPRESS_ZSTD_LEVEL - Static variable in class org.apache.parquet.hadoop.codec.ZstandardCodec
- PARQUET_COMPRESS_ZSTD_WORKERS - Static variable in class org.apache.parquet.hadoop.codec.ZstandardCodec
- PARQUET_EXAMPLE_SCHEMA - Static variable in class org.apache.parquet.hadoop.example.GroupWriteSupport
- PARQUET_METADATA_FILE - Static variable in class org.apache.parquet.hadoop.ParquetFileWriter
- PARQUET_READ_PARALLELISM - Static variable in class org.apache.parquet.hadoop.ParquetFileReader
- PARQUET_READ_SCHEMA - Static variable in class org.apache.parquet.hadoop.api.ReadSupport
-
configuration key for a parquet read projection schema
- ParquetCipher - Enum in org.apache.parquet.crypto
- ParquetCryptoRuntimeException - Exception in org.apache.parquet.crypto
-
Thrown upon encryption or decryption operation problem
- ParquetCryptoRuntimeException() - Constructor for exception org.apache.parquet.crypto.ParquetCryptoRuntimeException
- ParquetCryptoRuntimeException(String) - Constructor for exception org.apache.parquet.crypto.ParquetCryptoRuntimeException
- ParquetCryptoRuntimeException(String, Throwable) - Constructor for exception org.apache.parquet.crypto.ParquetCryptoRuntimeException
- ParquetCryptoRuntimeException(Throwable) - Constructor for exception org.apache.parquet.crypto.ParquetCryptoRuntimeException
- ParquetFileReader - Class in org.apache.parquet.hadoop
-
Internal implementation of the Parquet file reader as a block container
- ParquetFileReader(Configuration, Path, List<BlockMetaData>, List<ColumnDescriptor>) - Constructor for class org.apache.parquet.hadoop.ParquetFileReader
-
Deprecated.will be removed in 2.0.0.
- ParquetFileReader(Configuration, Path, ParquetMetadataConverter.MetadataFilter) - Constructor for class org.apache.parquet.hadoop.ParquetFileReader
-
Deprecated.will be removed in 2.0.0.
- ParquetFileReader(Configuration, Path, ParquetMetadata) - Constructor for class org.apache.parquet.hadoop.ParquetFileReader
-
Deprecated.will be removed in 2.0.0.
- ParquetFileReader(Configuration, FileMetaData, Path, List<BlockMetaData>, List<ColumnDescriptor>) - Constructor for class org.apache.parquet.hadoop.ParquetFileReader
-
Deprecated.will be removed in 2.0.0.
- ParquetFileReader(InputFile, ParquetReadOptions) - Constructor for class org.apache.parquet.hadoop.ParquetFileReader
- ParquetFileWriter - Class in org.apache.parquet.hadoop
-
Internal implementation of the Parquet file writer as a block container
- ParquetFileWriter(Configuration, MessageType, Path) - Constructor for class org.apache.parquet.hadoop.ParquetFileWriter
-
Deprecated.will be removed in 2.0.0
- ParquetFileWriter(Configuration, MessageType, Path, ParquetFileWriter.Mode) - Constructor for class org.apache.parquet.hadoop.ParquetFileWriter
-
Deprecated.will be removed in 2.0.0
- ParquetFileWriter(Configuration, MessageType, Path, ParquetFileWriter.Mode, long, int) - Constructor for class org.apache.parquet.hadoop.ParquetFileWriter
-
Deprecated.will be removed in 2.0.0
- ParquetFileWriter(OutputFile, MessageType, ParquetFileWriter.Mode, long, int) - Constructor for class org.apache.parquet.hadoop.ParquetFileWriter
-
Deprecated.will be removed in 2.0.0
- ParquetFileWriter(OutputFile, MessageType, ParquetFileWriter.Mode, long, int, int, int, boolean) - Constructor for class org.apache.parquet.hadoop.ParquetFileWriter
- ParquetFileWriter(OutputFile, MessageType, ParquetFileWriter.Mode, long, int, int, int, boolean, FileEncryptionProperties) - Constructor for class org.apache.parquet.hadoop.ParquetFileWriter
- ParquetFileWriter.Mode - Enum in org.apache.parquet.hadoop
- ParquetInputFormat<T> - Class in org.apache.parquet.hadoop
-
The input format to read a Parquet file.
- ParquetInputFormat() - Constructor for class org.apache.parquet.hadoop.ParquetInputFormat
-
Hadoop will instantiate using this constructor
- ParquetInputFormat(Class<S>) - Constructor for class org.apache.parquet.hadoop.ParquetInputFormat
-
Constructor for subclasses, such as AvroParquetInputFormat, or wrappers.
- ParquetInputSplit - Class in org.apache.parquet.hadoop
-
Deprecated.will be removed in 2.0.0. use org.apache.hadoop.mapred.FileSplit instead.
- ParquetInputSplit() - Constructor for class org.apache.parquet.hadoop.ParquetInputSplit
-
Deprecated.Writables must have a parameterless constructor
- ParquetInputSplit(Path, long, long, long, String[], long[]) - Constructor for class org.apache.parquet.hadoop.ParquetInputSplit
-
Deprecated.
- ParquetInputSplit(Path, long, long, String[], List<BlockMetaData>, String, String, Map<String, String>, Map<String, String>) - Constructor for class org.apache.parquet.hadoop.ParquetInputSplit
-
Deprecated.
- ParquetMetadata - Class in org.apache.parquet.hadoop.metadata
-
Meta Data block stored in the footer of the file contains file level (Codec, Schema, ...) and block level (location, columns, record count, ...) meta data
- ParquetMetadata(FileMetaData, List<BlockMetaData>) - Constructor for class org.apache.parquet.hadoop.metadata.ParquetMetadata
- ParquetMetadataConverter - Class in org.apache.parquet.format.converter
- ParquetMetadataConverter() - Constructor for class org.apache.parquet.format.converter.ParquetMetadataConverter
- ParquetMetadataConverter(int) - Constructor for class org.apache.parquet.format.converter.ParquetMetadataConverter
- ParquetMetadataConverter(Configuration) - Constructor for class org.apache.parquet.format.converter.ParquetMetadataConverter
-
Deprecated.will be removed in 2.0.0; use
ParquetMetadataConverter(ParquetReadOptions)
- ParquetMetadataConverter(ParquetReadOptions) - Constructor for class org.apache.parquet.format.converter.ParquetMetadataConverter
- ParquetMetadataConverter.MetadataFilter - Class in org.apache.parquet.format.converter
- ParquetOutputCommitter - Class in org.apache.parquet.hadoop
- ParquetOutputCommitter(Path, TaskAttemptContext) - Constructor for class org.apache.parquet.hadoop.ParquetOutputCommitter
- ParquetOutputFormat<T> - Class in org.apache.parquet.hadoop
-
OutputFormat to write to a Parquet file It requires a
WriteSupport
to convert the actual records to the underlying format. - ParquetOutputFormat() - Constructor for class org.apache.parquet.hadoop.ParquetOutputFormat
-
used when directly using the output format and configuring the write support implementation using parquet.write.support.class
- ParquetOutputFormat(S) - Constructor for class org.apache.parquet.hadoop.ParquetOutputFormat
-
constructor used when this OutputFormat in wrapped in another one (In Pig for example)
- ParquetOutputFormat.JobSummaryLevel - Enum in org.apache.parquet.hadoop
- ParquetReader<T> - Class in org.apache.parquet.hadoop
-
Read records from a Parquet file.
- ParquetReader(Configuration, Path, ReadSupport<T>) - Constructor for class org.apache.parquet.hadoop.ParquetReader
-
Deprecated.
- ParquetReader(Configuration, Path, ReadSupport<T>, UnboundRecordFilter) - Constructor for class org.apache.parquet.hadoop.ParquetReader
-
Deprecated.
- ParquetReader(Path, ReadSupport<T>) - Constructor for class org.apache.parquet.hadoop.ParquetReader
-
Deprecated.
- ParquetReader(Path, ReadSupport<T>, UnboundRecordFilter) - Constructor for class org.apache.parquet.hadoop.ParquetReader
-
Deprecated.
- ParquetReader.Builder<T> - Class in org.apache.parquet.hadoop
- ParquetReadOptions - Class in org.apache.parquet
- ParquetReadOptions.Builder - Class in org.apache.parquet
- ParquetRecordReader<T> - Class in org.apache.parquet.hadoop
-
Reads the records from a block of a Parquet file
- ParquetRecordReader(ReadSupport<T>) - Constructor for class org.apache.parquet.hadoop.ParquetRecordReader
- ParquetRecordReader(ReadSupport<T>, UnboundRecordFilter) - Constructor for class org.apache.parquet.hadoop.ParquetRecordReader
-
Deprecated.will be removed in 2.0.0.
- ParquetRecordReader(ReadSupport<T>, FilterCompat.Filter) - Constructor for class org.apache.parquet.hadoop.ParquetRecordReader
- ParquetRecordWriter<T> - Class in org.apache.parquet.hadoop
-
Writes records to a Parquet file
- ParquetRecordWriter(ParquetFileWriter, WriteSupport<T>, MessageType, Map<String, String>, int, int, CodecFactory.BytesCompressor, int, boolean, boolean, ParquetProperties.WriterVersion) - Constructor for class org.apache.parquet.hadoop.ParquetRecordWriter
-
Deprecated.
- ParquetRecordWriter(ParquetFileWriter, WriteSupport<T>, MessageType, Map<String, String>, long, int, CodecFactory.BytesCompressor, int, boolean, boolean, ParquetProperties.WriterVersion, MemoryManager) - Constructor for class org.apache.parquet.hadoop.ParquetRecordWriter
-
Deprecated.
- ParquetWriter<T> - Class in org.apache.parquet.hadoop
-
Write records to a Parquet file.
- ParquetWriter(Path, Configuration, WriteSupport<T>) - Constructor for class org.apache.parquet.hadoop.ParquetWriter
-
Deprecated.
- ParquetWriter(Path, WriteSupport<T>) - Constructor for class org.apache.parquet.hadoop.ParquetWriter
-
Deprecated.will be removed in 2.0.0
- ParquetWriter(Path, WriteSupport<T>, CompressionCodecName, int, int) - Constructor for class org.apache.parquet.hadoop.ParquetWriter
-
Deprecated.will be removed in 2.0.0
- ParquetWriter(Path, WriteSupport<T>, CompressionCodecName, int, int, boolean, boolean) - Constructor for class org.apache.parquet.hadoop.ParquetWriter
-
Deprecated.will be removed in 2.0.0
- ParquetWriter(Path, WriteSupport<T>, CompressionCodecName, int, int, int, boolean, boolean) - Constructor for class org.apache.parquet.hadoop.ParquetWriter
-
Deprecated.will be removed in 2.0.0
- ParquetWriter(Path, WriteSupport<T>, CompressionCodecName, int, int, int, boolean, boolean, ParquetProperties.WriterVersion) - Constructor for class org.apache.parquet.hadoop.ParquetWriter
-
Deprecated.will be removed in 2.0.0
- ParquetWriter(Path, WriteSupport<T>, CompressionCodecName, int, int, int, boolean, boolean, ParquetProperties.WriterVersion, Configuration) - Constructor for class org.apache.parquet.hadoop.ParquetWriter
-
Deprecated.will be removed in 2.0.0
- ParquetWriter(Path, ParquetFileWriter.Mode, WriteSupport<T>, CompressionCodecName, int, int, int, boolean, boolean, ParquetProperties.WriterVersion, Configuration) - Constructor for class org.apache.parquet.hadoop.ParquetWriter
-
Deprecated.will be removed in 2.0.0
- ParquetWriter.Builder<T,SELF extends ParquetWriter.Builder<T,SELF>> - Class in org.apache.parquet.hadoop
-
An abstract builder class for ParquetWriter instances.
- PLAINTEXT_FOOTER_DEFAULT - Static variable in class org.apache.parquet.crypto.keytools.PropertiesDrivenCryptoFactory
- PLAINTEXT_FOOTER_PROPERTY_NAME - Static variable in class org.apache.parquet.crypto.keytools.PropertiesDrivenCryptoFactory
-
Write files with plaintext footer.
- plaintextFile() - Method in class org.apache.parquet.crypto.InternalFileDecryptor
- plaintextFilesAllowed() - Method in class org.apache.parquet.crypto.InternalFileDecryptor
- positiveLongFitsInAnInt(long) - Static method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
-
checks that a positive long value fits in an int.
- prepareForRead(Configuration, Map<String, String>, MessageType, ReadSupport.ReadContext) - Method in class org.apache.parquet.hadoop.api.DelegatingReadSupport
- prepareForRead(Configuration, Map<String, String>, MessageType, ReadSupport.ReadContext) - Method in class org.apache.parquet.hadoop.api.ReadSupport
-
called in
RecordReader.initialize(org.apache.hadoop.mapreduce.InputSplit, org.apache.hadoop.mapreduce.TaskAttemptContext)
in the back end the returned RecordMaterializer will materialize the records and add them to the destination - prepareForRead(Configuration, Map<String, String>, MessageType, ReadSupport.ReadContext) - Method in class org.apache.parquet.hadoop.example.GroupReadSupport
- prepareForWrite(RecordConsumer) - Method in class org.apache.parquet.hadoop.api.DelegatingWriteSupport
- prepareForWrite(RecordConsumer) - Method in class org.apache.parquet.hadoop.api.WriteSupport
-
This will be called once per row group
- prepareForWrite(RecordConsumer) - Method in class org.apache.parquet.hadoop.example.GroupWriteSupport
- PrintFooter - Class in org.apache.parquet.hadoop
-
Utility to print footer information
- PrintFooter() - Constructor for class org.apache.parquet.hadoop.PrintFooter
- processBlocks(CompressionConverter.TransParquetFileReader, ParquetFileWriter, ParquetMetadata, MessageType, String, CompressionCodecName) - Method in class org.apache.parquet.hadoop.util.CompressionConverter
- processBlocks(CompressionConverter.TransParquetFileReader, ParquetFileWriter, ParquetMetadata, MessageType, List<String>, ColumnMasker.MaskMode) - Method in class org.apache.parquet.hadoop.util.ColumnMasker
- properties - Variable in class org.apache.parquet.ParquetReadOptions.Builder
- PropertiesDrivenCryptoFactory - Class in org.apache.parquet.crypto.keytools
- PropertiesDrivenCryptoFactory() - Constructor for class org.apache.parquet.crypto.keytools.PropertiesDrivenCryptoFactory
- pruneColumns(Configuration, Path, Path, List<String>) - Method in class org.apache.parquet.hadoop.util.ColumnPruner
Q
- quickUpdatePageAAD(byte[], int) - Static method in class org.apache.parquet.crypto.AesCipher
R
- randomGenerator - Variable in class org.apache.parquet.crypto.AesCipher
- range(long, long) - Static method in class org.apache.parquet.format.converter.ParquetMetadataConverter
-
[ startOffset, endOffset )
- read() - Method in class org.apache.parquet.hadoop.codec.ZstdDecompressorStream
- read() - Method in class org.apache.parquet.hadoop.ParquetReader
- read(byte[], int, int) - Method in class org.apache.parquet.hadoop.codec.NonBlockedDecompressorStream
- read(byte[], int, int) - Method in class org.apache.parquet.hadoop.codec.ZstdDecompressorStream
- read(InputFile) - Static method in class org.apache.parquet.hadoop.ParquetReader
- READ_SUPPORT_CLASS - Static variable in class org.apache.parquet.hadoop.ParquetInputFormat
-
key to configure the ReadSupport implementation
- readAllFootersInParallel(Configuration, List<FileStatus>) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
-
Deprecated.metadata files are not recommended and will be removed in 2.0.0
- readAllFootersInParallel(Configuration, List<FileStatus>, boolean) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
-
Deprecated.will be removed in 2.0.0; use
ParquetFileReader.open(InputFile, ParquetReadOptions)
- readAllFootersInParallel(Configuration, FileStatus) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
-
Deprecated.will be removed in 2.0.0; use
ParquetFileReader.open(InputFile, ParquetReadOptions)
- readAllFootersInParallel(Configuration, FileStatus, boolean) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
-
Deprecated.will be removed in 2.0.0; use
ParquetFileReader.open(InputFile, ParquetReadOptions)
- readAllFootersInParallelUsingSummaryFiles(Configuration, Collection<FileStatus>, boolean) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
-
Deprecated.metadata files are not recommended and will be removed in 2.0.0
- readAllFootersInParallelUsingSummaryFiles(Configuration, List<FileStatus>) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
-
Deprecated.metadata files are not recommended and will be removed in 2.0.0
- readBlock(int, CompressionConverter.TransParquetFileReader) - Method in class org.apache.parquet.hadoop.util.CompressionConverter
- readBlockAllocate(int, CompressionConverter.TransParquetFileReader) - Method in class org.apache.parquet.hadoop.util.CompressionConverter
- readBloomFilter(ColumnChunkMetaData) - Method in class org.apache.parquet.hadoop.BloomFilterReader
- readBloomFilter(ColumnChunkMetaData) - Method in class org.apache.parquet.hadoop.ParquetFileReader
-
Reads Bloom filter data for the given column chunk.
- readColumnIndex(ColumnChunkMetaData) - Method in class org.apache.parquet.hadoop.ParquetFileReader
- ReadContext(MessageType) - Constructor for class org.apache.parquet.hadoop.api.ReadSupport.ReadContext
- ReadContext(MessageType, Map<String, String>) - Constructor for class org.apache.parquet.hadoop.api.ReadSupport.ReadContext
- readFields(DataInput) - Method in class org.apache.parquet.hadoop.ParquetInputSplit
-
Deprecated.
- readFooter(Configuration, FileStatus) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
-
Deprecated.will be removed in 2.0.0; use
ParquetFileReader.open(InputFile, ParquetReadOptions)
- readFooter(Configuration, FileStatus, ParquetMetadataConverter.MetadataFilter) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
-
Deprecated.will be removed in 2.0.0; use
ParquetFileReader.open(InputFile, ParquetReadOptions)
- readFooter(Configuration, Path) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
-
Deprecated.will be removed in 2.0.0; use
ParquetFileReader.open(InputFile, ParquetReadOptions)
- readFooter(Configuration, Path, ParquetMetadataConverter.MetadataFilter) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
-
Deprecated.will be removed in 2.0.0; use
ParquetFileReader.open(InputFile, ParquetReadOptions)
- readFooter(InputFile, ParquetMetadataConverter.MetadataFilter) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
-
Deprecated.will be removed in 2.0.0; use
ParquetFileReader.open(InputFile, ParquetReadOptions)
- readFooters(Configuration, FileStatus) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
-
Deprecated.will be removed in 2.0.0; use
ParquetFileReader.open(InputFile, ParquetReadOptions)
- readFooters(Configuration, FileStatus, boolean) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
-
Deprecated.will be removed in 2.0.0; use
ParquetFileReader.open(InputFile, ParquetReadOptions)
- readFooters(Configuration, Path) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
-
Deprecated.will be removed in 2.0.0; use
ParquetFileReader.open(InputFile, ParquetReadOptions)
- readNextFilteredRowGroup() - Method in class org.apache.parquet.hadoop.ParquetFileReader
-
Reads all the columns requested from the row group at the current file position.
- readNextRowGroup() - Method in class org.apache.parquet.hadoop.ParquetFileReader
-
Reads all the columns requested from the row group at the current file position.
- readObjectFromConfAsBase64(String, Configuration) - Static method in class org.apache.parquet.hadoop.util.SerializationUtil
-
Reads an object (that was written using
SerializationUtil.writeObjectToConfAsBase64(java.lang.String, java.lang.Object, org.apache.hadoop.conf.Configuration)
) from a configuration - readOffsetIndex(ColumnChunkMetaData) - Method in class org.apache.parquet.hadoop.ParquetFileReader
- readPageHeader() - Method in class org.apache.parquet.hadoop.util.CompressionConverter.TransParquetFileReader
- readParquetMetadata(InputStream) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
-
Deprecated.
- readParquetMetadata(InputStream, ParquetMetadataConverter.MetadataFilter) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
- readParquetMetadata(InputStream, ParquetMetadataConverter.MetadataFilter, InternalFileDecryptor, boolean, int) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
- readSummaryFile(Configuration, FileStatus) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
-
Deprecated.metadata files are not recommended and will be removed in 2.0.0
- ReadSupport<T> - Class in org.apache.parquet.hadoop.api
-
Abstraction used by the
ParquetInputFormat
to materialize records - ReadSupport() - Constructor for class org.apache.parquet.hadoop.api.ReadSupport
- ReadSupport.ReadContext - Class in org.apache.parquet.hadoop.api
-
information to read the file
- realInputFormat - Variable in class org.apache.parquet.hadoop.mapred.DeprecatedParquetInputFormat
- realOutputFormat - Variable in class org.apache.parquet.hadoop.mapred.DeprecatedParquetOutputFormat
- RECORD_FILTERING_ENABLED - Static variable in class org.apache.parquet.hadoop.ParquetInputFormat
-
key to configure whether record-level filtering is enabled
- recordFilter - Variable in class org.apache.parquet.ParquetReadOptions.Builder
- REDACT - org.apache.parquet.hadoop.util.ColumnMasker.MaskMode
- registerScaleCallBack(String, Runnable) - Method in class org.apache.parquet.hadoop.MemoryManager
-
Register callback and deduplicate it if any.
- reinit(Configuration) - Method in class org.apache.parquet.hadoop.codec.SnappyCompressor
- release() - Method in class org.apache.parquet.hadoop.CodecFactory.BytesCompressor
-
Deprecated.
- release() - Method in class org.apache.parquet.hadoop.CodecFactory.BytesDecompressor
-
Deprecated.
- release() - Method in class org.apache.parquet.hadoop.CodecFactory
- removeCacheEntriesForAllTokens() - Static method in class org.apache.parquet.crypto.keytools.KeyToolkit
- removeCacheEntriesForToken(String) - Static method in class org.apache.parquet.crypto.keytools.KeyToolkit
-
Flush any caches that are tied to the (compromised) accessToken
- removeMaterial() - Method in interface org.apache.parquet.crypto.keytools.FileKeyMaterialStore
-
Remove key material from persistent store.
- removeMaterial() - Method in class org.apache.parquet.crypto.keytools.HadoopFSKeyMaterialStore
- reset() - Method in class org.apache.parquet.hadoop.codec.SnappyCompressor
- reset() - Method in class org.apache.parquet.hadoop.codec.SnappyDecompressor
- resetState() - Method in class org.apache.parquet.hadoop.codec.ZstdCompressorStream
- resetState() - Method in class org.apache.parquet.hadoop.codec.ZstdDecompressorStream
- rotateMasterKeys(String, Configuration) - Static method in class org.apache.parquet.crypto.keytools.KeyToolkit
-
Key rotation.
- RowGroupFilter - Class in org.apache.parquet.filter2.compat
-
Given a
FilterCompat.Filter
applies it to a list of BlockMetaData (row groups) If the Filter is anUnboundRecordFilter
or the no op filter, no filtering will be performed. - RowGroupFilter.FilterLevel - Enum in org.apache.parquet.filter2.compat
- rowGroupOrdinal - Variable in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
S
- saveMaterial() - Method in interface org.apache.parquet.crypto.keytools.FileKeyMaterialStore
-
After key material was added for all keys in the given Parquet file, save material in persistent store.
- saveMaterial() - Method in class org.apache.parquet.crypto.keytools.HadoopFSKeyMaterialStore
- self() - Method in class org.apache.parquet.hadoop.example.ExampleParquetWriter.Builder
- self() - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
- SerializationUtil - Class in org.apache.parquet.hadoop.util
-
Serialization utils copied from: https://github.com/kevinweil/elephant-bird/blob/master/core/src/main/java/com/twitter/elephantbird/util/HadoopUtils.java TODO: Refactor elephant-bird so that we can depend on utils like this without extra baggage.
- set(String, String) - Method in class org.apache.parquet.hadoop.ParquetReader.Builder
- set(String, String) - Method in class org.apache.parquet.ParquetReadOptions.Builder
- set(T) - Method in class org.apache.parquet.hadoop.mapred.Container
- setAsOutputFormat(JobConf) - Static method in class org.apache.parquet.hadoop.mapred.DeprecatedParquetOutputFormat
- setBlockSize(Configuration, int) - Static method in class org.apache.parquet.hadoop.mapred.DeprecatedParquetOutputFormat
- setBlockSize(Job, int) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
- setBloomFilterOffset(long) - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
- setColumnCryptoMetadata(ColumnPath, boolean, boolean, byte[], int) - Method in class org.apache.parquet.crypto.InternalFileDecryptor
- setColumnIndexReference(IndexReference) - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
- setColumnIndexTruncateLength(Configuration, int) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
- setColumnIndexTruncateLength(JobContext, int) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
- setCompression(Configuration, CompressionCodecName) - Static method in class org.apache.parquet.hadoop.mapred.DeprecatedParquetOutputFormat
- setCompression(Job, CompressionCodecName) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
- setConf(Configuration) - Method in class org.apache.parquet.hadoop.codec.SnappyCodec
- setConf(Configuration) - Method in class org.apache.parquet.hadoop.codec.ZstandardCodec
- setDictionary(byte[], int, int) - Method in class org.apache.parquet.hadoop.codec.SnappyCompressor
- setDictionary(byte[], int, int) - Method in class org.apache.parquet.hadoop.codec.SnappyDecompressor
- setDictionaryPageSize(Job, int) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
- setEnableDictionary(Configuration, boolean) - Static method in class org.apache.parquet.hadoop.mapred.DeprecatedParquetOutputFormat
- setEnableDictionary(Job, boolean) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
- setFileCryptoMetaData(EncryptionAlgorithm, boolean, byte[]) - Method in class org.apache.parquet.crypto.InternalFileDecryptor
- setFilterPredicate(Configuration, FilterPredicate) - Static method in class org.apache.parquet.hadoop.ParquetInputFormat
- setInput(byte[], int, int) - Method in class org.apache.parquet.hadoop.codec.SnappyCompressor
- setInput(byte[], int, int) - Method in class org.apache.parquet.hadoop.codec.SnappyDecompressor
-
Sets input data for decompression.
- setMaxPaddingSize(Configuration, int) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
- setMaxPaddingSize(JobContext, int) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
- setOffsetIndexReference(IndexReference) - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
- setOrdinal(int) - Method in class org.apache.parquet.hadoop.metadata.BlockMetaData
- setPageRowCountLimit(Configuration, int) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
- setPageRowCountLimit(JobContext, int) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
- setPageSize(Configuration, int) - Static method in class org.apache.parquet.hadoop.mapred.DeprecatedParquetOutputFormat
- setPageSize(Job, int) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
- setPageWriteChecksumEnabled(Configuration, boolean) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
- setPageWriteChecksumEnabled(JobContext, boolean) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
- setPath(String) - Method in class org.apache.parquet.hadoop.metadata.BlockMetaData
- setPlaintextFile() - Method in class org.apache.parquet.crypto.InternalFileDecryptor
- setReadSupportClass(JobConf, Class<?>) - Static method in class org.apache.parquet.hadoop.ParquetInputFormat
- setReadSupportClass(Job, Class<?>) - Static method in class org.apache.parquet.hadoop.ParquetInputFormat
- setRequestedSchema(MessageType) - Method in class org.apache.parquet.hadoop.ParquetFileReader
- setRowCount(long) - Method in class org.apache.parquet.hadoop.metadata.BlockMetaData
- setRowGroupOrdinal(int) - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
- setSchema(Job, MessageType) - Static method in class org.apache.parquet.hadoop.example.ExampleOutputFormat
-
set the schema being written to the job conf
- setSchema(MessageType, Configuration) - Static method in class org.apache.parquet.hadoop.example.GroupWriteSupport
- setStatisticsTruncateLength(JobContext, int) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
- setStreamPosition(long) - Method in class org.apache.parquet.hadoop.util.CompressionConverter.TransParquetFileReader
- setTaskSideMetaData(Job, boolean) - Static method in class org.apache.parquet.hadoop.ParquetInputFormat
- setTotalByteSize(long) - Method in class org.apache.parquet.hadoop.metadata.BlockMetaData
- setUnboundRecordFilter(Job, Class<? extends UnboundRecordFilter>) - Static method in class org.apache.parquet.hadoop.ParquetInputFormat
- setValidation(Configuration, boolean) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
- setValidation(JobContext, boolean) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
- setWriteSupportClass(Configuration, Class<?>) - Static method in class org.apache.parquet.hadoop.mapred.DeprecatedParquetOutputFormat
- setWriteSupportClass(JobConf, Class<?>) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
- setWriteSupportClass(Job, Class<?>) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
- size() - Method in class org.apache.parquet.hadoop.metadata.EncodingList
- SIZE_LENGTH - Static variable in class org.apache.parquet.crypto.AesCipher
- SIZE_LENGTH - Static variable in class org.apache.parquet.crypto.ModuleCipherFactory
- SKIP_ROW_GROUPS - Static variable in class org.apache.parquet.format.converter.ParquetMetadataConverter
- skipNextRowGroup() - Method in class org.apache.parquet.hadoop.ParquetFileReader
- SnappyCodec - Class in org.apache.parquet.hadoop.codec
-
Snappy compression codec for Parquet.
- SnappyCodec() - Constructor for class org.apache.parquet.hadoop.codec.SnappyCodec
- SnappyCompressor - Class in org.apache.parquet.hadoop.codec
-
This class is a wrapper around the snappy compressor.
- SnappyCompressor() - Constructor for class org.apache.parquet.hadoop.codec.SnappyCompressor
- SnappyDecompressor - Class in org.apache.parquet.hadoop.codec
- SnappyDecompressor() - Constructor for class org.apache.parquet.hadoop.codec.SnappyDecompressor
- SnappyUtil - Class in org.apache.parquet.hadoop.codec
-
Utilities for SnappyCompressor and SnappyDecompressor.
- SnappyUtil() - Constructor for class org.apache.parquet.hadoop.codec.SnappyUtil
- SPLIT_FILES - Static variable in class org.apache.parquet.hadoop.ParquetInputFormat
-
key to turn off file splitting.
- start() - Method in class org.apache.parquet.hadoop.ParquetFileWriter
-
start the file
- startBlock(long) - Method in class org.apache.parquet.hadoop.ParquetFileWriter
-
start a block
- startColumn(ColumnDescriptor, long, CompressionCodecName) - Method in class org.apache.parquet.hadoop.ParquetFileWriter
-
start a column inside a block
- STATISTICS - org.apache.parquet.filter2.compat.RowGroupFilter.FilterLevel
- STATISTICS_TRUNCATE_LENGTH - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
- StatisticsFilter - Class in org.apache.parquet.filter2.statisticslevel
-
Applies a
FilterPredicate
to statistics about a group of records. - STATS_FILTERING_ENABLED - Static variable in class org.apache.parquet.hadoop.ParquetInputFormat
-
key to configure whether row group stats filtering is enabled
- STRICT_TYPE_CHECKING - Static variable in class org.apache.parquet.hadoop.ParquetInputFormat
-
key to configure type checking for conflicting schemas (default: true)
- StrictKeyValueMetadataMergeStrategy - Class in org.apache.parquet.hadoop.metadata
-
Strategy to throw errors if there are multiple values for a given key in metadata.
- StrictKeyValueMetadataMergeStrategy() - Constructor for class org.apache.parquet.hadoop.metadata.StrictKeyValueMetadataMergeStrategy
- supportsBlockSize() - Method in class org.apache.parquet.hadoop.util.HadoopOutputFile
- sync() - Method in class org.apache.parquet.hadoop.util.HadoopPositionOutputStream
T
- TagVerificationException - Exception in org.apache.parquet.crypto
- TagVerificationException() - Constructor for exception org.apache.parquet.crypto.TagVerificationException
- TagVerificationException(String) - Constructor for exception org.apache.parquet.crypto.TagVerificationException
- TagVerificationException(String, Throwable) - Constructor for exception org.apache.parquet.crypto.TagVerificationException
- TagVerificationException(Throwable) - Constructor for exception org.apache.parquet.crypto.TagVerificationException
- TASK_SIDE_METADATA - Static variable in class org.apache.parquet.hadoop.ParquetInputFormat
-
key to turn on or off task side metadata loading (default true) if true then metadata is read on the task side and some tasks may finish immediately.
- TEMP_FILE_PREFIX - Static variable in class org.apache.parquet.crypto.keytools.HadoopFSKeyMaterialStore
- toBloomFilterHeader(BloomFilter) - Static method in class org.apache.parquet.format.converter.ParquetMetadataConverter
- toJSON(ParquetMetadata) - Static method in class org.apache.parquet.hadoop.metadata.ParquetMetadata
- toList() - Method in class org.apache.parquet.hadoop.metadata.EncodingList
- toParquetColumnIndex(PrimitiveType, ColumnIndex) - Static method in class org.apache.parquet.format.converter.ParquetMetadataConverter
- toParquetMetadata(int, ParquetMetadata) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
- toParquetMetadata(int, ParquetMetadata, InternalFileEncryptor) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
- toParquetOffsetIndex(OffsetIndex) - Static method in class org.apache.parquet.format.converter.ParquetMetadataConverter
- toParquetStatistics(Statistics) - Static method in class org.apache.parquet.format.converter.ParquetMetadataConverter
- toParquetStatistics(Statistics, int) - Static method in class org.apache.parquet.format.converter.ParquetMetadataConverter
- toPrettyJSON(ParquetMetadata) - Static method in class org.apache.parquet.hadoop.metadata.ParquetMetadata
- toString() - Method in class org.apache.parquet.hadoop.api.DelegatingReadSupport
- toString() - Method in class org.apache.parquet.hadoop.api.DelegatingWriteSupport
- toString() - Method in class org.apache.parquet.hadoop.ColumnIndexValidator.ContractViolation
- toString() - Method in class org.apache.parquet.hadoop.Footer
- toString() - Method in class org.apache.parquet.hadoop.metadata.BlockMetaData
- toString() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
- toString() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkProperties
- toString() - Method in class org.apache.parquet.hadoop.metadata.FileMetaData
- toString() - Method in class org.apache.parquet.hadoop.metadata.GlobalMetaData
- toString() - Method in class org.apache.parquet.hadoop.metadata.ParquetMetadata
- toString() - Method in class org.apache.parquet.hadoop.ParquetInputSplit
-
Deprecated.
- toString() - Method in class org.apache.parquet.hadoop.util.HadoopInputFile
- toString() - Method in class org.apache.parquet.hadoop.util.HadoopOutputFile
- TransParquetFileReader(InputFile, ParquetReadOptions) - Constructor for class org.apache.parquet.hadoop.util.CompressionConverter.TransParquetFileReader
U
- UNBOUND_RECORD_FILTER - Static variable in class org.apache.parquet.hadoop.ParquetInputFormat
-
key to configure the filter
- UnmaterializableRecordCounter - Class in org.apache.parquet.hadoop
-
Tracks number of records that cannot be materialized and throws ParquetDecodingException if the rate of errors crosses a limit.
- UnmaterializableRecordCounter(double, long) - Constructor for class org.apache.parquet.hadoop.UnmaterializableRecordCounter
- UnmaterializableRecordCounter(Configuration, long) - Constructor for class org.apache.parquet.hadoop.UnmaterializableRecordCounter
- UnmaterializableRecordCounter(ParquetReadOptions, long) - Constructor for class org.apache.parquet.hadoop.UnmaterializableRecordCounter
- unwrapKey(String, String) - Method in interface org.apache.parquet.crypto.keytools.KmsClient
-
Decrypts (unwraps) a key with the master key.
- unwrapKey(String, String) - Method in class org.apache.parquet.crypto.keytools.LocalWrapKmsClient
- useBloomFilter - Variable in class org.apache.parquet.ParquetReadOptions.Builder
- useBloomFilter() - Method in class org.apache.parquet.hadoop.ParquetReader.Builder
- useBloomFilter() - Method in class org.apache.parquet.ParquetReadOptions.Builder
- useBloomFilter() - Method in class org.apache.parquet.ParquetReadOptions
- useBloomFilter(boolean) - Method in class org.apache.parquet.hadoop.ParquetReader.Builder
- useBloomFilter(boolean) - Method in class org.apache.parquet.ParquetReadOptions.Builder
- useColumnIndexFilter - Variable in class org.apache.parquet.ParquetReadOptions.Builder
- useColumnIndexFilter() - Method in class org.apache.parquet.hadoop.ParquetReader.Builder
- useColumnIndexFilter() - Method in class org.apache.parquet.ParquetReadOptions.Builder
- useColumnIndexFilter() - Method in class org.apache.parquet.ParquetReadOptions
- useColumnIndexFilter(boolean) - Method in class org.apache.parquet.hadoop.ParquetReader.Builder
- useColumnIndexFilter(boolean) - Method in class org.apache.parquet.ParquetReadOptions.Builder
- useDictionaryFilter - Variable in class org.apache.parquet.ParquetReadOptions.Builder
- useDictionaryFilter() - Method in class org.apache.parquet.hadoop.ParquetReader.Builder
- useDictionaryFilter() - Method in class org.apache.parquet.ParquetReadOptions.Builder
- useDictionaryFilter() - Method in class org.apache.parquet.ParquetReadOptions
- useDictionaryFilter(boolean) - Method in class org.apache.parquet.hadoop.ParquetReader.Builder
- useDictionaryFilter(boolean) - Method in class org.apache.parquet.ParquetReadOptions.Builder
- usePageChecksumVerification - Variable in class org.apache.parquet.ParquetReadOptions.Builder
- usePageChecksumVerification() - Method in class org.apache.parquet.hadoop.ParquetReader.Builder
- usePageChecksumVerification() - Method in class org.apache.parquet.ParquetReadOptions.Builder
- usePageChecksumVerification() - Method in class org.apache.parquet.ParquetReadOptions
- usePageChecksumVerification(boolean) - Method in class org.apache.parquet.hadoop.ParquetReader.Builder
- usePageChecksumVerification(boolean) - Method in class org.apache.parquet.ParquetReadOptions.Builder
- useRecordFilter - Variable in class org.apache.parquet.ParquetReadOptions.Builder
- useRecordFilter() - Method in class org.apache.parquet.hadoop.ParquetReader.Builder
- useRecordFilter() - Method in class org.apache.parquet.ParquetReadOptions.Builder
- useRecordFilter() - Method in class org.apache.parquet.ParquetReadOptions
- useRecordFilter(boolean) - Method in class org.apache.parquet.hadoop.ParquetReader.Builder
- useRecordFilter(boolean) - Method in class org.apache.parquet.ParquetReadOptions.Builder
- useSignedStringMinMax - Variable in class org.apache.parquet.ParquetReadOptions.Builder
- useSignedStringMinMax() - Method in class org.apache.parquet.hadoop.ParquetReader.Builder
- useSignedStringMinMax() - Method in class org.apache.parquet.ParquetReadOptions.Builder
- useSignedStringMinMax() - Method in class org.apache.parquet.ParquetReadOptions
- useSignedStringMinMax(boolean) - Method in class org.apache.parquet.hadoop.ParquetReader.Builder
- useSignedStringMinMax(boolean) - Method in class org.apache.parquet.ParquetReadOptions.Builder
- useStatsFilter - Variable in class org.apache.parquet.ParquetReadOptions.Builder
- useStatsFilter() - Method in class org.apache.parquet.hadoop.ParquetReader.Builder
- useStatsFilter() - Method in class org.apache.parquet.ParquetReadOptions.Builder
- useStatsFilter() - Method in class org.apache.parquet.ParquetReadOptions
- useStatsFilter(boolean) - Method in class org.apache.parquet.hadoop.ParquetReader.Builder
- useStatsFilter(boolean) - Method in class org.apache.parquet.ParquetReadOptions.Builder
V
- validateBuffer(byte[], int, int) - Static method in class org.apache.parquet.hadoop.codec.SnappyUtil
- VALIDATION - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
- valueOf(String) - Static method in enum org.apache.parquet.crypto.AesMode
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum org.apache.parquet.crypto.ModuleCipherFactory.ModuleType
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum org.apache.parquet.crypto.ParquetCipher
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum org.apache.parquet.filter2.compat.RowGroupFilter.FilterLevel
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum org.apache.parquet.hadoop.ColumnIndexValidator.Contract
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum org.apache.parquet.hadoop.ParquetFileWriter.Mode
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum org.apache.parquet.hadoop.ParquetOutputFormat.JobSummaryLevel
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum org.apache.parquet.hadoop.util.ColumnMasker.MaskMode
-
Returns the enum constant of this type with the specified name.
- values() - Static method in enum org.apache.parquet.crypto.AesMode
-
Returns an array containing the constants of this enum type, in the order they are declared.
- values() - Static method in enum org.apache.parquet.crypto.ModuleCipherFactory.ModuleType
-
Returns an array containing the constants of this enum type, in the order they are declared.
- values() - Static method in enum org.apache.parquet.crypto.ParquetCipher
-
Returns an array containing the constants of this enum type, in the order they are declared.
- values() - Static method in enum org.apache.parquet.filter2.compat.RowGroupFilter.FilterLevel
-
Returns an array containing the constants of this enum type, in the order they are declared.
- values() - Static method in enum org.apache.parquet.hadoop.ColumnIndexValidator.Contract
-
Returns an array containing the constants of this enum type, in the order they are declared.
- values() - Static method in enum org.apache.parquet.hadoop.ParquetFileWriter.Mode
-
Returns an array containing the constants of this enum type, in the order they are declared.
- values() - Static method in enum org.apache.parquet.hadoop.ParquetOutputFormat.JobSummaryLevel
-
Returns an array containing the constants of this enum type, in the order they are declared.
- values() - Static method in enum org.apache.parquet.hadoop.util.ColumnMasker.MaskMode
-
Returns an array containing the constants of this enum type, in the order they are declared.
- verify(byte[]) - Method in interface org.apache.parquet.crypto.AADPrefixVerifier
-
Verifies identity (AAD Prefix) of individual file, or of file collection in a data set.
- visit(FilterCompat.FilterPredicateCompat) - Method in class org.apache.parquet.filter2.compat.RowGroupFilter
- visit(FilterCompat.NoOpFilter) - Method in class org.apache.parquet.filter2.compat.RowGroupFilter
- visit(FilterCompat.UnboundRecordFilterCompat) - Method in class org.apache.parquet.filter2.compat.RowGroupFilter
- visit(Operators.And) - Method in class org.apache.parquet.filter2.bloomfilterlevel.BloomFilterImpl
- visit(Operators.And) - Method in class org.apache.parquet.filter2.dictionarylevel.DictionaryFilter
- visit(Operators.And) - Method in class org.apache.parquet.filter2.statisticslevel.StatisticsFilter
- visit(Operators.Eq<T>) - Method in class org.apache.parquet.filter2.bloomfilterlevel.BloomFilterImpl
- visit(Operators.Eq<T>) - Method in class org.apache.parquet.filter2.dictionarylevel.DictionaryFilter
- visit(Operators.Eq<T>) - Method in class org.apache.parquet.filter2.statisticslevel.StatisticsFilter
- visit(Operators.Gt<T>) - Method in class org.apache.parquet.filter2.bloomfilterlevel.BloomFilterImpl
- visit(Operators.Gt<T>) - Method in class org.apache.parquet.filter2.dictionarylevel.DictionaryFilter
- visit(Operators.Gt<T>) - Method in class org.apache.parquet.filter2.statisticslevel.StatisticsFilter
- visit(Operators.GtEq<T>) - Method in class org.apache.parquet.filter2.bloomfilterlevel.BloomFilterImpl
- visit(Operators.GtEq<T>) - Method in class org.apache.parquet.filter2.dictionarylevel.DictionaryFilter
- visit(Operators.GtEq<T>) - Method in class org.apache.parquet.filter2.statisticslevel.StatisticsFilter
- visit(Operators.LogicalNotUserDefined<T, U>) - Method in class org.apache.parquet.filter2.bloomfilterlevel.BloomFilterImpl
- visit(Operators.LogicalNotUserDefined<T, U>) - Method in class org.apache.parquet.filter2.dictionarylevel.DictionaryFilter
- visit(Operators.LogicalNotUserDefined<T, U>) - Method in class org.apache.parquet.filter2.statisticslevel.StatisticsFilter
- visit(Operators.Lt<T>) - Method in class org.apache.parquet.filter2.bloomfilterlevel.BloomFilterImpl
- visit(Operators.Lt<T>) - Method in class org.apache.parquet.filter2.dictionarylevel.DictionaryFilter
- visit(Operators.Lt<T>) - Method in class org.apache.parquet.filter2.statisticslevel.StatisticsFilter
- visit(Operators.LtEq<T>) - Method in class org.apache.parquet.filter2.bloomfilterlevel.BloomFilterImpl
- visit(Operators.LtEq<T>) - Method in class org.apache.parquet.filter2.dictionarylevel.DictionaryFilter
- visit(Operators.LtEq<T>) - Method in class org.apache.parquet.filter2.statisticslevel.StatisticsFilter
- visit(Operators.Not) - Method in class org.apache.parquet.filter2.bloomfilterlevel.BloomFilterImpl
- visit(Operators.Not) - Method in class org.apache.parquet.filter2.dictionarylevel.DictionaryFilter
- visit(Operators.Not) - Method in class org.apache.parquet.filter2.statisticslevel.StatisticsFilter
- visit(Operators.NotEq<T>) - Method in class org.apache.parquet.filter2.bloomfilterlevel.BloomFilterImpl
- visit(Operators.NotEq<T>) - Method in class org.apache.parquet.filter2.dictionarylevel.DictionaryFilter
- visit(Operators.NotEq<T>) - Method in class org.apache.parquet.filter2.statisticslevel.StatisticsFilter
- visit(Operators.Or) - Method in class org.apache.parquet.filter2.bloomfilterlevel.BloomFilterImpl
- visit(Operators.Or) - Method in class org.apache.parquet.filter2.dictionarylevel.DictionaryFilter
- visit(Operators.Or) - Method in class org.apache.parquet.filter2.statisticslevel.StatisticsFilter
- visit(Operators.UserDefined<T, U>) - Method in class org.apache.parquet.filter2.bloomfilterlevel.BloomFilterImpl
- visit(Operators.UserDefined<T, U>) - Method in class org.apache.parquet.filter2.dictionarylevel.DictionaryFilter
- visit(Operators.UserDefined<T, U>) - Method in class org.apache.parquet.filter2.statisticslevel.StatisticsFilter
W
- withAADPrefix(byte[]) - Method in class org.apache.parquet.crypto.FileDecryptionProperties.Builder
-
Explicitly supply the file AAD prefix.
- withAADPrefix(byte[]) - Method in class org.apache.parquet.crypto.FileEncryptionProperties.Builder
-
Set the file AAD Prefix.
- withAADPrefixVerifier(AADPrefixVerifier) - Method in class org.apache.parquet.crypto.FileDecryptionProperties.Builder
-
Set callback for verification of AAD Prefixes stored in file.
- withAlgorithm(ParquetCipher) - Method in class org.apache.parquet.crypto.FileEncryptionProperties.Builder
-
Set encryption algorithm.
- withAllocator(ByteBufferAllocator) - Method in class org.apache.parquet.ParquetReadOptions.Builder
- withBloomFilterEnabled(boolean) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
Sets the bloom filter enabled/disabled
- withBloomFilterEnabled(String, boolean) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
Sets the bloom filter enabled/disabled for the specified column.
- withBloomFilterNDV(String, long) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
Sets the NDV (number of distinct values) for the specified column.
- withByteStreamSplitEncoding(boolean) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
- withCodecFactory(CompressionCodecFactory) - Method in class org.apache.parquet.hadoop.ParquetReader.Builder
- withCodecFactory(CompressionCodecFactory) - Method in class org.apache.parquet.ParquetReadOptions.Builder
- withColumnKeys(Map<ColumnPath, ColumnDecryptionProperties>) - Method in class org.apache.parquet.crypto.FileDecryptionProperties.Builder
-
Set explicit column keys (decryption properties).
- withCompressionCodec(CompressionCodecName) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
Set the
compression codec
used by the constructed writer. - withConf(Configuration) - Method in class org.apache.parquet.hadoop.ParquetReader.Builder
- withConf(Configuration) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
Set the
Configuration
used by the constructed writer. - withDecryption(FileDecryptionProperties) - Method in class org.apache.parquet.hadoop.ParquetReader.Builder
- withDecryption(FileDecryptionProperties) - Method in class org.apache.parquet.ParquetReadOptions.Builder
- withDictionaryEncoding(boolean) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
Enable or disable dictionary encoding for the constructed writer.
- withDictionaryEncoding(String, boolean) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
Enable or disable dictionary encoding of the specified column for the constructed writer.
- withDictionaryPageSize(int) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
Set the Parquet format dictionary page size used by the constructed writer.
- withEncryptedColumns(Map<ColumnPath, ColumnEncryptionProperties>) - Method in class org.apache.parquet.crypto.FileEncryptionProperties.Builder
-
Set the list of encrypted columns and their properties (keys etc).
- withEncryption(FileEncryptionProperties) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
Set the
file encryption properties
used by the constructed writer. - withExtraMetaData(Map<String, String>) - Method in class org.apache.parquet.hadoop.example.ExampleParquetWriter.Builder
- withFileRange(long, long) - Method in class org.apache.parquet.hadoop.ParquetReader.Builder
- withFilter(FilterCompat.Filter) - Method in class org.apache.parquet.hadoop.ParquetReader.Builder
- withFooterKey(byte[]) - Method in class org.apache.parquet.crypto.FileDecryptionProperties.Builder
-
Set an explicit footer key.
- withFooterKeyID(String) - Method in class org.apache.parquet.crypto.FileEncryptionProperties.Builder
-
Set a key retrieval metadata (converted from String).
- withFooterKeyMetadata(byte[]) - Method in class org.apache.parquet.crypto.FileEncryptionProperties.Builder
-
Set a key retrieval metadata.
- withKey(byte[]) - Method in class org.apache.parquet.crypto.ColumnDecryptionProperties.Builder
-
Set an explicit column key.
- withKey(byte[]) - Method in class org.apache.parquet.crypto.ColumnEncryptionProperties.Builder
-
Set a column-specific key.
- withKeyID(String) - Method in class org.apache.parquet.crypto.ColumnEncryptionProperties.Builder
-
Set a key retrieval metadata (converted from String).
- withKeyMetaData(byte[]) - Method in class org.apache.parquet.crypto.ColumnEncryptionProperties.Builder
-
Set a key retrieval metadata.
- withKeyRetriever(DecryptionKeyRetriever) - Method in class org.apache.parquet.crypto.FileDecryptionProperties.Builder
-
Set a key retriever callback.
- withMaxAllocationInBytes(int) - Method in class org.apache.parquet.ParquetReadOptions.Builder
- withMaxPaddingSize(int) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
Set the maximum amount of padding, in bytes, that will be used to align row groups with blocks in the underlying filesystem.
- withMetadataFilter(ParquetMetadataConverter.MetadataFilter) - Method in class org.apache.parquet.ParquetReadOptions.Builder
- withOffsets(long...) - Method in class org.apache.parquet.ParquetReadOptions.Builder
- withoutAADPrefixStorage() - Method in class org.apache.parquet.crypto.FileEncryptionProperties.Builder
-
Skip storing AAD Prefix in file metadata.
- withoutFooterSignatureVerification() - Method in class org.apache.parquet.crypto.FileDecryptionProperties.Builder
-
Skip integrity verification of plaintext footers.
- withPageChecksumVerification(boolean) - Method in class org.apache.parquet.ParquetReadOptions.Builder
- withPageRowCountLimit(int) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
Sets the Parquet format page row count limit used by the constructed writer.
- withPageSize(int) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
Set the Parquet format page size used by the constructed writer.
- withPageWriteChecksumEnabled(boolean) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
Enables writing page level checksums for the constructed writer.
- withPlaintextFilesAllowed() - Method in class org.apache.parquet.crypto.FileDecryptionProperties.Builder
-
By default, reading plaintext (unencrypted) files is not allowed when using a decryptor - in order to detect files that were not encrypted by mistake.
- withPlaintextFooter() - Method in class org.apache.parquet.crypto.FileEncryptionProperties.Builder
-
Create files with plaintext footer.
- withRange(long, long) - Method in class org.apache.parquet.ParquetReadOptions.Builder
- withRecordFilter(FilterCompat.Filter) - Method in class org.apache.parquet.ParquetReadOptions.Builder
- withRowGroupSize(int) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
Deprecated.Use
ParquetWriter.Builder.withRowGroupSize(long)
instead - withRowGroupSize(long) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
Set the Parquet format row group size used by the constructed writer.
- withType(MessageType) - Method in class org.apache.parquet.hadoop.example.ExampleParquetWriter.Builder
- withValidation(boolean) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
Enable or disable validation for the constructed writer.
- withWriteMode(ParquetFileWriter.Mode) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
Set the
write mode
used when creating the backing file for this writer. - withWriterVersion(ParquetProperties.WriterVersion) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
-
Set the
format version
used by the constructed writer. - wrap(FSDataInputStream) - Static method in class org.apache.parquet.hadoop.util.HadoopStreams
-
Wraps a
FSDataInputStream
in aSeekableInputStream
implementation for Parquet readers. - wrap(FSDataOutputStream) - Static method in class org.apache.parquet.hadoop.util.HadoopStreams
-
Wraps a
FSDataOutputStream
in aPositionOutputStream
implementation for Parquet writers. - wrapKey(byte[], String) - Method in interface org.apache.parquet.crypto.keytools.KmsClient
-
Wraps a key - encrypts it with the master key, encodes the result and potentially adds a KMS-specific metadata.
- wrapKey(byte[], String) - Method in class org.apache.parquet.crypto.keytools.LocalWrapKmsClient
- write(byte[]) - Method in class org.apache.parquet.hadoop.util.HadoopPositionOutputStream
- write(byte[], int, int) - Method in class org.apache.parquet.hadoop.codec.NonBlockedCompressorStream
- write(byte[], int, int) - Method in class org.apache.parquet.hadoop.codec.ZstdCompressorStream
- write(byte[], int, int) - Method in class org.apache.parquet.hadoop.util.HadoopPositionOutputStream
- write(int) - Method in class org.apache.parquet.hadoop.codec.ZstdCompressorStream
- write(int) - Method in class org.apache.parquet.hadoop.util.HadoopPositionOutputStream
- write(DataOutput) - Method in class org.apache.parquet.hadoop.ParquetInputSplit
-
Deprecated.
- write(Void, T) - Method in class org.apache.parquet.hadoop.ParquetRecordWriter
- write(Group) - Method in class org.apache.parquet.hadoop.example.GroupWriteSupport
- write(T) - Method in class org.apache.parquet.hadoop.api.DelegatingWriteSupport
- write(T) - Method in class org.apache.parquet.hadoop.api.WriteSupport
-
called once per record
- write(T) - Method in class org.apache.parquet.hadoop.ParquetWriter
- WRITE_SUPPORT_CLASS - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
- WriteContext(MessageType, Map<String, String>) - Constructor for class org.apache.parquet.hadoop.api.WriteSupport.WriteContext
- writeDataPage(int, int, BytesInput, Encoding, Encoding, Encoding) - Method in class org.apache.parquet.hadoop.ParquetFileWriter
-
Deprecated.
- writeDataPage(int, int, BytesInput, Statistics, long, Encoding, Encoding, Encoding) - Method in class org.apache.parquet.hadoop.ParquetFileWriter
-
Writes a single page
- writeDataPage(int, int, BytesInput, Statistics, Encoding, Encoding, Encoding) - Method in class org.apache.parquet.hadoop.ParquetFileWriter
-
Deprecated.this method does not support writing column indexes; Use
ParquetFileWriter.writeDataPage(int, int, BytesInput, Statistics, long, Encoding, Encoding, Encoding)
instead - writeDataPageHeader(int, int, int, Encoding, Encoding, Encoding, OutputStream) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
-
Deprecated.
- writeDataPageHeader(int, int, int, Statistics, Encoding, Encoding, Encoding, OutputStream) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
-
Deprecated.
- writeDataPageV1Header(int, int, int, Encoding, Encoding, Encoding, int, OutputStream) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
- writeDataPageV1Header(int, int, int, Encoding, Encoding, Encoding, int, OutputStream, BlockCipher.Encryptor, byte[]) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
- writeDataPageV1Header(int, int, int, Encoding, Encoding, Encoding, OutputStream) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
- writeDataPageV1Header(int, int, int, Encoding, Encoding, Encoding, OutputStream, BlockCipher.Encryptor, byte[]) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
- writeDataPageV2(int, int, int, BytesInput, BytesInput, Encoding, BytesInput, int, Statistics<?>) - Method in class org.apache.parquet.hadoop.ParquetFileWriter
-
Writes a single v2 data page
- writeDataPageV2Header(int, int, int, int, int, Encoding, int, int, OutputStream) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
- writeDataPageV2Header(int, int, int, int, int, Encoding, int, int, OutputStream, BlockCipher.Encryptor, byte[]) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
- writeDataPageV2Header(int, int, int, int, int, Statistics, Encoding, int, int, OutputStream) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
-
Deprecated.
- writeDictionaryPage(DictionaryPage) - Method in class org.apache.parquet.hadoop.ParquetFileWriter
-
writes a dictionary page page
- writeDictionaryPage(DictionaryPage, BlockCipher.Encryptor, byte[]) - Method in class org.apache.parquet.hadoop.ParquetFileWriter
- writeDictionaryPageHeader(int, int, int, Encoding, int, OutputStream) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
- writeDictionaryPageHeader(int, int, int, Encoding, int, OutputStream, BlockCipher.Encryptor, byte[]) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
- writeDictionaryPageHeader(int, int, int, Encoding, OutputStream) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
- writeDictionaryPageHeader(int, int, int, Encoding, OutputStream, BlockCipher.Encryptor, byte[]) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
- writeMergedMetadataFile(List<Path>, Path, Configuration) - Static method in class org.apache.parquet.hadoop.ParquetFileWriter
-
Deprecated.metadata files are not recommended and will be removed in 2.0.0
- writeMetadataFile(Configuration, Path, List<Footer>) - Static method in class org.apache.parquet.hadoop.ParquetFileWriter
-
Deprecated.metadata files are not recommended and will be removed in 2.0.0
- writeMetadataFile(Configuration, Path, List<Footer>, ParquetOutputFormat.JobSummaryLevel) - Static method in class org.apache.parquet.hadoop.ParquetFileWriter
-
Deprecated.metadata files are not recommended and will be removed in 2.0.0
- writeMetaDataFile(Configuration, Path) - Static method in class org.apache.parquet.hadoop.ParquetOutputCommitter
- writeObjectToConfAsBase64(String, Object, Configuration) - Static method in class org.apache.parquet.hadoop.util.SerializationUtil
-
Writes an object to a configuration.
- WRITER_VERSION - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
- WriteSupport<T> - Class in org.apache.parquet.hadoop.api
-
Abstraction to use with
ParquetOutputFormat
to convert incoming records - WriteSupport() - Constructor for class org.apache.parquet.hadoop.api.WriteSupport
- WriteSupport.FinalizedWriteContext - Class in org.apache.parquet.hadoop.api
-
Information to be added in the file once all the records have been written
- WriteSupport.WriteContext - Class in org.apache.parquet.hadoop.api
-
information to be persisted in the file
Z
- ZstandardCodec - Class in org.apache.parquet.hadoop.codec
-
ZSTD compression codec for Parquet.
- ZstandardCodec() - Constructor for class org.apache.parquet.hadoop.codec.ZstandardCodec
- ZstdCompressorStream - Class in org.apache.parquet.hadoop.codec
- ZstdCompressorStream(OutputStream, int, int) - Constructor for class org.apache.parquet.hadoop.codec.ZstdCompressorStream
- ZstdCompressorStream(OutputStream, BufferPool, int, int) - Constructor for class org.apache.parquet.hadoop.codec.ZstdCompressorStream
- ZstdDecompressorStream - Class in org.apache.parquet.hadoop.codec
- ZstdDecompressorStream(InputStream) - Constructor for class org.apache.parquet.hadoop.codec.ZstdDecompressorStream
- ZstdDecompressorStream(InputStream, BufferPool) - Constructor for class org.apache.parquet.hadoop.codec.ZstdDecompressorStream
All Classes All Packages