public class ArrowStreamReader extends ArrowReader
DictionaryProvider.MapDictionaryProvider
allocator, dictionaries
Constructor and Description |
---|
ArrowStreamReader(InputStream in,
BufferAllocator allocator)
Constructs a streaming reader from an InputStream.
|
ArrowStreamReader(InputStream in,
BufferAllocator allocator,
CompressionCodec.Factory compressionFactory)
Constructs a streaming reader from a ReadableByteChannel input.
|
ArrowStreamReader(MessageChannelReader messageReader,
BufferAllocator allocator)
Constructs a streaming reader using a MessageChannelReader.
|
ArrowStreamReader(MessageChannelReader messageReader,
BufferAllocator allocator,
CompressionCodec.Factory compressionFactory)
Constructs a streaming reader using a MessageChannelReader.
|
ArrowStreamReader(ReadableByteChannel in,
BufferAllocator allocator)
Constructs a streaming reader from a ReadableByteChannel input.
|
ArrowStreamReader(ReadableByteChannel in,
BufferAllocator allocator,
CompressionCodec.Factory compressionFactory)
Constructs a streaming reader from a ReadableByteChannel input.
|
Modifier and Type | Method and Description |
---|---|
long |
bytesRead()
Get the number of bytes read from the stream since constructing the reader.
|
protected void |
closeReadSource()
Closes the underlying read source.
|
boolean |
loadNextBatch()
Load the next ArrowRecordBatch to the vector schema root if available.
|
protected Schema |
readSchema()
Reads the schema message from the beginning of the stream.
|
close, close, ensureInitialized, getDictionaryIds, getDictionaryVectors, getVectorSchemaRoot, initialize, loadDictionary, loadRecordBatch, lookup, prepareLoadNextBatch
public ArrowStreamReader(MessageChannelReader messageReader, BufferAllocator allocator, CompressionCodec.Factory compressionFactory)
messageReader
- reader used to get messages from a ReadChannelallocator
- to allocate new bufferscompressionFactory
- the factory to create compression codec.public ArrowStreamReader(MessageChannelReader messageReader, BufferAllocator allocator)
messageReader
- reader used to get messages from a ReadChannelallocator
- to allocate new bufferspublic ArrowStreamReader(ReadableByteChannel in, BufferAllocator allocator, CompressionCodec.Factory compressionFactory)
in
- ReadableByteChannel to read messages fromallocator
- to allocate new bufferscompressionFactory
- the factory to create compression codec.public ArrowStreamReader(ReadableByteChannel in, BufferAllocator allocator)
in
- ReadableByteChannel to read messages fromallocator
- to allocate new bufferspublic ArrowStreamReader(InputStream in, BufferAllocator allocator, CompressionCodec.Factory compressionFactory)
in
- InputStream to read messages fromallocator
- to allocate new bufferscompressionFactory
- the factory to create compression codec.public ArrowStreamReader(InputStream in, BufferAllocator allocator)
in
- InputStream to read messages fromallocator
- to allocate new bufferspublic long bytesRead()
bytesRead
in class ArrowReader
protected void closeReadSource() throws IOException
closeReadSource
in class ArrowReader
IOException
- on errorpublic boolean loadNextBatch() throws IOException
loadNextBatch
in class ArrowReader
IOException
- on errorprotected Schema readSchema() throws IOException
readSchema
in class ArrowReader
IOException
- on errorCopyright © 2023 The Apache Software Foundation. All rights reserved.