Package org.apache.parquet.hadoop
Class ParquetInputSplit
- java.lang.Object
-
- org.apache.hadoop.mapreduce.InputSplit
-
- org.apache.hadoop.mapreduce.lib.input.FileSplit
-
- org.apache.parquet.hadoop.ParquetInputSplit
-
- All Implemented Interfaces:
org.apache.hadoop.io.Writable
@Private @Deprecated public class ParquetInputSplit extends org.apache.hadoop.mapreduce.lib.input.FileSplit implements org.apache.hadoop.io.Writable
Deprecated.will be removed in 2.0.0. use org.apache.hadoop.mapred.FileSplit instead.An input split for the Parquet format It contains the information to read one block of the file. This class is private to the ParquetInputFormat. Backward compatibility is not maintained.
-
-
Constructor Summary
Constructors Constructor Description ParquetInputSplit()
Deprecated.Writables must have a parameterless constructorParquetInputSplit(org.apache.hadoop.fs.Path file, long start, long end, long length, String[] hosts, long[] rowGroupOffsets)
Deprecated.ParquetInputSplit(org.apache.hadoop.fs.Path path, long start, long length, String[] hosts, List<BlockMetaData> blocks, String requestedSchema, String fileSchema, Map<String,String> extraMetadata, Map<String,String> readSupportMetadata)
Deprecated.
-
Method Summary
All Methods Instance Methods Concrete Methods Deprecated Methods Modifier and Type Method Description List<BlockMetaData>
getBlocks()
Deprecated.the file footer is no longer read before creating input splitslong
getEnd()
Deprecated.Map<String,String>
getExtraMetadata()
Deprecated.will be removed in 2.0.0.String
getFileSchema()
Deprecated.the file footer is no longer read before creating input splitslong[]
getRowGroupOffsets()
Deprecated.will be removed in 2.0.0.void
readFields(DataInput hin)
Deprecated.String
toString()
Deprecated.void
write(DataOutput hout)
Deprecated.
-
-
-
Constructor Detail
-
ParquetInputSplit
public ParquetInputSplit()
Deprecated.Writables must have a parameterless constructor
-
ParquetInputSplit
@Deprecated public ParquetInputSplit(org.apache.hadoop.fs.Path path, long start, long length, String[] hosts, List<BlockMetaData> blocks, String requestedSchema, String fileSchema, Map<String,String> extraMetadata, Map<String,String> readSupportMetadata)
Deprecated.For compatibility only useParquetInputSplit(Path, long, long, long, String[], long[])
- Parameters:
path
- a Pathstart
- split start locationlength
- split lengthhosts
- locality information for this splitblocks
- Parquet blocks in this splitrequestedSchema
- the requested schemafileSchema
- the file schemaextraMetadata
- string map of file metadatareadSupportMetadata
- string map of metadata from read support
-
ParquetInputSplit
public ParquetInputSplit(org.apache.hadoop.fs.Path file, long start, long end, long length, String[] hosts, long[] rowGroupOffsets)
Deprecated.- Parameters:
file
- the path of the file for that splitstart
- the start offset in the fileend
- the end offset in the filelength
- the actual size in bytes that we expect to readhosts
- the hosts with the replicas of this datarowGroupOffsets
- the offsets of the rowgroups selected if loaded on the client
-
-
Method Detail
-
getBlocks
@Deprecated public List<BlockMetaData> getBlocks()
Deprecated.the file footer is no longer read before creating input splits- Returns:
- the block meta data
-
getFileSchema
@Deprecated public String getFileSchema()
Deprecated.the file footer is no longer read before creating input splits- Returns:
- the file schema
-
getEnd
public long getEnd()
Deprecated.- Returns:
- the end offset of that split
-
getExtraMetadata
@Deprecated public Map<String,String> getExtraMetadata()
Deprecated.will be removed in 2.0.0. the file footer is no longer read before creating input splits- Returns:
- app specific metadata from the file
-
getRowGroupOffsets
public long[] getRowGroupOffsets()
Deprecated.will be removed in 2.0.0.- Returns:
- the offsets of the row group selected if this has been determined on the client side
-
toString
public String toString()
Deprecated.- Overrides:
toString
in classorg.apache.hadoop.mapreduce.lib.input.FileSplit
-
readFields
public void readFields(DataInput hin) throws IOException
Deprecated.- Specified by:
readFields
in interfaceorg.apache.hadoop.io.Writable
- Overrides:
readFields
in classorg.apache.hadoop.mapreduce.lib.input.FileSplit
- Throws:
IOException
-
write
public void write(DataOutput hout) throws IOException
Deprecated.- Specified by:
write
in interfaceorg.apache.hadoop.io.Writable
- Overrides:
write
in classorg.apache.hadoop.mapreduce.lib.input.FileSplit
- Throws:
IOException
-
-