org.apache.hadoop.hbase.io.encoding

接口 DataBlockEncoder

所有已知实现类:

AbstractDataBlockEncoder, CopyKeyDataBlockEncoder, DiffKeyDeltaEncoder, FastDiffDeltaEncoder, PrefixKeyDeltaEncoder, RowIndexCodecV1

@InterfaceAudience.Private
public interface DataBlockEncoder

Encoding of KeyValue. It aims to be fast and efficient using assumptions:

• the KeyValues are stored sorted by key
• we know the structure of KeyValue
• the values are always iterated forward from beginning of block
• knowledge of Key Value format

It is designed to work fast enough to be feasible as in memory compression.

嵌套类概要

嵌套类

限定符和类型	接口和说明
static interface	DataBlockEncoder.EncodedSeeker An interface which enable to seek while underlying data is encoded.

方法概要

方法

限定符和类型	方法和说明
DataBlockEncoder.EncodedSeeker	createSeeker(KeyValue.KVComparator comparator, HFileBlockDecodingContext decodingCtx) Create a HFileBlock seeker which find KeyValues within a block.
ByteBuffer	decodeKeyValues(DataInputStream source, HFileBlockDecodingContext decodingCtx) Decode.
int	encode(Cell cell, HFileBlockEncodingContext encodingCtx, DataOutputStream out) Encodes a KeyValue.
void	endBlockEncoding(HFileBlockEncodingContext encodingCtx, DataOutputStream out, byte[] uncompressedBytesWithHeader) Ends encoding for a block of KeyValues.
ByteBuffer	getFirstKeyInBlock(ByteBuffer block) Return first key in block.
HFileBlockDecodingContext	newDataBlockDecodingContext(HFileContext meta) Creates an encoder specific decoding context, which will prepare the data before actual decoding
HFileBlockEncodingContext	newDataBlockEncodingContext(DataBlockEncoding encoding, byte[] headerBytes, HFileContext meta) Creates a encoder specific encoding context
void	startBlockEncoding(HFileBlockEncodingContext encodingCtx, DataOutputStream out) Starts encoding for a block of KeyValues.

方法详细资料

startBlockEncoding

void startBlockEncoding(HFileBlockEncodingContext encodingCtx,
                      DataOutputStream out)
                        throws IOException

Starts encoding for a block of KeyValues. Call endBlockEncoding(HFileBlockEncodingContext, DataOutputStream, byte[]) to finish encoding of a block.

参数:

encodingCtx -

out -

抛出:

IOException

encode

int encode(Cell cell,
         HFileBlockEncodingContext encodingCtx,
         DataOutputStream out)
           throws IOException

Encodes a KeyValue.

参数:

cell -

encodingCtx -

out -

返回:

unencoded kv size written

抛出:

IOException

endBlockEncoding

void endBlockEncoding(HFileBlockEncodingContext encodingCtx,
                    DataOutputStream out,
                    byte[] uncompressedBytesWithHeader)
                      throws IOException

Ends encoding for a block of KeyValues. Gives a chance for the encoder to do the finishing stuff for the encoded block. It must be called at the end of block encoding.

参数:

encodingCtx -

out -

uncompressedBytesWithHeader -

抛出:

IOException

decodeKeyValues

ByteBuffer decodeKeyValues(DataInputStream source,
                         HFileBlockDecodingContext decodingCtx)
                           throws IOException

Decode.

参数:

source - Compressed stream of KeyValues.

decodingCtx -

返回:

Uncompressed block of KeyValues.

抛出:

IOException - If there is an error in source.

getFirstKeyInBlock

ByteBuffer getFirstKeyInBlock(ByteBuffer block)

Return first key in block. Useful for indexing. Typically does not make a deep copy but returns a buffer wrapping a segment of the actual block's byte array. This is because the first key in block is usually stored unencoded.

参数:

block - encoded block we want index, the position will not change

返回:

First key in block.

createSeeker

DataBlockEncoder.EncodedSeeker createSeeker(KeyValue.KVComparator comparator,
                                          HFileBlockDecodingContext decodingCtx)

Create a HFileBlock seeker which find KeyValues within a block.

参数:

comparator - what kind of comparison should be used

decodingCtx -

返回:

A newly created seeker.

newDataBlockEncodingContext

HFileBlockEncodingContext newDataBlockEncodingContext(DataBlockEncoding encoding,
                                                    byte[] headerBytes,
                                                    HFileContext meta)

Creates a encoder specific encoding context

参数:

encoding - encoding strategy used

headerBytes - header bytes to be written, put a dummy header here if the header is unknown

meta - HFile meta data

返回:

a newly created encoding context

newDataBlockDecodingContext

HFileBlockDecodingContext newDataBlockDecodingContext(HFileContext meta)

Creates an encoder specific decoding context, which will prepare the data before actual decoding

参数:

meta - HFile meta data

返回:

a newly created decoding context