org.apache.hadoop.hbase.io.encoding

Interface DataBlockEncoder

All Known Implementing Classes:

CopyKeyDataBlockEncoder, DiffKeyDeltaEncoder, FastDiffDeltaEncoder, PrefixKeyDeltaEncoder

@InterfaceAudience.Private
public interface DataBlockEncoder

Encoding of KeyValue. It aims to be fast and efficient using assumptions:

• the KeyValues are stored sorted by key
• we know the structure of KeyValue
• the values are always iterated forward from beginning of block
• knowledge of Key Value format

It is designed to work fast enough to be feasible as in memory compression. After encoding, it also optionally compresses the encoded data if a compression algorithm is specified in HFileBlockEncodingContext argument of encodeKeyValues(ByteBuffer, HFileBlockEncodingContext).

Nested Class Summary

Nested Classes

Modifier and Type	Interface and Description
static interface	DataBlockEncoder.EncodedSeeker An interface which enable to seek while underlying data is encoded.

Method Summary

Methods

Modifier and Type	Method and Description
DataBlockEncoder.EncodedSeeker	createSeeker(KeyValue.KVComparator comparator, HFileBlockDecodingContext decodingCtx) Create a HFileBlock seeker which find KeyValues within a block.
ByteBuffer	decodeKeyValues(DataInputStream source, HFileBlockDecodingContext decodingCtx) Decode.
void	encodeKeyValues(ByteBuffer in, HFileBlockEncodingContext encodingCtx) Encodes KeyValues.
ByteBuffer	getFirstKeyInBlock(ByteBuffer block) Return first key in block.
HFileBlockDecodingContext	newDataBlockDecodingContext(HFileContext meta) Creates an encoder specific decoding context, which will prepare the data before actual decoding
HFileBlockEncodingContext	newDataBlockEncodingContext(DataBlockEncoding encoding, byte[] headerBytes, HFileContext meta) Creates a encoder specific encoding context

Method Detail

encodeKeyValues

void encodeKeyValues(ByteBuffer in,
                   HFileBlockEncodingContext encodingCtx)
                     throws IOException

Encodes KeyValues. It will first encode key value pairs, and then optionally do the compression for the encoded data.

Parameters:

in - Source of KeyValue for compression.

encodingCtx - the encoding context which will contain encoded uncompressed bytes as well as compressed encoded bytes if compression is enabled, and also it will reuse resources across multiple calls.

Throws:

IOException - If there is an error writing to output stream.

decodeKeyValues

ByteBuffer decodeKeyValues(DataInputStream source,
                         HFileBlockDecodingContext decodingCtx)
                           throws IOException

Decode.

Parameters:

source - Compressed stream of KeyValues.

decodingCtx -

Returns:

Uncompressed block of KeyValues.

Throws:

IOException - If there is an error in source.

getFirstKeyInBlock

ByteBuffer getFirstKeyInBlock(ByteBuffer block)

Return first key in block. Useful for indexing. Typically does not make a deep copy but returns a buffer wrapping a segment of the actual block's byte array. This is because the first key in block is usually stored unencoded.

Parameters:

block - encoded block we want index, the position will not change

Returns:

First key in block.

createSeeker

DataBlockEncoder.EncodedSeeker createSeeker(KeyValue.KVComparator comparator,
                                          HFileBlockDecodingContext decodingCtx)

Create a HFileBlock seeker which find KeyValues within a block.

Parameters:

comparator - what kind of comparison should be used

decodingCtx -

Returns:

A newly created seeker.

newDataBlockEncodingContext

HFileBlockEncodingContext newDataBlockEncodingContext(DataBlockEncoding encoding,
                                                    byte[] headerBytes,
                                                    HFileContext meta)

Creates a encoder specific encoding context

Parameters:

encoding - encoding strategy used

headerBytes - header bytes to be written, put a dummy header here if the header is unknown

meta - HFile meta data

Returns:

a newly created encoding context

newDataBlockDecodingContext

HFileBlockDecodingContext newDataBlockDecodingContext(HFileContext meta)

Creates an encoder specific decoding context, which will prepare the data before actual decoding

Parameters:

meta - HFile meta data

Returns:

a newly created decoding context