com.aliyun.odps.tunnel.io

Class TunnelRecordReader

java.lang.Object

com.aliyun.odps.commons.proto.ProtobufRecordStreamReader

com.aliyun.odps.tunnel.io.TunnelRecordReader

All Implemented Interfaces:

RecordReader, Closeable, AutoCloseable

public class TunnelRecordReader
extends com.aliyun.odps.commons.proto.ProtobufRecordStreamReader

TunnelReaderReader支持通过Tunnel服务读取ODPS表中的数据

Field Summary

Fields

Modifier and Type	Field and Description
static int	DEFAULT_CONNECT_RETRYTIMES 底层网络重试次数, 4
static int	DEFAULT_CONNECT_TIMEOUT 底层网络建立超时时间,30秒

Constructor Summary

Constructors

Constructor and Description
TunnelRecordReader(long start, long count, List<Column> columns, CompressOption option, com.aliyun.odps.rest.RestClient tunnelRestClient, InstanceTunnel.DownloadSession session) 构造此类对象
TunnelRecordReader(long start, long count, List<Column> columns, CompressOption option, com.aliyun.odps.rest.RestClient tunnelRestClient, TableTunnel.DownloadSession session) 构造此类对象
TunnelRecordReader(TableSchema schema, com.aliyun.odps.commons.transport.Connection conn, CompressOption option) Deprecated.
TunnelRecordReader(TableSchema schema, List<Column> columns, com.aliyun.odps.commons.transport.Connection conn, CompressOption option) Deprecated.

Method Summary

Modifier and Type	Method and Description
void	close()
long	getTotalBytes()
Record	read() 读取一条记录
Record	read(Record reusedRecord) 使用 reuse 的Record 读取数据 当 reuseRecord 为 null 时，返回一个新的 Record 对象 当 reuseRecord 非 null 时， 返回 reuseRecord 本身 当数据读取完成， 返回 null
void	setTransform(boolean shouldTransform)

Methods inherited from class com.aliyun.odps.commons.proto.ProtobufRecordStreamReader

createEmptyRecord, readArray, readArray, readMap, readMap, readStruct

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

DEFAULT_CONNECT_TIMEOUT

public static final int DEFAULT_CONNECT_TIMEOUT

底层网络建立超时时间,30秒

See Also:

Constant Field Values

DEFAULT_CONNECT_RETRYTIMES

public static final int DEFAULT_CONNECT_RETRYTIMES

底层网络重试次数, 4

See Also:

Constant Field Values

Constructor Detail

TunnelRecordReader

@Deprecated
public TunnelRecordReader(TableSchema schema,
                                      com.aliyun.odps.commons.transport.Connection conn,
                                      CompressOption option)
                               throws IOException

Deprecated.

构造此类对象

Parameters:

schema - ODPS表的Schema TableSchema

conn - Connection

option - CompressOption

Throws:

IOException

TunnelRecordReader

@Deprecated
public TunnelRecordReader(TableSchema schema,
                                      List<Column> columns,
                                      com.aliyun.odps.commons.transport.Connection conn,
                                      CompressOption option)
                               throws IOException

Deprecated.

构造此类对象

Parameters:

schema - ODPS表的Schema TableSchema

columns - 需要读取的列 Column

conn - Connection

option - CompressOption

Throws:

IOException

TunnelRecordReader

public TunnelRecordReader(long start,
                          long count,
                          List<Column> columns,
                          CompressOption option,
                          com.aliyun.odps.rest.RestClient tunnelRestClient,
                          TableTunnel.DownloadSession session)
                   throws TunnelException,
                          IOException

构造此类对象

Parameters:

columns - 需要读取的列 Column

option - CompressOption

start - 本次要读取记录的起始位置

count - 本次要读取记录的数量

session - 本次读取所在 session

Throws:

IOException

TunnelException

TunnelRecordReader

public TunnelRecordReader(long start,
                          long count,
                          List<Column> columns,
                          CompressOption option,
                          com.aliyun.odps.rest.RestClient tunnelRestClient,
                          InstanceTunnel.DownloadSession session)
                   throws TunnelException,
                          IOException

构造此类对象

Parameters:

columns - 需要读取的列 Column

option - CompressOption

start - 本次要读取记录的起始位置

count - 本次要读取记录的数量

session - 本次读取所在 session

Throws:

IOException

TunnelException

Method Detail

setTransform

public void setTransform(boolean shouldTransform)

Overrides:

setTransform in class com.aliyun.odps.commons.proto.ProtobufRecordStreamReader

close

public void close()
           throws IOException

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Overrides:

close in class com.aliyun.odps.commons.proto.ProtobufRecordStreamReader

Throws:

IOException

read

public Record read()
            throws IOException

Description copied from interface: RecordReader

读取一条记录

Specified by:

read in interface RecordReader

Overrides:

read in class com.aliyun.odps.commons.proto.ProtobufRecordStreamReader

Returns:

成功读到记录返回Record对象, 读取完成返回null

Throws:

IOException - 读取过程发生异常, 发生异常后不可重试

read

public Record read(Record reusedRecord)
            throws IOException

Description copied from class: com.aliyun.odps.commons.proto.ProtobufRecordStreamReader

使用 reuse 的Record 读取数据 当 reuseRecord 为 null 时，返回一个新的 Record 对象 当 reuseRecord 非 null 时， 返回 reuseRecord 本身 当数据读取完成， 返回 null

Overrides:

read in class com.aliyun.odps.commons.proto.ProtobufRecordStreamReader

Returns:

Throws:

IOException

getTotalBytes

public long getTotalBytes()

Overrides:

getTotalBytes in class com.aliyun.odps.commons.proto.ProtobufRecordStreamReader