org.apache.flink.python.api.streaming.data

类 PythonStreamer<S extends PythonSender,OUT>

java.lang.Object

org.apache.flink.python.api.streaming.data.PythonStreamer<S,OUT>

所有已实现的接口:

Serializable

直接已知子类:

PythonDualInputStreamer, PythonSingleInputStreamer

public class PythonStreamer<S extends PythonSender,OUT>
extends Object
implements Serializable

This streamer is used by functions to send/receive data to/from an external python process.

另请参阅:

序列化表格

字段概要

字段

限定符和类型	字段和说明
protected Thread	errorPrinter
protected org.apache.flink.api.common.functions.AbstractRichFunction	function
protected DataInputStream	in
protected static org.slf4j.Logger	LOG
protected AtomicReference<String>	msg
protected DataOutputStream	out
protected Thread	outPrinter
protected int	port
protected PythonReceiver<OUT>	receiver
protected S	sender
protected ServerSocket	server
protected static int	SIGNAL_BUFFER_REQUEST
protected static int	SIGNAL_BUFFER_REQUEST_G0
protected static int	SIGNAL_BUFFER_REQUEST_G1
protected static int	SIGNAL_ERROR
protected static int	SIGNAL_FINISHED
protected static byte	SIGNAL_LAST
protected Socket	socket

构造器概要

构造器

构造器和说明
PythonStreamer(org.apache.flink.api.common.functions.AbstractRichFunction function, org.apache.flink.configuration.Configuration config, int envID, int setID, boolean usesByteArray, S sender)

方法概要

限定符和类型	方法和说明
void	close() Closes this streamer.
static void	destroyProcess(Process process)
void	open() Starts the python script.
void	sendBroadCastVariables(org.apache.flink.configuration.Configuration config) Sends all broadcast-variables encoded in the configuration to the external process.
protected void	sendReadConfirmation()
protected void	sendWriteNotification(int size, boolean hasNext)

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

字段详细资料

LOG

protected static final org.slf4j.Logger LOG

SIGNAL_BUFFER_REQUEST

protected static final int SIGNAL_BUFFER_REQUEST

另请参阅:

常量字段值

SIGNAL_BUFFER_REQUEST_G0

protected static final int SIGNAL_BUFFER_REQUEST_G0

另请参阅:

常量字段值

SIGNAL_BUFFER_REQUEST_G1

protected static final int SIGNAL_BUFFER_REQUEST_G1

另请参阅:

常量字段值

SIGNAL_FINISHED

protected static final int SIGNAL_FINISHED

另请参阅:

常量字段值

SIGNAL_ERROR

protected static final int SIGNAL_ERROR

另请参阅:

常量字段值

SIGNAL_LAST

protected static final byte SIGNAL_LAST

另请参阅:

常量字段值

server

protected transient ServerSocket server

socket

protected transient Socket socket

in

protected transient DataInputStream in

out

protected transient DataOutputStream out

port

protected int port

sender

protected S extends PythonSender sender

receiver

protected PythonReceiver<OUT> receiver

msg

protected AtomicReference<String> msg

function

protected final org.apache.flink.api.common.functions.AbstractRichFunction function

outPrinter

protected transient Thread outPrinter

errorPrinter

protected transient Thread errorPrinter

构造器详细资料

PythonStreamer

public PythonStreamer(org.apache.flink.api.common.functions.AbstractRichFunction function,
                      org.apache.flink.configuration.Configuration config,
                      int envID,
                      int setID,
                      boolean usesByteArray,
                      S sender)

方法详细资料

open

public void open()
          throws IOException

Starts the python script.

抛出:

IOException

close

public void close()
           throws IOException

Closes this streamer.

抛出:

IOException

destroyProcess

public static void destroyProcess(Process process)
                           throws IOException

抛出:

IOException

sendWriteNotification

protected void sendWriteNotification(int size,
                                     boolean hasNext)
                              throws IOException

抛出:

IOException

sendReadConfirmation

protected void sendReadConfirmation()
                             throws IOException

抛出:

IOException

sendBroadCastVariables

public final void sendBroadCastVariables(org.apache.flink.configuration.Configuration config)
                                  throws IOException

Sends all broadcast-variables encoded in the configuration to the external process.

参数:

config - configuration object containing broadcast-variable count and names

抛出:

IOException