Package | Description |
---|---|
com.aliyun.odps |
提供操作ODPS基本资源的类
|
com.aliyun.odps.commons | |
com.aliyun.odps.ml |
提供机器学习相关操作类
|
com.aliyun.odps.sqa | |
com.aliyun.odps.sqa.commandapi | |
com.aliyun.odps.sqa.commandapi.utils | |
com.aliyun.odps.task |
提供ODPS支持的Task定义
|
com.aliyun.odps.tunnel |
ODPS Tunnel服务用于上传、下载数据到ODPS
|
com.aliyun.odps.tunnel.impl |
Modifier and Type | Method and Description |
---|---|
Odps |
Odps.clone() |
Odps |
Instance.getOdps()
获得Instance的 ODPS 对象
|
Modifier and Type | Method and Description |
---|---|
void |
OdpsHooks.after(Instance instance,
Odps odps)
调用 Hook 的 after
|
abstract void |
OdpsHook.after(Instance instance,
Odps odps)
instance 结束后,框架会将 Instance 和 odps 对象传入 hook
|
static Session |
Session.attach(Odps odps,
String sessionName)
attach 指定名字的 session
此调用会立即返回,不会等待 session 启动完成。 可以手动调用
Session.waitForStart(long) 来等待启动。 |
static Session |
Session.attach(Odps odps,
String sessionName,
Map<String,String> hints)
attach 指定名字的 session
此调用会立即返回,不会等待 session 启动完成。 可以手动调用
Session.waitForStart(long) 来等待启动。 |
static Session |
Session.attach(Odps odps,
String sessionName,
Map<String,String> hints,
Long timeout)
attach 指定名字的 session
|
static Session |
Session.attach(Odps odps,
String sessionName,
Map<String,String> hints,
Long timeout,
String taskName)
attach 指定名字的 session
|
static Session |
Session.attach(Odps odps,
String sessionName,
Map<String,String> hints,
Long timeout,
String runningCluster,
String taskName)
attach 指定名字的 session
|
void |
OdpsHooks.before(Job job,
Odps odps)
调用 Hook 的 before
|
abstract void |
OdpsHook.before(Job job,
Odps odps)
提交代码前,框架会将 Job 和 Odps 对象传入 Hook
|
static Session |
Session.create(Odps odps,
int workerCount,
int workerMemory)
创建 session
此调用会立即返回,不会等待 session 启动完成。 可以手动调用
Session.waitForStart(long) 来等待启动。 |
static Session |
Session.create(Odps odps,
int workerCount,
int workerMemory,
String sessionName)
创建 session
此调用会立即返回,不会等待 session 启动完成。 可以手动调用
Session.waitForStart(long) 来等待启动。 |
static Session |
Session.create(Odps odps,
int workerCount,
int workerMemory,
String sessionName,
String projectName,
String workerSpareSpan,
Map<String,String> hints,
Long timeout)
创建 session
|
static Session |
Session.create(Odps odps,
int workerCount,
int workerMemory,
String sessionName,
String projectName,
String workerSpareSpan,
Map<String,String> hints,
Long timeout,
Integer priority)
创建 session
|
static Session |
Session.create(Odps odps,
int workerCount,
int workerMemory,
String sessionName,
String projectName,
String workerSpareSpan,
Map<String,String> hints,
Long timeout,
Integer priority,
String runningCluster)
创建 session
|
static Session |
Session.create(Odps odps,
int workerCount,
int workerMemory,
String sessionName,
String projectName,
String workerSpareSpan,
Map<String,String> hints,
Long timeout,
Integer priority,
String runningCluster,
String taskName)
创建 session
|
static Session |
Session.create(Odps odps,
String sessionName,
String projectName,
Map<String,String> hints,
Long timeout)
创建 session
|
static Session |
Session.create(Odps odps,
String sessionName,
String projectName,
Map<String,String> hints,
Long timeout,
Integer priority)
创建 session
|
static Session |
Session.create(Odps odps,
String sessionName,
String projectName,
Map<String,String> hints,
Long timeout,
Integer priority,
String runningCluster)
创建 session
|
static VolumeFSFile |
VolumeFSFile.getRoot(String project,
Odps odps)
Get a mocked root path
|
String |
TunnelEndpointLocalCache.getTunnelEndpointFromLocalCache(Odps odps,
String tunnelQuotaName) |
void |
OdpsHooks.onInstanceCreated(Instance instance,
Odps odps)
调用 Hook 的 ready
|
void |
OdpsHook.onInstanceCreated(Instance instance,
Odps odps)
向远程提交 job 并产生 instance 时,将 Instance 和 Odps 对象传入 Hook
|
void |
TunnelEndpointLocalCache.putTunnelEndpointIntoLocalCache(Odps odps,
String tunnelEndpoint) |
Constructor and Description |
---|
LogView(Odps odps) |
Odps(Odps odps) |
Session(Odps odps,
Instance instance) |
Session(Odps odps,
Instance instance,
String sessionName,
String taskName) |
Sessions(Odps odps) |
Constructor and Description |
---|
GeneralConfiguration(Odps odps) |
Constructor and Description |
---|
OfflineModels(Odps odps) |
Modifier and Type | Method and Description |
---|---|
SQLExecutorPoolBuilder |
SQLExecutorPoolBuilder.odps(Odps odps) |
SQLExecutorBuilder |
SQLExecutorBuilder.odps(Odps odps) |
Modifier and Type | Method and Description |
---|---|
RecordIter |
Command.run(Odps odps,
CommandInfo commandInfo) |
Modifier and Type | Method and Description |
---|---|
static String |
CommandUtil.getRealProjectName(Odps odps,
String project,
String schema,
boolean useOdpsNamespaceSchema)
获取真正的project name
|
static String |
CommandUtil.getRealSchemaName(Odps odps,
String project,
String schema,
boolean useOdpsNamespaceSchema)
获取真正的schema name
|
static String |
CommandUtil.runJob(Task task,
Odps odps) |
Modifier and Type | Method and Description |
---|---|
static Instance |
SQLCostTask.run(Odps odps,
String sql)
通过匿名Instance运行SQLCostTask
|
static Instance |
SQLTask.run(Odps odps,
String sql)
运行 SQL.
特别注意,在执行数据读取操作时: 正常情况下的 task 执行后,task 的状态为 SUCCESS,并正常返回数据结果。 但是,当读取数据量超过 10MB,task 的状态将是 FAILED,返回的数据结果为 error message。 因此,大量数据的获取建议使用 TableTunnel 进行操作。示例代码: |
static Instance |
LOTTask.run(Odps odps,
String input,
boolean runSQL)
通过匿名Instance运行LOTTask
|
static Instance |
GraphTask.run(Odps odps,
String project,
GraphTask graphTask,
int priority,
String runningCluster) |
static Instance |
LOTTask.run(Odps odps,
String project,
String input,
boolean runSQL,
Map<String,String> hints,
Map<String,String> aliases)
通过匿名Instance运行LOTTask
|
static Instance |
LOTTask.run(Odps odps,
String project,
String input,
boolean runSQL,
String taskName,
Map<String,String> hints,
Map<String,String> aliases)
运行LOTTask
|
static Instance |
CupidTask.run(Odps odps,
String project,
String plan,
Map<String,String> hints) |
static Instance |
SQLCostTask.run(Odps odps,
String project,
String sql,
Map<String,String> hints)
通过匿名Instance运行SQLCostTask
|
static Instance |
MoyeTask.run(Odps odps,
String project,
String plan,
Map<String,String> hints) |
static Instance |
CupidTask.run(Odps odps,
String project,
String plan,
Map<String,String> hints,
int priority) |
static Instance |
MoyeTask.run(Odps odps,
String project,
String plan,
Map<String,String> hints,
int priority) |
static Instance |
CupidTask.run(Odps odps,
String project,
String plan,
Map<String,String> hints,
Integer priority,
String runningCluster,
String jobName) |
static Instance |
SQLTask.run(Odps odps,
String project,
String sql,
Map<String,String> hints,
Map<String,String> aliases)
运行SQL
|
static Instance |
KubeTask.run(Odps odps,
String project,
String taskName,
String yamlPath) |
static Instance |
KubeTask.run(Odps odps,
String project,
String taskName,
String yamlPath,
int priority) |
static Instance |
KubeTask.run(Odps odps,
String project,
String taskName,
String appId,
KubeTask.Command command) |
static Instance |
KubeTask.run(Odps odps,
String project,
String taskName,
String appId,
KubeTask.Command command,
int priority) |
static Instance |
SQLCostTask.run(Odps odps,
String project,
String sql,
String taskName,
Map<String,String> hints)
运行SQLCostTask
|
static Instance |
SQLTask.run(Odps odps,
String project,
String sql,
String taskName,
Map<String,String> hints,
Map<String,String> aliases) |
static Instance |
SQLTask.run(Odps odps,
String project,
String sql,
String taskName,
Map<String,String> hints,
Map<String,String> aliases,
int priority)
运行SQL
|
static Instance |
KubeTask.run(Odps odps,
String project,
String taskName,
String appId,
String resourceName,
String labels,
KubeTask.Command command,
KubeTask.Kind kind) |
static Instance |
KubeTask.run(Odps odps,
String project,
String taskName,
String appId,
String resourceName,
String labels,
KubeTask.Command command,
KubeTask.Kind kind,
int priority) |
Modifier and Type | Method and Description |
---|---|
Odps |
Configuration.getOdps() |
Constructor and Description |
---|
Configuration(Odps odps) |
InstanceTunnel(Odps odps)
构造此类对象
|
TableTunnel(Odps odps)
构造此类对象
|
VolumeFSTunnel(Odps odps) |
VolumeTunnel(Odps odps)
构造此类对象
|
Constructor and Description |
---|
ConfigurationImpl(Odps odps) |
Copyright © 2023 Alibaba Cloud Computing. All rights reserved.