public interface FileSet extends Dataset, InputFormatProvider, OutputFormatProvider
Modifier and Type | Method and Description |
---|---|
org.apache.twill.filesystem.Location |
getBaseLocation()
Allows to interact directly with the location of this dataset in the underlying file system.
|
Map<String,String> |
getInputFormatConfiguration(Iterable<? extends org.apache.twill.filesystem.Location> inputLocs)
A variant of
InputFormatProvider.getInputFormatConfiguration()
that allows passing in the input locations (rather than using the input locations that were
determined from runtime arguments). |
List<org.apache.twill.filesystem.Location> |
getInputLocations()
Allows direct access to files of this dataset in the underlying file system.
|
org.apache.twill.filesystem.Location |
getLocation(String relativePath)
Allows direct access to files in this dataset, in the underlying file system.
|
org.apache.twill.filesystem.Location |
getOutputLocation()
Allows direct access to files in the output location, in the underlying file system.
|
Map<String,String> |
getRuntimeArguments()
Allow direct access to the runtime arguments of this file set.
|
getInputFormatClassName, getInputFormatConfiguration
getOutputFormatClassName, getOutputFormatConfiguration
static final String TYPE
org.apache.twill.filesystem.Location getBaseLocation()
List<org.apache.twill.filesystem.Location> getInputLocations()
org.apache.twill.filesystem.Location getOutputLocation()
org.apache.twill.filesystem.Location getLocation(String relativePath)
Map<String,String> getRuntimeArguments()
Map<String,String> getInputFormatConfiguration(Iterable<? extends org.apache.twill.filesystem.Location> inputLocs)
InputFormatProvider.getInputFormatConfiguration()
that allows passing in the input locations (rather than using the input locations that were
determined from runtime arguments).inputLocs
- the input locations to be usedCopyright © 2024 Cask Data, Inc. Licensed under the Apache License, Version 2.0.