Index

A B C D E F G H I K L M N O P R S T U V
All Classes and Interfaces|All Packages|Constant Field Values

A

ABSOLUTE_HDFS_PATH_ATTRIBUTE - Static variable in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

AbstractHadoopProcessor - Class in org.apache.nifi.processors.hadoop

This is a base class that is helpful when building processors interacting with HDFS.

AbstractHadoopProcessor() - Constructor for class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

AbstractHadoopProcessor.ValidationResources - Class in org.apache.nifi.processors.hadoop

abstractOnScheduled(ProcessContext) - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

If your subclass also has an @OnScheduled annotated method and you need hdfsResources in that method, then be sure to call super.abstractOnScheduled(context)

abstractOnStopped() - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

ADDITIONAL_CLASSPATH_RESOURCES - Static variable in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

allowableValues() - Static method in enum class org.apache.nifi.processors.hadoop.CompressionType

AUTOMATIC - Enum constant in enum class org.apache.nifi.processors.hadoop.CompressionType

B

BZIP - Enum constant in enum class org.apache.nifi.processors.hadoop.CompressionType

C

CACHE_CLASSES - Variable in class org.apache.nifi.processors.hadoop.ExtendedConfiguration

callWithUgi(UserGroupInformation, PrivilegedExceptionAction<T>) - Static method in class org.apache.nifi.hadoop.SecurityUtil

Helper method to execute the given action as the given user.

checkHdfsUriForTimeout(Configuration) - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

checkTGTAndRelogin(ComponentLog, KerberosUser) - Static method in class org.apache.nifi.hadoop.SecurityUtil

Helper method to call checkTGTAndRelogin on a given KerberosUser that may be null.

closeFileSystem(FileSystem) - Static method in class org.apache.nifi.processors.hadoop.HDFSResourceHelper

COMPRESSION_CODEC - Static variable in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

CompressionType - Enum Class in org.apache.nifi.processors.hadoop

Compression Type Enum for Hadoop related processors.

CompressionType(String) - Constructor for enum class org.apache.nifi.processors.hadoop.CompressionType

configLocations - Variable in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor.ValidationResources

configuration - Variable in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor.ValidationResources

configuration - Variable in class org.apache.nifi.processors.hadoop.HdfsResources

customValidate(ValidationContext) - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

D

DEFAULT - Enum constant in enum class org.apache.nifi.processors.hadoop.CompressionType

DENY_LFS_ACCESS - Static variable in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

DENY_LFS_EXPLANATION - Static variable in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

description - Variable in enum class org.apache.nifi.processors.hadoop.CompressionType

DIRECTORY - Static variable in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

E

EMPTY_HDFS_RESOURCES - Static variable in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

ExtendedConfiguration - Class in org.apache.nifi.processors.hadoop

Extending Hadoop Configuration to prevent it from caching classes that can't be found.

ExtendedConfiguration(ComponentLog) - Constructor for class org.apache.nifi.processors.hadoop.ExtendedConfiguration

ExtendedConfiguration(Logger) - Constructor for class org.apache.nifi.processors.hadoop.ExtendedConfiguration

F

fileSystem - Variable in class org.apache.nifi.processors.hadoop.HdfsResources

findCause(Throwable, Class<T>, Predicate<T>) - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

Returns an optional with the first throwable in the causal chain that is assignable to the provided cause type, and satisfies the provided cause predicate, Optional.empty() otherwise.

G

getClassByNameOrNull(String) - Method in class org.apache.nifi.processors.hadoop.ExtendedConfiguration

getClassloaderIsolationKey(PropertyContext) - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

getCommonPropertyDescriptors() - Static method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

getCompressionCodec(ProcessContext, Configuration) - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

Returns the configured CompressionCodec, or null if none is configured.

getConfigLocations() - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor.ValidationResources

getConfigLocations(PropertyContext) - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

getConfiguration() - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

getConfiguration() - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor.ValidationResources

getConfiguration() - Method in class org.apache.nifi.processors.hadoop.HdfsResources

getConfigurationFromResources(Configuration, List<String>) - Static method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

getDescription() - Method in enum class org.apache.nifi.processors.hadoop.CompressionType

getFileSystem() - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

getFileSystem() - Method in class org.apache.nifi.processors.hadoop.HdfsResources

getFileSystem(Configuration) - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

This exists in order to allow unit tests to override it so that they don't take several minutes waiting for UDP packets to be received

getFileSystemAsUser(Configuration, UserGroupInformation) - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

getHadoopConfigurationForValidation(List<String>) - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

getKerberosUser() - Method in class org.apache.nifi.processors.hadoop.HdfsResources

getKerberosUser(ProcessContext) - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

getNormalizedPath(String) - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

getNormalizedPath(String, Optional<String>) - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

getNormalizedPath(ProcessContext, PropertyDescriptor) - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

getNormalizedPath(ProcessContext, PropertyDescriptor, FlowFile) - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

getPathDifference(Path, Path) - Static method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

Returns the relative path of the child that does not include the filename or the root path.

getSupportedPropertyDescriptors() - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

getUgiForKerberosUser(Configuration, KerberosUser) - Static method in class org.apache.nifi.hadoop.SecurityUtil

Authenticates a KerberosUser and acquires a UserGroupInformation instance using UserGroupInformation.getUGIFromSubject(Subject).

getUserGroupInformation() - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

getUserGroupInformation() - Method in class org.apache.nifi.processors.hadoop.HdfsResources

GZIP - Enum constant in enum class org.apache.nifi.processors.hadoop.CompressionType

H

HADOOP_CONFIGURATION_RESOURCES - Static variable in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

HADOOP_FILE_URL_ATTRIBUTE - Static variable in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

HADOOP_SECURITY_AUTHENTICATION - Static variable in class org.apache.nifi.hadoop.SecurityUtil

HadoopValidators - Interface in org.apache.nifi.processors.hadoop

Validators for Hadoop related processors.

handleAuthErrors(Throwable, ProcessSession, ProcessContext, BiConsumer<ProcessSession, ProcessContext>) - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

HDFSResourceHelper - Class in org.apache.nifi.processors.hadoop

HDFSResourceHelper() - Constructor for class org.apache.nifi.processors.hadoop.HDFSResourceHelper

hdfsResources - Variable in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

HdfsResources - Class in org.apache.nifi.processors.hadoop

HdfsResources(Configuration, FileSystem, UserGroupInformation, KerberosUser) - Constructor for class org.apache.nifi.processors.hadoop.HdfsResources

I

init(ProcessorInitializationContext) - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

interruptStatisticsThread(FileSystem) - Static method in class org.apache.nifi.processors.hadoop.HDFSResourceHelper

isFileSystemAccessDenied(URI) - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

isLocalFileSystemAccessDenied() - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

isSecurityEnabled(Configuration) - Static method in class org.apache.nifi.hadoop.SecurityUtil

Initializes UserGroupInformation with the given Configuration and returns UserGroupInformation.isSecurityEnabled().

K

KERBEROS - Static variable in class org.apache.nifi.hadoop.SecurityUtil

KERBEROS_USER_SERVICE - Static variable in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

kerberosUser - Variable in class org.apache.nifi.processors.hadoop.HdfsResources

L

LOCAL_FILE_SYSTEM_URI - Static variable in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

LOGGER - Static variable in class org.apache.nifi.processors.hadoop.HDFSResourceHelper

loggerMethod - Variable in class org.apache.nifi.processors.hadoop.ExtendedConfiguration

loginKerberos(Configuration, String, String) - Static method in class org.apache.nifi.hadoop.SecurityUtil

Initializes UserGroupInformation with the given Configuration and performs the login for the given principal and keytab.

loginSimple(Configuration) - Static method in class org.apache.nifi.hadoop.SecurityUtil

Initializes UserGroupInformation with the given Configuration and returns UserGroupInformation.getLoginUser().

LZ4 - Enum constant in enum class org.apache.nifi.processors.hadoop.CompressionType

LZO - Enum constant in enum class org.apache.nifi.processors.hadoop.CompressionType

M

migrateProperties(PropertyConfiguration) - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

N

NONE - Enum constant in enum class org.apache.nifi.processors.hadoop.CompressionType

NORMALIZE_ERROR_WITH_PROPERTY - Static variable in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

NORMALIZE_ERROR_WITHOUT_PROPERTY - Static variable in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

O

org.apache.nifi.hadoop - package org.apache.nifi.hadoop

org.apache.nifi.processors.hadoop - package org.apache.nifi.processors.hadoop

P

POSITIVE_SHORT_VALIDATOR - Static variable in interface org.apache.nifi.processors.hadoop.HadoopValidators

preProcessConfiguration(Configuration, ProcessContext) - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

This method will be called after the Configuration has been created, but before the FileSystem is created, allowing sub-classes to take further action on the Configuration before creating the FileSystem.

PROPERTY_DESCRIPTORS - Static variable in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

R

resetHDFSResources(List<String>, ProcessContext) - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

RESOURCES_LOCK - Static variable in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

S

SecurityUtil - Class in org.apache.nifi.hadoop

Provides synchronized access to UserGroupInformation to avoid multiple processors/services from interfering with each other.

SecurityUtil() - Constructor for class org.apache.nifi.hadoop.SecurityUtil

SNAPPY - Enum constant in enum class org.apache.nifi.processors.hadoop.CompressionType

T

TARGET_HDFS_DIR_CREATED_ATTRIBUTE - Static variable in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

toString() - Method in enum class org.apache.nifi.processors.hadoop.CompressionType

U

UMASK_VALIDATOR - Static variable in interface org.apache.nifi.processors.hadoop.HadoopValidators

userGroupInformation - Variable in class org.apache.nifi.processors.hadoop.HdfsResources

V

validateFileSystem(Configuration) - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

validationResourceHolder - Variable in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

ValidationResources(List<String>, Configuration) - Constructor for class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor.ValidationResources

valueOf(String) - Static method in enum class org.apache.nifi.processors.hadoop.CompressionType

Returns the enum constant of this class with the specified name.

values() - Static method in enum class org.apache.nifi.processors.hadoop.CompressionType

Returns an array containing the constants of this enum class, in the order they are declared.

A B C D E F G H I K L M N O P R S T U V
All Classes and Interfaces|All Packages|Constant Field Values