Index

A B C D E F G H I K L N O P R S T U V
All Classes and Interfaces|All Packages|Constant Field Values

A

ABSOLUTE_HDFS_PATH_ATTRIBUTE - Static variable in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

AbstractHadoopProcessor - Class in org.apache.nifi.processors.hadoop

This is a base class that is helpful when building processors interacting with HDFS.

AbstractHadoopProcessor() - Constructor for class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

AbstractHadoopProcessor.ValidationResources - Class in org.apache.nifi.processors.hadoop

abstractOnScheduled(ProcessContext) - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

If your subclass also has an @OnScheduled annotated method and you need hdfsResources in that method, then be sure to call super.abstractOnScheduled(context)

abstractOnStopped() - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

ADDITIONAL_CLASSPATH_RESOURCES - Static variable in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

ALLOW_EXPLICIT_KEYTAB - Static variable in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

allowableValues() - Static method in enum class org.apache.nifi.processors.hadoop.CompressionType

AUTOMATIC - Enum constant in enum class org.apache.nifi.processors.hadoop.CompressionType

B

BZIP - Enum constant in enum class org.apache.nifi.processors.hadoop.CompressionType

C

CACHE_CLASSES - Variable in class org.apache.nifi.processors.hadoop.ExtendedConfiguration

callWithUgi(UserGroupInformation, PrivilegedExceptionAction<T>) - Static method in class org.apache.nifi.hadoop.SecurityUtil

Helper method to execute the given action as the given user.

checkHdfsUriForTimeout(Configuration) - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

checkTGTAndRelogin(ComponentLog, KerberosUser) - Static method in class org.apache.nifi.hadoop.SecurityUtil

Helper method to call checkTGTAndRelogin on a given KerberosUser that may be null.

closeFileSystem(FileSystem) - Static method in class org.apache.nifi.processors.hadoop.HDFSResourceHelper

COMPRESSION_CODEC - Static variable in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

CompressionType - Enum Class in org.apache.nifi.processors.hadoop

Compression Type Enum for Hadoop related processors.

CompressionType(String) - Constructor for enum class org.apache.nifi.processors.hadoop.CompressionType

configLocations - Variable in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor.ValidationResources

configuration - Variable in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor.ValidationResources

configuration - Variable in class org.apache.nifi.processors.hadoop.HdfsResources

create(HttpContext) - Method in class org.apache.nifi.hadoop.KerberosKeytabSPNegoAuthSchemeProvider

customValidate(ValidationContext) - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

D

DEFAULT - Enum constant in enum class org.apache.nifi.processors.hadoop.CompressionType

DENY_LFS_ACCESS - Static variable in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

DENY_LFS_EXPLANATION - Static variable in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

description - Variable in enum class org.apache.nifi.processors.hadoop.CompressionType

DIRECTORY - Static variable in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

E

EMPTY_HDFS_RESOURCES - Static variable in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

ExtendedConfiguration - Class in org.apache.nifi.processors.hadoop

Extending Hadoop Configuration to prevent it from caching classes that can't be found.

ExtendedConfiguration(ComponentLog) - Constructor for class org.apache.nifi.processors.hadoop.ExtendedConfiguration

ExtendedConfiguration(Logger) - Constructor for class org.apache.nifi.processors.hadoop.ExtendedConfiguration

F

fileSystem - Variable in class org.apache.nifi.processors.hadoop.HdfsResources

G

generateToken(byte[], String, Credentials) - Method in class org.apache.nifi.hadoop.KerberosKeytabSPNegoScheme

getAppConfigurationEntry(String) - Method in class org.apache.nifi.hadoop.KerberosConfiguration

getClassByNameOrNull(String) - Method in class org.apache.nifi.processors.hadoop.ExtendedConfiguration

getClassloaderIsolationKey(PropertyContext) - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

getCompressionCodec(ProcessContext, Configuration) - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

Returns the configured CompressionCodec, or null if none is configured.

getConfigLocations() - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor.ValidationResources

getConfigLocations(PropertyContext) - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

getConfiguration() - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

getConfiguration() - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor.ValidationResources

getConfiguration() - Method in class org.apache.nifi.processors.hadoop.HdfsResources

getConfigurationFromResources(Configuration, List<String>) - Static method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

getDescription() - Method in enum class org.apache.nifi.processors.hadoop.CompressionType

getFileSystem() - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

getFileSystem() - Method in class org.apache.nifi.processors.hadoop.HdfsResources

getFileSystem(Configuration) - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

This exists in order to allow unit tests to override it so that they don't take several minutes waiting for UDP packets to be received

getFileSystemAsUser(Configuration, UserGroupInformation) - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

getHadoopConfigurationForValidation(List<String>) - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

getKerberosConfigFile() - Method in class org.apache.nifi.hadoop.KerberosProperties

getKerberosConfigValidator() - Method in class org.apache.nifi.hadoop.KerberosProperties

getKerberosKeytab() - Method in class org.apache.nifi.hadoop.KerberosProperties

getKerberosPassword() - Method in class org.apache.nifi.hadoop.KerberosProperties

getKerberosPrincipal() - Method in class org.apache.nifi.hadoop.KerberosProperties

getKerberosProperties(File) - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

getKerberosUser() - Method in class org.apache.nifi.processors.hadoop.HdfsResources

getKerberosUser(ProcessContext) - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

getKeytab() - Method in class org.apache.nifi.hadoop.KerberosKeytabCredentials

getNormalizedPath(String) - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

getNormalizedPath(String, Optional<String>) - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

getNormalizedPath(ProcessContext, PropertyDescriptor) - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

getNormalizedPath(ProcessContext, PropertyDescriptor, FlowFile) - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

getPassword() - Method in class org.apache.nifi.hadoop.KerberosKeytabCredentials

getPathDifference(Path, Path) - Static method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

Returns the relative path of the child that does not include the filename or the root path.

getSupportedPropertyDescriptors() - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

getUgiForKerberosUser(Configuration, KerberosUser) - Static method in class org.apache.nifi.hadoop.SecurityUtil

Authenticates a KerberosUser and acquires a UserGroupInformation instance using UserGroupInformation.getUGIFromSubject(Subject).

getUserGroupInformation() - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

getUserGroupInformation() - Method in class org.apache.nifi.processors.hadoop.HdfsResources

getUserPrincipal() - Method in class org.apache.nifi.hadoop.KerberosKeytabCredentials

GZIP - Enum constant in enum class org.apache.nifi.processors.hadoop.CompressionType

H

HADOOP_CONFIGURATION_RESOURCES - Static variable in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

HADOOP_FILE_URL_ATTRIBUTE - Static variable in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

HADOOP_SECURITY_AUTHENTICATION - Static variable in class org.apache.nifi.hadoop.SecurityUtil

HadoopValidators - Interface in org.apache.nifi.processors.hadoop

Validators for Hadoop related processors.

HDFSResourceHelper - Class in org.apache.nifi.processors.hadoop

HDFSResourceHelper() - Constructor for class org.apache.nifi.processors.hadoop.HDFSResourceHelper

hdfsResources - Variable in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

HdfsResources - Class in org.apache.nifi.processors.hadoop

HdfsResources(Configuration, FileSystem, UserGroupInformation, KerberosUser) - Constructor for class org.apache.nifi.processors.hadoop.HdfsResources

I

init(ProcessorInitializationContext) - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

interruptStatisticsThread(FileSystem) - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

interruptStatisticsThread(FileSystem) - Static method in class org.apache.nifi.processors.hadoop.HDFSResourceHelper

isAllowExplicitKeytab() - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

isFileSystemAccessDenied(URI) - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

isLocalFileSystemAccessDenied() - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

isSecurityEnabled(Configuration) - Static method in class org.apache.nifi.hadoop.SecurityUtil

Initializes UserGroupInformation with the given Configuration and returns UserGroupInformation.isSecurityEnabled().

K

KERBEROS - Static variable in class org.apache.nifi.hadoop.SecurityUtil

KERBEROS_CREDENTIALS_SERVICE - Static variable in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

KERBEROS_RELOGIN_PERIOD - Static variable in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

KERBEROS_USER_SERVICE - Static variable in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

kerberosConfigFile - Variable in class org.apache.nifi.hadoop.KerberosProperties

kerberosConfigFile - Variable in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

KerberosConfiguration - Class in org.apache.nifi.hadoop

Modified Kerberos configuration class from KerberosAuthenticator.KerberosConfiguration that requires authentication from a keytab.

KerberosConfiguration(String, String) - Constructor for class org.apache.nifi.hadoop.KerberosConfiguration

kerberosConfigValidator - Variable in class org.apache.nifi.hadoop.KerberosProperties

kerberosKeytab - Variable in class org.apache.nifi.hadoop.KerberosProperties

KerberosKeytabCredentials - Class in org.apache.nifi.hadoop

Crendentials that incorporate a user principal and a keytab file.

KerberosKeytabCredentials(String, String) - Constructor for class org.apache.nifi.hadoop.KerberosKeytabCredentials

KerberosKeytabSPNegoAuthSchemeProvider - Class in org.apache.nifi.hadoop

Provider class for KerberosKeytabSPNegoAuthScheme.

KerberosKeytabSPNegoAuthSchemeProvider() - Constructor for class org.apache.nifi.hadoop.KerberosKeytabSPNegoAuthSchemeProvider

KerberosKeytabSPNegoScheme - Class in org.apache.nifi.hadoop

This class provides a very similar authentication scheme and token generation as SPNegoScheme does.

KerberosKeytabSPNegoScheme() - Constructor for class org.apache.nifi.hadoop.KerberosKeytabSPNegoScheme

kerberosPassword - Variable in class org.apache.nifi.hadoop.KerberosProperties

kerberosPrincipal - Variable in class org.apache.nifi.hadoop.KerberosProperties

kerberosProperties - Variable in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

KerberosProperties - Class in org.apache.nifi.hadoop

All processors and controller services that need properties for Kerberos Principal and Keytab should obtain them through this class by calling: KerberosProperties props = KerberosProperties.create(NiFiProperties.getInstance()) The properties can be accessed from the resulting KerberosProperties instance.

KerberosProperties(File) - Constructor for class org.apache.nifi.hadoop.KerberosProperties

Instantiate a KerberosProperties object but keep in mind it is effectively a singleton because the krb5.conf file needs to be set as a system property which this constructor will take care of.

kerberosUser - Variable in class org.apache.nifi.processors.hadoop.HdfsResources

keytab - Variable in class org.apache.nifi.hadoop.KerberosKeytabCredentials

L

LOCAL_FILE_SYSTEM_URI - Static variable in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

LOGGER - Static variable in class org.apache.nifi.processors.hadoop.HDFSResourceHelper

loggerMethod - Variable in class org.apache.nifi.processors.hadoop.ExtendedConfiguration

loginKerberos(Configuration, String, String) - Static method in class org.apache.nifi.hadoop.SecurityUtil

Initializes UserGroupInformation with the given Configuration and performs the login for the given principal and keytab.

loginSimple(Configuration) - Static method in class org.apache.nifi.hadoop.SecurityUtil

Initializes UserGroupInformation with the given Configuration and returns UserGroupInformation.getLoginUser().

LZ4 - Enum constant in enum class org.apache.nifi.processors.hadoop.CompressionType

LZO - Enum constant in enum class org.apache.nifi.processors.hadoop.CompressionType

N

NONE - Enum constant in enum class org.apache.nifi.processors.hadoop.CompressionType

NORMALIZE_ERROR_WITH_PROPERTY - Static variable in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

NORMALIZE_ERROR_WITHOUT_PROPERTY - Static variable in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

O

org.apache.nifi.hadoop - package org.apache.nifi.hadoop

org.apache.nifi.processors.hadoop - package org.apache.nifi.processors.hadoop

P

POSITIVE_SHORT_VALIDATOR - Static variable in interface org.apache.nifi.processors.hadoop.HadoopValidators

preProcessConfiguration(Configuration, ProcessContext) - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

This method will be called after the Configuration has been created, but before the FileSystem is created, allowing sub-classes to take further action on the Configuration before creating the FileSystem.

properties - Variable in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

R

resetHDFSResources(List<String>, ProcessContext) - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

RESOURCES_LOCK - Static variable in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

S

SecurityUtil - Class in org.apache.nifi.hadoop

Provides synchronized access to UserGroupInformation to avoid multiple processors/services from interfering with each other.

SecurityUtil() - Constructor for class org.apache.nifi.hadoop.SecurityUtil

SNAPPY - Enum constant in enum class org.apache.nifi.processors.hadoop.CompressionType

T

TARGET_HDFS_DIR_CREATED_ATTRIBUTE - Static variable in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

toString() - Method in enum class org.apache.nifi.processors.hadoop.CompressionType

U

UMASK_VALIDATOR - Static variable in interface org.apache.nifi.processors.hadoop.HadoopValidators

USER_KERBEROS_CONF - Static variable in class org.apache.nifi.hadoop.KerberosConfiguration

USER_KERBEROS_LOGIN - Static variable in class org.apache.nifi.hadoop.KerberosConfiguration

USER_KERBEROS_OPTIONS - Static variable in class org.apache.nifi.hadoop.KerberosConfiguration

userGroupInformation - Variable in class org.apache.nifi.processors.hadoop.HdfsResources

userPrincipal - Variable in class org.apache.nifi.hadoop.KerberosKeytabCredentials

V

validateFileSystem(Configuration) - Method in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

validatePrincipalWithKeytabOrPassword(String, Configuration, String, String, String, ComponentLog) - Static method in class org.apache.nifi.hadoop.KerberosProperties

validationResourceHolder - Variable in class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor

ValidationResources(List<String>, Configuration) - Constructor for class org.apache.nifi.processors.hadoop.AbstractHadoopProcessor.ValidationResources

valueOf(String) - Static method in enum class org.apache.nifi.processors.hadoop.CompressionType

Returns the enum constant of this class with the specified name.

values() - Static method in enum class org.apache.nifi.processors.hadoop.CompressionType

Returns an array containing the constants of this enum class, in the order they are declared.

A B C D E F G H I K L N O P R S T U V
All Classes and Interfaces|All Packages|Constant Field Values