gobblin.util

Class ProxiedFileSystemCache

java.lang.Object

gobblin.util.ProxiedFileSystemCache

public class ProxiedFileSystemCache
extends Object

A cache for storing a mapping between Hadoop users and user FileSystem objects.

This classes uses Guava's Cache for storing the user to FileSystem mapping, and creates the FileSystems using the ProxiedFileSystemUtils class.

See Also:

Cache, ProxiedFileSystemUtils

Constructor Summary

Constructors

Constructor and Description
ProxiedFileSystemCache()

Method Summary

Modifier and Type	Method and Description
static FileSystem	getProxiedFileSystem(String userNameToProxyAs, Properties properties, Configuration conf) Deprecated. use #fromProperties
static FileSystem	getProxiedFileSystem(String userNameToProxyAs, Properties properties, URI fsURI) Deprecated. use #fromProperties
static FileSystem	getProxiedFileSystem(String userNameToProxyAs, Properties properties, URI fsURI, Configuration configuration) Deprecated. Use #fromProperties
static FileSystem	getProxiedFileSystemUsingKeytab(State state, URI fsURI, Configuration conf) Deprecated. use #fromKeytab.
static FileSystem	getProxiedFileSystemUsingKeytab(String userNameToProxyAs, String superUserName, Path superUserKeytabLocation, URI fsURI, Configuration conf) Deprecated. use #fromKeytab.
static FileSystem	getProxiedFileSystemUsingToken(String userNameToProxyAs, org.apache.hadoop.security.token.Token<?> userNameToken, URI fsURI, Configuration conf) Deprecated. use #fromToken.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ProxiedFileSystemCache

public ProxiedFileSystemCache()

Method Detail

getProxiedFileSystem

@Deprecated
public static FileSystem getProxiedFileSystem(@NonNull
                                                          String userNameToProxyAs,
                                                          Properties properties,
                                                          URI fsURI)
                                                   throws IOException

Deprecated. use #fromProperties

Gets a FileSystem that can perform any operations allowed by the specified userNameToProxyAs.

Parameters:

userNameToProxyAs - The name of the user the super user should proxy as

properties - Properties containing initialization properties.

fsURI - The URI for the FileSystem that should be created.

Returns:

a FileSystem that can execute commands on behalf of the specified userNameToProxyAs

Throws:

IOException

getProxiedFileSystem

@Deprecated
public static FileSystem getProxiedFileSystem(@NonNull
                                                          String userNameToProxyAs,
                                                          Properties properties,
                                                          Configuration conf)
                                                   throws IOException

Deprecated. use #fromProperties

Gets a FileSystem that can perform any operations allowed by the specified userNameToProxyAs.

Parameters:

userNameToProxyAs - The name of the user the super user should proxy as

properties - Properties containing initialization properties.

conf - The Configuration for the FileSystem that should be created.

Returns:

a FileSystem that can execute commands on behalf of the specified userNameToProxyAs

Throws:

IOException

getProxiedFileSystem

@Deprecated
public static FileSystem getProxiedFileSystem(@NonNull
                                                          String userNameToProxyAs,
                                                          Properties properties,
                                                          URI fsURI,
                                                          Configuration configuration)
                                                   throws IOException

Deprecated. Use #fromProperties

Gets a FileSystem that can perform any operations allowed by the specified userNameToProxyAs.

Parameters:

userNameToProxyAs - The name of the user the super user should proxy as

properties - Properties containing initialization properties.

fsURI - The URI for the FileSystem that should be created.

configuration - The Configuration for the FileSystem that should be created.

Returns:

a FileSystem that can execute commands on behalf of the specified userNameToProxyAs

Throws:

IOException

getProxiedFileSystemUsingKeytab

@Deprecated
public static FileSystem getProxiedFileSystemUsingKeytab(State state,
                                                                     URI fsURI,
                                                                     Configuration conf)
                                                              throws ExecutionException

Deprecated. use #fromKeytab.

Cached version of ProxiedFileSystemUtils.createProxiedFileSystemUsingKeytab(State, URI, Configuration).

Throws:

ExecutionException

getProxiedFileSystemUsingKeytab

@Deprecated
public static FileSystem getProxiedFileSystemUsingKeytab(@NonNull
                                                                     String userNameToProxyAs,
                                                                     String superUserName,
                                                                     Path superUserKeytabLocation,
                                                                     URI fsURI,
                                                                     Configuration conf)
                                                              throws ExecutionException

Deprecated. use #fromKeytab.

Cached version of ProxiedFileSystemUtils.createProxiedFileSystemUsingKeytab(String, String, Path, URI, Configuration).

Throws:

ExecutionException

getProxiedFileSystemUsingToken

@Deprecated
public static FileSystem getProxiedFileSystemUsingToken(@NonNull
                                                                    String userNameToProxyAs,
                                                                    org.apache.hadoop.security.token.Token<?> userNameToken,
                                                                    URI fsURI,
                                                                    Configuration conf)
                                                             throws ExecutionException

Deprecated. use #fromToken.

Cached version of ProxiedFileSystemUtils.createProxiedFileSystemUsingToken(String, Token, URI, Configuration).

Throws:

ExecutionException