gobblin.util

Class PullFileLoader

java.lang.Object

gobblin.util.PullFileLoader

public class PullFileLoader
extends Object

Used to load pull files from the file system.

Field Summary

Fields

Modifier and Type	Field and Description
static Set<String>	DEFAULT_HOCON_PULL_FILE_EXTENSIONS
static Set<String>	DEFAULT_JAVA_PROPS_PULL_FILE_EXTENSIONS
static String	GLOBAL_PROPS_EXTENSION
static PathFilter	GLOBAL_PROPS_PATH_FILTER

Constructor Summary

Constructors

Constructor and Description
PullFileLoader(Path rootDirectory, FileSystem fs, Collection<String> javaPropsPullFileExtensions, Collection<String> hoconPullFileExtensions)

Method Summary

Modifier and Type	Method and Description
Config	loadPullFile(Path path, Config sysProps, boolean loadGlobalProperties) Load a single pull file.
Collection<Config>	loadPullFilesRecursively(Path path, Config sysProps, boolean loadGlobalProperties) Find and load all pull files under a base Path recursively.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

GLOBAL_PROPS_EXTENSION

public static final String GLOBAL_PROPS_EXTENSION

See Also:

Constant Field Values

GLOBAL_PROPS_PATH_FILTER

public static final PathFilter GLOBAL_PROPS_PATH_FILTER

DEFAULT_JAVA_PROPS_PULL_FILE_EXTENSIONS

public static final Set<String> DEFAULT_JAVA_PROPS_PULL_FILE_EXTENSIONS

DEFAULT_HOCON_PULL_FILE_EXTENSIONS

public static final Set<String> DEFAULT_HOCON_PULL_FILE_EXTENSIONS

Constructor Detail

PullFileLoader

public PullFileLoader(Path rootDirectory,
                      FileSystem fs,
                      Collection<String> javaPropsPullFileExtensions,
                      Collection<String> hoconPullFileExtensions)

Method Detail

loadPullFile

public Config loadPullFile(Path path,
                           Config sysProps,
                           boolean loadGlobalProperties)
                    throws IOException

Load a single pull file.

Parameters:

path - The Path to the pull file to load, full path

sysProps - A Config used as fallback.

loadGlobalProperties - if true, will also load at most one *.properties file per directory from the rootDirectory to the pull file Path.

Returns:

The loaded Config.

Throws:

IOException

loadPullFilesRecursively

public Collection<Config> loadPullFilesRecursively(Path path,
                                                   Config sysProps,
                                                   boolean loadGlobalProperties)

Find and load all pull files under a base Path recursively.

Parameters:

path - base Path where pull files should be found recursively.

sysProps - A Config used as fallback.

loadGlobalProperties - if true, will also load at most one *.properties file per directory from the rootDirectory to the pull file Path for each pull file.

Returns:

The loaded Configs.