gobblin.data.management.copy.hive

Class WhitelistBlacklist

java.lang.Object

gobblin.data.management.copy.hive.WhitelistBlacklist

All Implemented Interfaces:

Serializable

public class WhitelistBlacklist
extends Object
implements Serializable

A whitelist / blacklist implementation for filtering Hive tables. Parses input whitelist and blacklist of the form [dbpattern.tablepattern1|tablepattern2|...],... and filters accordingly. The db and table patterns accept "*" characters. Each of whitelist and blacklist is a list of patterns. For a table to be accepted, it must fail the blacklist filter and pass the whitelist filter. Empty whitelist or blacklist are noops.

Example whitelist and blacklist patterns: * db1.table1 -> only db1.table1 passes. * db1 -> any table under db1 passes. * db1.table* -> any table under db1 whose name satisfies the pattern table* passes. * db* -> all tables from all databases whose names satisfy the pattern db* pass. * db*.table* -> db and table must satisfy the patterns db* and table* respectively * db1.table1,db2.table2 -> combine expressions for different databases with comma. * db1.table1|table2 -> combine expressions for same database with "|".

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
static String	BLACKLIST
static String	WHITELIST

Constructor Summary

Constructors

Constructor and Description
WhitelistBlacklist(Config config)
WhitelistBlacklist(String whitelist, String blacklist)

Method Summary

Modifier and Type	Method and Description
boolean	acceptDb(String db)
boolean	acceptTable(String db, String table)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

WHITELIST

public static final String WHITELIST

See Also:

Constant Field Values

BLACKLIST

public static final String BLACKLIST

See Also:

Constant Field Values

Constructor Detail

WhitelistBlacklist

public WhitelistBlacklist(Config config)
                   throws IOException

Throws:

IOException

WhitelistBlacklist

public WhitelistBlacklist(String whitelist,
                          String blacklist)
                   throws IOException

Throws:

IOException

Method Detail

acceptDb

public boolean acceptDb(String db)

Returns:

Whether database db might contain tables accepted by this WhitelistBlacklist.

acceptTable

public boolean acceptTable(String db,
                           String table)

Returns:

Whether the input table is accepted by this WhitelistBlacklist.