co.cask.hydrator.common

Class SchemaValidator

java.lang.Object

co.cask.hydrator.common.SchemaValidator

public final class SchemaValidator
extends Object

Utility class for with methods for validating schema fields and its types, validating fields are simple, checking if schema is subset of another, checking if fields are present in schema, etc

Method Summary

Methods

Modifier and Type	Method and Description
static void	validateFieldsArePresentInSchema(co.cask.cdap.api.data.schema.Schema schema, String... requiredFields) Iterates through the required fields and checks if they are present in the schema
static co.cask.cdap.api.data.schema.Schema	validateOutputSchemaAndInputSchemaIfPresent(String outputSchemaString, String rowKeyField, PipelineConfigurer pipelineConfigurer) Validate output schema fields and if input schema is present, check if output schema is a subset of the input schema and return output schema.
static void	validateOutputSchemaIsSubsetOfInputSchema(co.cask.cdap.api.data.schema.Schema inputSchema, co.cask.cdap.api.data.schema.Schema outputSchema) Checks that all the fields in output schema is part of input schema and the fields schema type matches.
static void	validateSchemaFieldsAreSimple(co.cask.cdap.api.data.schema.Schema schema) Iterates through the schema fields and checks their type is simple

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

validateOutputSchemaAndInputSchemaIfPresent

@Nullable
public static co.cask.cdap.api.data.schema.Schema validateOutputSchemaAndInputSchemaIfPresent(String outputSchemaString,
                                                                                       String rowKeyField,
                                                                                       PipelineConfigurer pipelineConfigurer)

Validate output schema fields and if input schema is present, check if output schema is a subset of the input schema and return output schema.

Parameters:

outputSchemaString - output schema from config

rowKeyField - row key field from config

pipelineConfigurer - Pipelineconfigurer that's used to get input schema and set output schema.

Returns:

Schema - output schema

validateOutputSchemaIsSubsetOfInputSchema

public static void validateOutputSchemaIsSubsetOfInputSchema(co.cask.cdap.api.data.schema.Schema inputSchema,
                                             co.cask.cdap.api.data.schema.Schema outputSchema)

Checks that all the fields in output schema is part of input schema and the fields schema type matches.

Parameters:

inputSchema -

outputSchema -

validateSchemaFieldsAreSimple

public static void validateSchemaFieldsAreSimple(co.cask.cdap.api.data.schema.Schema schema)

Iterates through the schema fields and checks their type is simple

Parameters:

schema -

validateFieldsArePresentInSchema

public static void validateFieldsArePresentInSchema(co.cask.cdap.api.data.schema.Schema schema,
                                    String... requiredFields)

Iterates through the required fields and checks if they are present in the schema

Parameters:

schema -

requiredFields -