Package gobblin.util.request_allocation

Interface Summary

Interface	Description
AllocatedRequestsIterator<T extends Request<T>>	An Iterator over Request that also provides with the total resources used by all consumed entries.
HierarchicalPrioritizer<T extends Request>	A Comparator for Requests that can also compare Requestors, and which guarantees that given Requests r1, r2, then r1.getRequestor > r2.getRequestor implies r1 > r2.
PushDownRequestor<T extends Request>	A Requestor that can provide an Iterator of Requests already sorted by the input prioritizer.
Request<T extends Request>	Represents an expensive request in the request allocation problem.
RequestAllocator<T extends Request<T>>	This interface is intended to solve the problem of selecting a subset of expensive requests based on priority when there are limited resources to perform such requests.
RequestAllocator.Factory
Requestor<T extends Request>	A wrapper around a Iterator of Requests used for request allocation problem.
ResourceEstimator<T>	Computes the ResourceRequirement for Requests.
ResourceEstimator.Factory<T>

Class Summary

Class	Description
AllocatedRequestsIteratorBase<T extends Request<T>>	A basic implementation of AllocatedRequestsIterator.
AllocatedRequestsIteratorBase.RequestWithResourceRequirement<T>	Stores and element and its ResourceRequirement.
AllocatedRequestsIteratorBase.TExtractor<T>	A Function used to extract the actual Request from a AllocatedRequestsIteratorBase.RequestWithResourceRequirement.
BruteForceAllocator<T extends Request<T>>	A RequestAllocator that simply adds every work unit to a ConcurrentBoundedPriorityIterable, then returns the iterator.
BruteForceAllocator.Factory
ConcurrentBoundedPriorityIterable<T>	A concurrent bounded priority Iterable.
GreedyAllocator<T extends Request<T>>	A RequestAllocator that selects Requests without any order guarantees until the ResourcePool is full, then stops.
GreedyAllocator.Factory
HierarchicalAllocator<T extends Request<T>>	A RequestAllocator optimized for HierarchicalPrioritizers.
HierarchicalAllocator.Factory
PreOrderAllocator<T extends Request<T>>	A RequestAllocator that operates over PushDownRequestors, getting a pre-ordered iterator of Requests from each Requestor and merging them, stopping as soon as the ResourcePool is exhausted.
PreOrderAllocator.Factory
PriorityIterableBasedRequestAllocator<T extends Request<T>>
RequestAllocatorConfig<T extends Request<T>>
RequestAllocatorConfig.AllEqualPrioritizer<T>
RequestAllocatorConfig.Builder<T extends Request<T>>
RequestAllocatorUtils
ResourcePool	Represents a pool of available resources for a RequestAllocator.
ResourceRequirement	Represents a requirement of resources in a ResourcePool.
ResourceRequirement.Builder
SimpleHierarchicalPrioritizer<T extends Request<T>>	A HierarchicalPrioritizer built from two input Comparators: one for Requestor and one for Request.