Package org.apache.accumulo.core.summary
Class Gatherer
- java.lang.Object
-
- org.apache.accumulo.core.summary.Gatherer
-
public class Gatherer extends Object
This class implements using multiple tservers to gather summaries. Below is a rough outline of the RPC process.- Clients pick a random tserver and make an RPC to remotely execute
gather(ExecutorService)
. gather(ExecutorService)
will call make RPC calls to multiple tservers to remotely executeprocessPartition(ExecutorService, int, int)
processPartition(ExecutorService, int, int)
will make RPC calls to multiple tserver to remotely executeprocessFiles(FileSystemResolver, Map, BlockCache, BlockCache, Cache, ExecutorService)
- Clients pick a random tserver and make an RPC to remotely execute
-
-
Nested Class Summary
Nested Classes Modifier and Type Class Description static interface
Gatherer.FileSystemResolver
static class
Gatherer.RowRange
-
Constructor Summary
Constructors Constructor Description Gatherer(ClientContext context, TSummaryRequest request, AccumuloConfiguration tableConfig, CryptoService cryptoService)
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description Future<SummaryCollection>
gather(ExecutorService es)
Future<SummaryCollection>
processFiles(Gatherer.FileSystemResolver volMgr, Map<String,List<TRowRange>> files, BlockCache summaryCache, BlockCache indexCache, com.google.common.cache.Cache<String,Long> fileLenCache, ExecutorService srp)
This method will read summaries from a set of files.Future<SummaryCollection>
processPartition(ExecutorService execSrv, int modulus, int remainder)
This methods reads a subset of file paths into memory and groups them by location.
-
-
-
Constructor Detail
-
Gatherer
public Gatherer(ClientContext context, TSummaryRequest request, AccumuloConfiguration tableConfig, CryptoService cryptoService)
-
-
Method Detail
-
processPartition
public Future<SummaryCollection> processPartition(ExecutorService execSrv, int modulus, int remainder)
This methods reads a subset of file paths into memory and groups them by location. Then it request summaries for files from each location/tablet server.
-
processFiles
public Future<SummaryCollection> processFiles(Gatherer.FileSystemResolver volMgr, Map<String,List<TRowRange>> files, BlockCache summaryCache, BlockCache indexCache, com.google.common.cache.Cache<String,Long> fileLenCache, ExecutorService srp)
This method will read summaries from a set of files.
-
gather
public Future<SummaryCollection> gather(ExecutorService es)
-
-