Class FileOperations

    • Constructor Detail

      • FileOperations

        public FileOperations()
    • Method Detail

      • getValidExtensions

        public static Set<String> getValidExtensions()
      • getBulkWorkingFiles

        public static Set<String> getBulkWorkingFiles()
      • newWriterBuilder

        public FileOperations.WriterBuilder newWriterBuilder()
        Construct an operation object allowing one to create a writer for a file.
        Syntax:
         FileSKVWriter writer = fileOperations.newWriterBuilder()
             .forFile(...)
             .withTableConfiguration(...)
             .withRateLimiter(...) // optional
             .withCompression(...) // optional
             .build();
         
      • newIndexReaderBuilder

        public FileOperations.IndexReaderBuilder newIndexReaderBuilder()
        Construct an operation object allowing one to create an index iterator for a file.
        Syntax:
         FileSKVIterator iterator = fileOperations.newIndexReaderBuilder()
             .forFile(...)
             .withTableConfiguration(...)
             .withRateLimiter(...) // optional
             .withBlockCache(...) // optional
             .build();
         
      • newScanReaderBuilder

        public FileOperations.ScanReaderBuilder newScanReaderBuilder()
        Construct an operation object allowing one to create a "scan" reader for a file. Scan readers do not have any optimizations for seeking beyond their initial position. This is useful for file operations that only need to scan data within a range and do not need to seek. Therefore file metadata such as indexes does not need to be kept in memory while the file is scanned. Also seek optimizations like bloom filters do not need to be loaded.
        Syntax:
         FileSKVIterator scanner = fileOperations.newScanReaderBuilder()
             .forFile(...)
             .withTableConfiguration(...)
             .overRange(...)
             .withRateLimiter(...) // optional
             .withBlockCache(...) // optional
             .build();
         
      • newReaderBuilder

        public FileOperations.ReaderBuilder newReaderBuilder()
        Construct an operation object allowing one to create a reader for a file. A reader constructed in this manner fully supports seeking, and also enables any optimizations related to seeking (e.g. Bloom filters).
        Syntax:
         FileSKVIterator scanner = fileOperations.newReaderBuilder()
             .forFile(...)
             .withTableConfiguration(...)
             .withRateLimiter(...) // optional
             .withBlockCache(...) // optional
             .seekToBeginning(...) // optional
             .build();