Tabnine Logo
DataSegmentFinder
Code IndexAdd Tabnine to your IDE (free)

How to use
DataSegmentFinder
in
org.apache.druid.segment.loading

Best Java code snippets using org.apache.druid.segment.loading.DataSegmentFinder (Showing top 7 results out of 315)

origin: apache/incubator-druid

DataSegmentFinder.putInMapRetainingNewest(timestampedSegments, dataSegment, indexZip.lastModified());
origin: apache/incubator-druid

@Override
public void run()
{
 final Injector injector = makeInjector();
 indexerMetadataStorageCoordinator = injector.getInstance(IndexerMetadataStorageCoordinator.class);
 final DataSegmentFinder dataSegmentFinder = injector.getInstance(DataSegmentFinder.class);
 log.info("Start searching segments under [%s]", workingDirPath);
 Set<DataSegment> segments = null;
 try {
  segments = dataSegmentFinder.findSegments(workingDirPath, Boolean.valueOf(updateDescriptor));
 }
 catch (SegmentLoadingException e) {
  Throwables.propagate(e);
 }
 log.info(
   "Done searching segments under [%s], [%d] segments were found",
   workingDirPath,
   segments.size()
 );
 try {
  insertSegments(segments);
 }
 catch (IOException e) {
  Throwables.propagate(e);
 }
 log.info("Done processing [%d] segments", segments.size());
}
origin: apache/incubator-druid

DataSegmentFinder.putInMapRetainingNewest(
  timestampedSegments,
  dataSegment,
origin: org.apache.druid/druid-services

@Override
public void run()
{
 final Injector injector = makeInjector();
 indexerMetadataStorageCoordinator = injector.getInstance(IndexerMetadataStorageCoordinator.class);
 final DataSegmentFinder dataSegmentFinder = injector.getInstance(DataSegmentFinder.class);
 log.info("Start searching segments under [%s]", workingDirPath);
 Set<DataSegment> segments = null;
 try {
  segments = dataSegmentFinder.findSegments(workingDirPath, Boolean.valueOf(updateDescriptor));
 }
 catch (SegmentLoadingException e) {
  Throwables.propagate(e);
 }
 log.info(
   "Done searching segments under [%s], [%d] segments were found",
   workingDirPath,
   segments.size()
 );
 try {
  insertSegments(segments);
 }
 catch (IOException e) {
  Throwables.propagate(e);
 }
 log.info("Done processing [%d] segments", segments.size());
}
origin: apache/incubator-druid

DataSegmentFinder.putInMapRetainingNewest(
  timestampedSegments,
  dataSegment,
origin: org.apache.druid/druid-server

DataSegmentFinder.putInMapRetainingNewest(timestampedSegments, dataSegment, indexZip.lastModified());
origin: org.apache.druid.extensions/druid-s3-extensions

DataSegmentFinder.putInMapRetainingNewest(
  timestampedSegments,
  dataSegment,
org.apache.druid.segment.loadingDataSegmentFinder

Javadoc

A DataSegmentFinder is responsible for finding Druid segments underneath a specified directory and optionally updates all descriptor.json files on deep storage with correct loadSpec.

Most used methods

  • putInMapRetainingNewest
    Adds dataSegment if it does not exist in timestampedSegments. If it exists, replaces entry if segmen
  • findSegments
    This method should first recursively look for descriptor.json (partitionNum_descriptor.json for HDFS

Popular in Java

  • Reactive rest calls using spring rest template
  • getContentResolver (Context)
  • getSupportFragmentManager (FragmentActivity)
  • getApplicationContext (Context)
  • Font (java.awt)
    The Font class represents fonts, which are used to render text in a visible way. A font provides the
  • Graphics2D (java.awt)
    This Graphics2D class extends the Graphics class to provide more sophisticated control overgraphics
  • Enumeration (java.util)
    A legacy iteration interface.New code should use Iterator instead. Iterator replaces the enumeration
  • Locale (java.util)
    Locale represents a language/country/variant combination. Locales are used to alter the presentatio
  • SortedSet (java.util)
    SortedSet is a Set which iterates over its elements in a sorted order. The order is determined eithe
  • Callable (java.util.concurrent)
    A task that returns a result and may throw an exception. Implementors define a single method with no
  • Top Vim plugins
Tabnine Logo
  • Products

    Search for Java codeSearch for JavaScript code
  • IDE Plugins

    IntelliJ IDEAWebStormVisual StudioAndroid StudioEclipseVisual Studio CodePyCharmSublime TextPhpStormVimGoLandRubyMineEmacsJupyter NotebookJupyter LabRiderDataGripAppCode
  • Company

    About UsContact UsCareers
  • Resources

    FAQBlogTabnine AcademyTerms of usePrivacy policyJava Code IndexJavascript Code Index
Get Tabnine for your IDE now