Tabnine Logo
PooledConcurrentMergeScheduler
Code IndexAdd Tabnine to your IDE (free)

How to use
PooledConcurrentMergeScheduler
in
org.apache.lucene.index

Best Java code snippets using org.apache.lucene.index.PooledConcurrentMergeScheduler (Showing top 3 results out of 315)

origin: neo4j/neo4j

@Override
public void merge( IndexWriter writer, MergeTrigger trigger, boolean newMergesFound )
    throws IOException
{
  while ( true )
  {
    MergePolicy.OneMerge merge = writer.getNextMerge();
    if ( merge == null )
    {
      return;
    }
    boolean success = false;
    try
    {
      MergeThread mergeThread = getMergeThread( writer, merge );
      writerTaskCounter.increment();
      PooledConcurrentMergePool.mergeThreadsPool.submit( mergeTask( mergeThread ) );
      success = true;
    }
    finally
    {
      if ( !success )
      {
        writer.mergeFinish( merge );
        writerTaskCounter.decrement();
      }
    }
  }
}
origin: neo4j/neo4j

@Override
public void close()
{
  waitForAllTasks();
  super.close();
}
origin: neo4j/neo4j

public static IndexWriterConfig standard( Analyzer analyzer )
{
  IndexWriterConfig writerConfig = new IndexWriterConfig( analyzer );
  writerConfig.setMaxBufferedDocs( MAX_BUFFERED_DOCS );
  writerConfig.setMaxBufferedDeleteTerms( MAX_BUFFERED_DELETE_TERMS );
  writerConfig.setIndexDeletionPolicy( new SnapshotDeletionPolicy( new KeepOnlyLastCommitDeletionPolicy() ) );
  writerConfig.setUseCompoundFile( true );
  writerConfig.setRAMBufferSizeMB( STANDARD_RAM_BUFFER_SIZE_MB );
  writerConfig.setCodec(new Lucene54Codec()
  {
    @Override
    public PostingsFormat getPostingsFormatForField( String field )
    {
      PostingsFormat postingFormat = super.getPostingsFormatForField( field );
      return CODEC_BLOCK_TREE_ORDS_POSTING_FORMAT ? blockTreeOrdsPostingsFormat : postingFormat;
    }
  });
  if ( CUSTOM_MERGE_SCHEDULER )
  {
    writerConfig.setMergeScheduler( new PooledConcurrentMergeScheduler() );
  }
  LogByteSizeMergePolicy mergePolicy = new LogByteSizeMergePolicy();
  mergePolicy.setNoCFSRatio( MERGE_POLICY_NO_CFS_RATIO );
  mergePolicy.setMinMergeMB( MERGE_POLICY_MIN_MERGE_MB );
  mergePolicy.setMergeFactor( MERGE_POLICY_MERGE_FACTOR );
  writerConfig.setMergePolicy( mergePolicy );
  return writerConfig;
}
org.apache.lucene.indexPooledConcurrentMergeScheduler

Javadoc

Lucene indexes merge scheduler that execute merges in a thread pool instead of starting separate thread for each merge. Each writer have it's own scheduler but all of them use shared pool. Current implementation is minimalistic in a number of things it knows about lucene internals to simplify migrations overhead. It wraps up lucene internal merge tasks and execute them in a common thread pool. In case if pool and queue exhausted merge will be performed in callers thread. Since we cant rely on lucene per writer merge threads we need to perform writer tasks counting ourselves to prevent cases while writer will be closed in the middle of merge and will wait for all writer related merges to complete before allowing close of writer scheduler.

Most used methods

  • <init>
  • getMergeThread
  • mergeTask
  • waitForAllTasks

Popular in Java

  • Creating JSON documents from java classes using gson
  • runOnUiThread (Activity)
  • addToBackStack (FragmentTransaction)
  • setScale (BigDecimal)
  • FileReader (java.io)
    A specialized Reader that reads from a file in the file system. All read requests made by calling me
  • DateFormat (java.text)
    Formats or parses dates and times.This class provides factories for obtaining instances configured f
  • NoSuchElementException (java.util)
    Thrown when trying to retrieve an element past the end of an Enumeration or Iterator.
  • Queue (java.util)
    A collection designed for holding elements prior to processing. Besides basic java.util.Collection o
  • JList (javax.swing)
  • JTextField (javax.swing)
  • Top Sublime Text plugins
Tabnine Logo
  • Products

    Search for Java codeSearch for JavaScript code
  • IDE Plugins

    IntelliJ IDEAWebStormVisual StudioAndroid StudioEclipseVisual Studio CodePyCharmSublime TextPhpStormVimGoLandRubyMineEmacsJupyter NotebookJupyter LabRiderDataGripAppCode
  • Company

    About UsContact UsCareers
  • Resources

    FAQBlogTabnine AcademyTerms of usePrivacy policyJava Code IndexJavascript Code Index
Get Tabnine for your IDE now