Tabnine Logo
MergeManagerImpl.closeOnDiskFile
Code IndexAdd Tabnine to your IDE (free)

How to use
closeOnDiskFile
method
in
org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl

Best Java code snippets using org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl.closeOnDiskFile (Showing top 5 results out of 315)

origin: org.apache.hadoop/hadoop-mapreduce-client-core

Path path = new Path("somePath");
CompressAwarePath cap = new CompressAwarePath(path, 1l, rand.nextInt());
manager.closeOnDiskFile(cap);
origin: io.prestosql.hadoop/hadoop-apache

@Override
public void commit() throws IOException {
 fs.rename(tmpOutputPath, outputPath);
 CompressAwarePath compressAwarePath = new CompressAwarePath(outputPath,
   getSize(), this.compressedSize);
 merger.closeOnDiskFile(compressAwarePath);
}

origin: com.github.jiayuhan-it/hadoop-mapreduce-client-core

@Override
public void commit() throws IOException {
 fs.rename(tmpOutputPath, outputPath);
 CompressAwarePath compressAwarePath = new CompressAwarePath(outputPath,
   getSize(), this.compressedSize);
 merger.closeOnDiskFile(compressAwarePath);
}

origin: ch.cern.hadoop/hadoop-mapreduce-client-core

@Override
public void commit() throws IOException {
 fs.rename(tmpOutputPath, outputPath);
 CompressAwarePath compressAwarePath = new CompressAwarePath(outputPath,
   getSize(), this.compressedSize);
 merger.closeOnDiskFile(compressAwarePath);
}

origin: io.hops/hadoop-mapreduce-client-core

@Override
public void commit() throws IOException {
 fs.rename(tmpOutputPath, outputPath);
 CompressAwarePath compressAwarePath = new CompressAwarePath(outputPath,
   getSize(), this.compressedSize);
 getMerger().closeOnDiskFile(compressAwarePath);
}

org.apache.hadoop.mapreduce.task.reduceMergeManagerImplcloseOnDiskFile

Popular methods of MergeManagerImpl

  • <init>
  • createInMemoryMerger
  • getMaxInMemReduceLimit
  • unreserve
  • closeInMemoryFile
  • createInMemorySegments
  • finalMerge
  • unconditionalReserve
    Unconditional Reserve is used by the Memory-to-Memory thread
  • canShuffleToMemory
  • close
  • createOnDiskMerger
  • reserve
  • createOnDiskMerger,
  • reserve,
  • waitForResource

Popular in Java

  • Finding current android device location
  • getApplicationContext (Context)
  • getResourceAsStream (ClassLoader)
  • getSupportFragmentManager (FragmentActivity)
  • Container (java.awt)
    A generic Abstract Window Toolkit(AWT) container object is a component that can contain other AWT co
  • EOFException (java.io)
    Thrown when a program encounters the end of a file or stream during an input operation.
  • String (java.lang)
  • Stream (java.util.stream)
    A sequence of elements supporting sequential and parallel aggregate operations. The following exampl
  • ZipFile (java.util.zip)
    This class provides random read access to a zip file. You pay more to read the zip file's central di
  • SAXParseException (org.xml.sax)
    Encapsulate an XML parse error or warning.> This module, both source code and documentation, is in t
  • Top 12 Jupyter Notebook extensions
Tabnine Logo
  • Products

    Search for Java codeSearch for JavaScript code
  • IDE Plugins

    IntelliJ IDEAWebStormVisual StudioAndroid StudioEclipseVisual Studio CodePyCharmSublime TextPhpStormVimGoLandRubyMineEmacsJupyter NotebookJupyter LabRiderDataGripAppCode
  • Company

    About UsContact UsCareers
  • Resources

    FAQBlogTabnine AcademyTerms of usePrivacy policyJava Code IndexJavascript Code Index
Get Tabnine for your IDE now