Tabnine Logo
PartitionedFileSet.getPartitionOutput
Code IndexAdd Tabnine to your IDE (free)

How to use
getPartitionOutput
method
in
co.cask.cdap.api.dataset.lib.PartitionedFileSet

Best Java code snippets using co.cask.cdap.api.dataset.lib.PartitionedFileSet.getPartitionOutput (Showing top 20 results out of 315)

origin: caskdata/cdap

 @Override
 public void apply() throws Exception {
  for (PartitionKey partitionKey : partitionKeys1) {
   dataset.getPartitionOutput(partitionKey).addPartition();
  }
 }
});
origin: caskdata/cdap

 @Override
 public void apply() throws Exception {
  for (PartitionKey partitionKey : partitionKeys) {
   dataset.getPartitionOutput(partitionKey).addPartition();
  }
 }
});
origin: caskdata/cdap

 @Override
 public void apply() throws Exception {
  for (PartitionKey partitionKey : partitionKeys) {
   dataset.getPartitionOutput(partitionKey).addPartition();
  }
 }
});
origin: caskdata/cdap

 @Override
 public void apply() throws Exception {
   dataset.getPartitionOutput(partitionKey).addPartition();
 }
});
origin: caskdata/cdap

 @Override
 public void apply() throws Exception {
  for (PartitionKey partitionKey : partitionKeys1) {
   dataset.getPartitionOutput(partitionKey).addPartition();
  }
 }
});
origin: caskdata/cdap

 @Override
 public void apply() throws Exception {
  dataset.getPartitionOutput(partitionKey).addPartition();
 }
});
origin: caskdata/cdap

 @Override
 public void apply() throws Exception {
  dataset.getPartitionOutput(partitionKey1).addPartition();
 }
});
origin: caskdata/cdap

 @Override
 public void apply() throws Exception {
  // add 2 more partitions after the first 3. We do not need to keep track of these, because they will be dropped
  // and not consumed
  for (int i = 0; i < 2; i++) {
   dataset.getPartitionOutput(generateUniqueKey()).addPartition();
  }
 }
});
origin: caskdata/cdap

 @Override
 public void apply() throws Exception {
  dataset.getPartitionOutput(partitionKey2).addPartition();
 }
});
origin: caskdata/cdap

 @Override
 public void apply() throws Exception {
  for (PartitionKey partitionKey : partitionKeys2) {
   dataset.getPartitionOutput(partitionKey).addPartition();
  }
 }
});
origin: caskdata/cdap

 @Override
 public void apply() throws Exception {
  for (PartitionKey partitionKey : partitionKeys2) {
   dataset.getPartitionOutput(partitionKey).addPartition();
  }
 }
});
origin: caskdata/cdap

 @Override
 public void apply() throws Exception {
  for (final PartitionKey partitionKey : partitionKeys1) {
   dataset.getPartitionOutput(partitionKey).addPartition();
  }
  for (final PartitionKey partitionKey : partitionKeys2) {
   dataset.getPartitionOutput(partitionKey).addPartition();
  }
 }
});
origin: caskdata/cdap

 @Override
 public void apply() throws Exception {
  for (PartitionKey partitionKey : partitionKeys2) {
   dataset.getPartitionOutput(partitionKey).addPartition();
  }
 }
});
origin: caskdata/cdap

 @Override
 public void apply() throws Exception {
  for (PartitionKey partitionKey : partitionKeys1) {
   dataset.getPartitionOutput(partitionKey).addPartition();
  }
 }
});
origin: caskdata/cdap

 @Override
 public void apply() throws Exception {
   dataset.getPartitionOutput(partitionKey).addPartition();
 }
});
origin: caskdata/cdap

 @Override
 public void apply() throws Exception {
  for (final PartitionKey partitionKey : partitionKeys) {
   dataset.getPartitionOutput(partitionKey).addPartition();
  }
 }
});
origin: caskdata/cdap

 @Override
 public void apply() throws Exception {
  dataset.getPartitionOutput(partitionKey).addPartition();
 }
});
origin: caskdata/cdap

 @Override
 public BasicPartition call() throws Exception {
  PartitionOutput p = dataset.getPartitionOutput(key);
  p.addPartition();
  return new BasicPartition((PartitionedFileSetDataset) dataset,
               p.getRelativePath(), p.getPartitionKey());
 }
});
origin: caskdata/cdap

 @Override
 public void apply() throws Exception {
  // drop all existing partitions (2 of which are not consumed)
  for (PartitionDetail partitionDetail : dataset.getPartitions(PartitionFilter.ALWAYS_MATCH)) {
   dataset.dropPartition(partitionDetail.getPartitionKey());
  }
  // add 5 new ones
  for (PartitionKey partitionKey : partitionKeys2) {
   dataset.getPartitionOutput(partitionKey).addPartition();
  }
 }
});
origin: caskdata/cdap

private Location createPartition(PartitionedFileSet pfs, PartitionKey key, String fileName,
                 int intToWrite) throws IOException {
 PartitionOutput partitionOutput = pfs.getPartitionOutput(key);
 Location outputLocation = partitionOutput.getLocation().append(fileName);
 Assert.assertFalse(outputLocation.exists());
 try (OutputStream outputStream = outputLocation.getOutputStream()) {
  outputStream.write(intToWrite);
 }
 Assert.assertTrue(outputLocation.exists());
 partitionOutput.addPartition();
 return outputLocation;
}
co.cask.cdap.api.dataset.libPartitionedFileSetgetPartitionOutput

Javadoc

Return a partition output for a specific partition key, in preparation for creating a new partition. Obtain the location to write from the PartitionOutput, then call the PartitionOutput#addPartitionto add the partition to this dataset.

Popular methods of PartitionedFileSet

  • getPartition
  • getEmbeddedFileSet
  • dropPartition
  • getPartitions
  • addPartition
    Add a partition for a given partition key, stored at a given path (relative to the file set's base p
  • consumePartitions
  • getPartitioning
  • addMetadata
    Adds a set of new metadata entries for a particular partition. Note that existing entries cannot be
  • concatenatePartition
    Asynchronous operation to concatenate the partition in Hive. Note that Hive only supports certain fo
  • removeMetadata
    Removes a set of metadata entries for a particular partition. If any metadata key does not exist, no
  • setMetadata
    Sets metadata entries for a particular partition. If the metadata entry key does not already exist,
  • setMetadata

Popular in Java

  • Reading from database using SQL prepared statement
  • compareTo (BigDecimal)
  • runOnUiThread (Activity)
  • scheduleAtFixedRate (ScheduledExecutorService)
  • Rectangle (java.awt)
    A Rectangle specifies an area in a coordinate space that is enclosed by the Rectangle object's top-
  • Dictionary (java.util)
    Note: Do not use this class since it is obsolete. Please use the Map interface for new implementatio
  • Random (java.util)
    This class provides methods that return pseudo-random values.It is dangerous to seed Random with the
  • StringTokenizer (java.util)
    Breaks a string into tokens; new code should probably use String#split.> // Legacy code: StringTo
  • Pattern (java.util.regex)
    Patterns are compiled regular expressions. In many cases, convenience methods such as String#matches
  • Project (org.apache.tools.ant)
    Central representation of an Ant project. This class defines an Ant project with all of its targets,
  • Best IntelliJ plugins
Tabnine Logo
  • Products

    Search for Java codeSearch for JavaScript code
  • IDE Plugins

    IntelliJ IDEAWebStormVisual StudioAndroid StudioEclipseVisual Studio CodePyCharmSublime TextPhpStormVimGoLandRubyMineEmacsJupyter NotebookJupyter LabRiderDataGripAppCode
  • Company

    About UsContact UsCareers
  • Resources

    FAQBlogTabnine AcademyTerms of usePrivacy policyJava Code IndexJavascript Code Index
Get Tabnine for your IDE now