Tabnine Logo
EncodingStats
Code IndexAdd Tabnine to your IDE (free)

How to use
EncodingStats
in
org.apache.parquet.column

Best Java code snippets using org.apache.parquet.column.EncodingStats (Showing top 9 results out of 315)

origin: org.apache.parquet/parquet-column

 public EncodingStats build() {
  return new EncodingStats(
    Collections.unmodifiableMap(new LinkedHashMap<Encoding, Integer>(dictStats)),
    Collections.unmodifiableMap(new LinkedHashMap<Encoding, Integer>(dataStats)),
    usesV2Pages);
 }
}
origin: org.lasersonlab.apache.parquet/parquet-hadoop

public List<PageEncodingStats> convertEncodingStats(EncodingStats stats) {
 if (stats == null) {
  return null;
 }
 List<PageEncodingStats> formatStats = new ArrayList<PageEncodingStats>();
 for (org.apache.parquet.column.Encoding encoding : stats.getDictionaryEncodings()) {
  formatStats.add(new PageEncodingStats(
    PageType.DICTIONARY_PAGE, getEncoding(encoding),
    stats.getNumDictionaryPagesEncodedAs(encoding)));
 }
 PageType dataPageType = (stats.usesV2Pages() ? PageType.DATA_PAGE_V2 : PageType.DATA_PAGE);
 for (org.apache.parquet.column.Encoding encoding : stats.getDataEncodings()) {
  formatStats.add(new PageEncodingStats(
    dataPageType, getEncoding(encoding),
    stats.getNumDataPagesEncodedAs(encoding)));
 }
 return formatStats;
}
origin: org.apache.parquet/parquet-hadoop

 private boolean hasDictionaryPage(ColumnChunkMetaData column) {
  EncodingStats stats = column.getEncodingStats();
  if (stats != null) {
   // ensure there is a dictionary page and that it is used to encode data pages
   return stats.hasDictionaryPages() && stats.hasDictionaryEncodedPages();
  }

  Set<Encoding> encodings = column.getEncodings();
  return (encodings.contains(PLAIN_DICTIONARY) || encodings.contains(RLE_DICTIONARY));
 }
}
origin: Netflix/iceberg

EncodingStats stats = meta.getEncodingStats();
if (stats != null) {
 return stats.hasNonDictionaryEncodedPages();
origin: org.apache.parquet/parquet-hadoop

EncodingStats stats = meta.getEncodingStats();
if (stats != null) {
 return stats.hasNonDictionaryEncodedPages();
origin: org.apache.parquet/parquet-hadoop

public List<PageEncodingStats> convertEncodingStats(EncodingStats stats) {
 if (stats == null) {
  return null;
 }
 List<PageEncodingStats> formatStats = new ArrayList<PageEncodingStats>();
 for (org.apache.parquet.column.Encoding encoding : stats.getDictionaryEncodings()) {
  formatStats.add(new PageEncodingStats(
    PageType.DICTIONARY_PAGE, getEncoding(encoding),
    stats.getNumDictionaryPagesEncodedAs(encoding)));
 }
 PageType dataPageType = (stats.usesV2Pages() ? PageType.DATA_PAGE_V2 : PageType.DATA_PAGE);
 for (org.apache.parquet.column.Encoding encoding : stats.getDataEncodings()) {
  formatStats.add(new PageEncodingStats(
    dataPageType, getEncoding(encoding),
    stats.getNumDataPagesEncodedAs(encoding)));
 }
 return formatStats;
}
origin: org.lasersonlab.apache.parquet/parquet-hadoop

 private boolean hasDictionaryPage(ColumnChunkMetaData column) {
  EncodingStats stats = column.getEncodingStats();
  if (stats != null) {
   // ensure there is a dictionary page and that it is used to encode data pages
   return stats.hasDictionaryPages() && stats.hasDictionaryEncodedPages();
  }

  Set<Encoding> encodings = column.getEncodings();
  return (encodings.contains(PLAIN_DICTIONARY) || encodings.contains(RLE_DICTIONARY));
 }
}
origin: org.lasersonlab.apache.parquet/parquet-hadoop

EncodingStats stats = meta.getEncodingStats();
if (stats != null) {
 return stats.hasNonDictionaryEncodedPages();
origin: org.lasersonlab.apache.parquet/parquet-column

 public EncodingStats build() {
  return new EncodingStats(
    Collections.unmodifiableMap(new LinkedHashMap<Encoding, Integer>(dictStats)),
    Collections.unmodifiableMap(new LinkedHashMap<Encoding, Integer>(dataStats)),
    usesV2Pages);
 }
}
org.apache.parquet.columnEncodingStats

Javadoc

EncodingStats track dictionary and data page encodings for a single column within a row group. These are used when filtering row groups. For example, to filter a row group based on a column's dictionary, all of the data pages in that column must be dictionary-encoded. This class provides convenience methods for those checks, like #hasNonDictionaryEncodedPages().

Most used methods

  • hasNonDictionaryEncodedPages
  • <init>
  • getDataEncodings
  • getDictionaryEncodings
  • getNumDataPagesEncodedAs
  • getNumDictionaryPagesEncodedAs
  • hasDictionaryEncodedPages
  • hasDictionaryPages
  • usesV2Pages

Popular in Java

  • Parsing JSON documents to java classes using gson
  • scheduleAtFixedRate (ScheduledExecutorService)
  • getSharedPreferences (Context)
  • runOnUiThread (Activity)
  • GridBagLayout (java.awt)
    The GridBagLayout class is a flexible layout manager that aligns components vertically and horizonta
  • Format (java.text)
    The base class for all formats. This is an abstract base class which specifies the protocol for clas
  • Date (java.util)
    A specific moment in time, with millisecond precision. Values typically come from System#currentTime
  • LinkedHashMap (java.util)
    LinkedHashMap is an implementation of Map that guarantees iteration order. All optional operations a
  • Callable (java.util.concurrent)
    A task that returns a result and may throw an exception. Implementors define a single method with no
  • BoxLayout (javax.swing)
  • Github Copilot alternatives
Tabnine Logo
  • Products

    Search for Java codeSearch for JavaScript code
  • IDE Plugins

    IntelliJ IDEAWebStormVisual StudioAndroid StudioEclipseVisual Studio CodePyCharmSublime TextPhpStormVimGoLandRubyMineEmacsJupyter NotebookJupyter LabRiderDataGripAppCode
  • Company

    About UsContact UsCareers
  • Resources

    FAQBlogTabnine AcademyTerms of usePrivacy policyJava Code IndexJavascript Code Index
Get Tabnine for your IDE now