congrats Icon
New! Tabnine Pro 14-day free trial
Start a free trial
Tabnine Logo
MeasureIngester.reEncodeDictionary
Code IndexAdd Tabnine to your IDE (free)

How to use
reEncodeDictionary
method
in
org.apache.kylin.measure.MeasureIngester

Best Java code snippets using org.apache.kylin.measure.MeasureIngester.reEncodeDictionary (Showing top 5 results out of 315)

origin: apache/kylin

/**
 * Re-encode with measures in Object[] format.
 * @param key
 * @param value
 * @return
 * @throws IOException
 */
public Pair<Text, Object[]> reEncode2(Text key, Text value) throws IOException {
  if (initialized == false) {
    throw new IllegalStateException("Not initialized");
  }
  Object[] measureObjs = new Object[measureDescs.size()];
  codec.decode(ByteBuffer.wrap(value.getBytes(), 0, value.getLength()), measureObjs);
  // re-encode measures if dictionary is used
  if (dictMeasures.size() > 0) {
    for (Pair<Integer, MeasureIngester> pair : dictMeasures) {
      int i = pair.getFirst();
      MeasureIngester ingester = pair.getSecond();
      measureObjs[i] = ingester.reEncodeDictionary(measureObjs[i], measureDescs.get(i), oldDicts, newDicts);
    }
  }
  return Pair.newPair(processKey(key), measureObjs);
}
origin: apache/kylin

/**
 * Re-encode with both dimension and measure in encoded (Text) format.
 * @param key
 * @param value
 * @return
 * @throws IOException
 */
public Pair<Text, Text> reEncode(Text key, Text value) throws IOException {
  if (initialized == false) {
    throw new IllegalStateException("Not initialized");
  }
  Object[] measureObjs = new Object[measureDescs.size()];
  // re-encode measures if dictionary is used
  if (dictMeasures.size() > 0) {
    codec.decode(ByteBuffer.wrap(value.getBytes(), 0, value.getLength()), measureObjs);
    for (Pair<Integer, MeasureIngester> pair : dictMeasures) {
      int i = pair.getFirst();
      MeasureIngester ingester = pair.getSecond();
      measureObjs[i] = ingester.reEncodeDictionary(measureObjs[i], measureDescs.get(i), oldDicts, newDicts);
    }
    ByteBuffer valueBuf = codec.encode(measureObjs);
    textValue.set(valueBuf.array(), 0, valueBuf.position());
    return Pair.newPair(processKey(key), textValue);
  } else {
    return Pair.newPair(processKey(key), value);
  }
}
origin: org.apache.kylin/kylin-engine-mr

/**
 * Re-encode with measures in Object[] format.
 * @param key
 * @param value
 * @return
 * @throws IOException
 */
public Pair<Text, Object[]> reEncode2(Text key, Text value) throws IOException {
  if (initialized == false) {
    throw new IllegalStateException("Not initialized");
  }
  Object[] measureObjs = new Object[measureDescs.size()];
  codec.decode(ByteBuffer.wrap(value.getBytes(), 0, value.getLength()), measureObjs);
  // re-encode measures if dictionary is used
  if (dictMeasures.size() > 0) {
    for (Pair<Integer, MeasureIngester> pair : dictMeasures) {
      int i = pair.getFirst();
      MeasureIngester ingester = pair.getSecond();
      measureObjs[i] = ingester.reEncodeDictionary(measureObjs[i], measureDescs.get(i), oldDicts, newDicts);
    }
  }
  return Pair.newPair(processKey(key), measureObjs);
}
origin: org.apache.kylin/kylin-engine-mr

/**
 * Re-encode with both dimension and measure in encoded (Text) format.
 * @param key
 * @param value
 * @return
 * @throws IOException
 */
public Pair<Text, Text> reEncode(Text key, Text value) throws IOException {
  if (initialized == false) {
    throw new IllegalStateException("Not initialized");
  }
  Object[] measureObjs = new Object[measureDescs.size()];
  // re-encode measures if dictionary is used
  if (dictMeasures.size() > 0) {
    codec.decode(ByteBuffer.wrap(value.getBytes(), 0, value.getLength()), measureObjs);
    for (Pair<Integer, MeasureIngester> pair : dictMeasures) {
      int i = pair.getFirst();
      MeasureIngester ingester = pair.getSecond();
      measureObjs[i] = ingester.reEncodeDictionary(measureObjs[i], measureDescs.get(i), oldDicts, newDicts);
    }
    ByteBuffer valueBuf = codec.encode(measureObjs);
    textValue.set(valueBuf.array(), 0, valueBuf.position());
    return Pair.newPair(processKey(key), textValue);
  } else {
    return Pair.newPair(processKey(key), value);
  }
}
origin: org.apache.kylin/kylin-job

int i = pair.getFirst();
MeasureIngester ingester = pair.getSecond();
measureObjs[i] = ingester.reEncodeDictionary(measureObjs[i], measureDescs.get(i), oldDicts, newDicts);
org.apache.kylin.measureMeasureIngesterreEncodeDictionary

Popular methods of MeasureIngester

  • create
  • valueOf
  • reset

Popular in Java

  • Running tasks concurrently on multiple threads
  • notifyDataSetChanged (ArrayAdapter)
  • getContentResolver (Context)
  • getSystemService (Context)
  • Dictionary (java.util)
    Note: Do not use this class since it is obsolete. Please use the Map interface for new implementatio
  • SortedSet (java.util)
    SortedSet is a Set which iterates over its elements in a sorted order. The order is determined eithe
  • Handler (java.util.logging)
    A Handler object accepts a logging request and exports the desired messages to a target, for example
  • Notification (javax.management)
  • LogFactory (org.apache.commons.logging)
    Factory for creating Log instances, with discovery and configuration features similar to that employ
  • Logger (org.apache.log4j)
    This is the central class in the log4j package. Most logging operations, except configuration, are d
  • Top 15 Vim Plugins
Tabnine Logo
  • Products

    Search for Java codeSearch for JavaScript code
  • IDE Plugins

    IntelliJ IDEAWebStormVisual StudioAndroid StudioEclipseVisual Studio CodePyCharmSublime TextPhpStormVimAtomGoLandRubyMineEmacsJupyter NotebookJupyter LabRiderDataGripAppCode
  • Company

    About UsContact UsCareers
  • Resources

    FAQBlogTabnine AcademyStudentsTerms of usePrivacy policyJava Code IndexJavascript Code Index
Get Tabnine for your IDE now