Tabnine Logo
BroadcastVariableMaterialization
Code IndexAdd Tabnine to your IDE (free)

How to use
BroadcastVariableMaterialization
in
org.apache.flink.runtime.broadcast

Best Java code snippets using org.apache.flink.runtime.broadcast.BroadcastVariableMaterialization (Showing top 20 results out of 315)

origin: org.apache.flink/flink-runtime

public void releaseReference(BroadcastVariableKey key, BatchTask<?, ?> referenceHolder) {
  BroadcastVariableMaterialization<?, ?> mat = variables.get(key);
  // release this reference
  if (mat.decrementReference(referenceHolder)) {
    // remove if no one holds a reference and no one concurrently replaced the entry
    variables.remove(key, mat);
  }
}
origin: org.apache.flink/flink-runtime_2.10

public void releaseAllReferencesFromTask(BatchTask<?, ?> referenceHolder) {
  // go through all registered variables 
  for (Map.Entry<BroadcastVariableKey, BroadcastVariableMaterialization<?, ?>> entry : variables.entrySet()) {
    BroadcastVariableMaterialization<?, ?> mat = entry.getValue();
    
    // release the reference
    if (mat.decrementReferenceIfHeld(referenceHolder)) {
      // remove if no one holds a reference and no one concurrently replaced the entry
      variables.remove(entry.getKey(), mat);
    }
  }
}

origin: org.apache.flink/flink-runtime_2.11

public boolean decrementReference(BatchTask<?, ?> referenceHolder) {
  return decrementReferenceInternal(referenceHolder, true);
}
origin: org.apache.flink/flink-runtime

final BroadcastVariableMaterialization<T, Object> newMat = new BroadcastVariableMaterialization<T, Object>(key);
  materialization.materializeVariable(reader, serializerFactory, holder);
  return materialization;
      newMat.materializeVariable(reader, serializerFactory, holder);
      return newMat;
origin: org.apache.flink/flink-runtime_2.11

@Override
public <T, C> C getBroadcastVariableWithInitializer(String name, BroadcastVariableInitializer<T, C> initializer) {
  Preconditions.checkNotNull(name, "The broadcast variable name must not be null.");
  Preconditions.checkNotNull(initializer, "The broadcast variable initializer must not be null.");
  // check if we have an initialized version
  @SuppressWarnings("unchecked")
  BroadcastVariableMaterialization<T, C> variable = (BroadcastVariableMaterialization<T, C>) this.broadcastVars.get(name);
  if (variable != null) {
    return variable.getVariable(initializer);
  }
  else {
    throw new IllegalArgumentException("The broadcast variable with name '" + name + "' has not been set.");
  }
}

origin: org.apache.flink/flink-runtime_2.10

final BroadcastVariableMaterialization<T, Object> newMat = new BroadcastVariableMaterialization<T, Object>(key);
  materialization.materializeVariable(reader, serializerFactory, holder);
  return materialization;
      newMat.materializeVariable(reader, serializerFactory, holder);
      return newMat;
origin: org.apache.flink/flink-runtime_2.10

@Override
public <T, C> C getBroadcastVariableWithInitializer(String name, BroadcastVariableInitializer<T, C> initializer) {
  Preconditions.checkNotNull(name, "The broadcast variable name must not be null.");
  Preconditions.checkNotNull(initializer, "The broadcast variable initializer must not be null.");
  // check if we have an initialized version
  @SuppressWarnings("unchecked")
  BroadcastVariableMaterialization<T, C> variable = (BroadcastVariableMaterialization<T, C>) this.broadcastVars.get(name);
  if (variable != null) {
    return variable.getVariable(initializer);
  }
  else {
    throw new IllegalArgumentException("The broadcast variable with name '" + name + "' has not been set.");
  }
}

origin: com.alibaba.blink/flink-runtime

final BroadcastVariableMaterialization<T, Object> newMat = new BroadcastVariableMaterialization<T, Object>(key);
  materialization.materializeVariable(reader, serializerFactory, holder);
  return materialization;
      newMat.materializeVariable(reader, serializerFactory, holder);
      return newMat;
origin: org.apache.flink/flink-runtime_2.11

public void releaseAllReferencesFromTask(BatchTask<?, ?> referenceHolder) {
  // go through all registered variables
  for (Map.Entry<BroadcastVariableKey, BroadcastVariableMaterialization<?, ?>> entry : variables.entrySet()) {
    BroadcastVariableMaterialization<?, ?> mat = entry.getValue();
    // release the reference
    if (mat.decrementReferenceIfHeld(referenceHolder)) {
      // remove if no one holds a reference and no one concurrently replaced the entry
      variables.remove(entry.getKey(), mat);
    }
  }
}
origin: org.apache.flink/flink-runtime

@Override
public <T, C> C getBroadcastVariableWithInitializer(String name, BroadcastVariableInitializer<T, C> initializer) {
  Preconditions.checkNotNull(name, "The broadcast variable name must not be null.");
  Preconditions.checkNotNull(initializer, "The broadcast variable initializer must not be null.");
  // check if we have an initialized version
  @SuppressWarnings("unchecked")
  BroadcastVariableMaterialization<T, C> variable = (BroadcastVariableMaterialization<T, C>) this.broadcastVars.get(name);
  if (variable != null) {
    return variable.getVariable(initializer);
  }
  else {
    throw new IllegalArgumentException("The broadcast variable with name '" + name + "' has not been set.");
  }
}

origin: org.apache.flink/flink-runtime_2.10

public boolean decrementReference(BatchTask<?, ?> referenceHolder) {
  return decrementReferenceInternal(referenceHolder, true);
}

origin: org.apache.flink/flink-runtime_2.10

public void releaseReference(BroadcastVariableKey key, BatchTask<?, ?> referenceHolder) {
  BroadcastVariableMaterialization<?, ?> mat = variables.get(key);
  
  // release this reference
  if (mat.decrementReference(referenceHolder)) {
    // remove if no one holds a reference and no one concurrently replaced the entry
    variables.remove(key, mat);
  }
}

origin: org.apache.flink/flink-runtime_2.11

final BroadcastVariableMaterialization<T, Object> newMat = new BroadcastVariableMaterialization<T, Object>(key);
  materialization.materializeVariable(reader, serializerFactory, holder);
  return materialization;
      newMat.materializeVariable(reader, serializerFactory, holder);
      return newMat;
origin: org.apache.flink/flink-runtime

public void releaseAllReferencesFromTask(BatchTask<?, ?> referenceHolder) {
  // go through all registered variables
  for (Map.Entry<BroadcastVariableKey, BroadcastVariableMaterialization<?, ?>> entry : variables.entrySet()) {
    BroadcastVariableMaterialization<?, ?> mat = entry.getValue();
    // release the reference
    if (mat.decrementReferenceIfHeld(referenceHolder)) {
      // remove if no one holds a reference and no one concurrently replaced the entry
      variables.remove(entry.getKey(), mat);
    }
  }
}
origin: org.apache.flink/flink-runtime

@Override
public <T> List<T> getBroadcastVariable(String name) {
  Preconditions.checkNotNull(name, "The broadcast variable name must not be null.");
  
  // check if we have an initialized version
  @SuppressWarnings("unchecked")
  BroadcastVariableMaterialization<T, ?> variable = (BroadcastVariableMaterialization<T, ?>) this.broadcastVars.get(name);
  if (variable != null) {
    try {
      return variable.getVariable();
    }
    catch (InitializationTypeConflictException e) {
      throw new RuntimeException("The broadcast variable '" + name + "' has been initialized by a prior call to a " + e.getType());
    }
  }
  else {
    throw new IllegalArgumentException("The broadcast variable with name '" + name + "' has not been set.");
  }
}

origin: com.alibaba.blink/flink-runtime

public boolean decrementReferenceIfHeld(BatchTask<?, ?> referenceHolder) {
  return decrementReferenceInternal(referenceHolder, false);
}
origin: org.apache.flink/flink-runtime_2.11

public void releaseReference(BroadcastVariableKey key, BatchTask<?, ?> referenceHolder) {
  BroadcastVariableMaterialization<?, ?> mat = variables.get(key);
  // release this reference
  if (mat.decrementReference(referenceHolder)) {
    // remove if no one holds a reference and no one concurrently replaced the entry
    variables.remove(key, mat);
  }
}
origin: com.alibaba.blink/flink-runtime

public void releaseAllReferencesFromTask(BatchTask<?, ?> referenceHolder) {
  // go through all registered variables
  for (Map.Entry<BroadcastVariableKey, BroadcastVariableMaterialization<?, ?>> entry : variables.entrySet()) {
    BroadcastVariableMaterialization<?, ?> mat = entry.getValue();
    // release the reference
    if (mat.decrementReferenceIfHeld(referenceHolder)) {
      // remove if no one holds a reference and no one concurrently replaced the entry
      variables.remove(entry.getKey(), mat);
    }
  }
}
origin: com.alibaba.blink/flink-runtime

@Override
public <T> List<T> getBroadcastVariable(String name) {
  Preconditions.checkNotNull(name, "The broadcast variable name must not be null.");
  
  // check if we have an initialized version
  @SuppressWarnings("unchecked")
  BroadcastVariableMaterialization<T, ?> variable = (BroadcastVariableMaterialization<T, ?>) this.broadcastVars.get(name);
  if (variable != null) {
    try {
      return variable.getVariable();
    }
    catch (InitializationTypeConflictException e) {
      throw new RuntimeException("The broadcast variable '" + name + "' has been initialized by a prior call to a " + e.getType());
    }
  }
  else {
    throw new IllegalArgumentException("The broadcast variable with name '" + name + "' has not been set.");
  }
}

origin: org.apache.flink/flink-runtime_2.11

public boolean decrementReferenceIfHeld(BatchTask<?, ?> referenceHolder) {
  return decrementReferenceInternal(referenceHolder, false);
}
org.apache.flink.runtime.broadcastBroadcastVariableMaterialization

Javadoc

This class represents a single materialization of a broadcast variable and maintains a reference count for it. If the reference count reaches zero the variable is no longer accessible and will eventually be garbage-collected.

Most used methods

  • <init>
  • decrementReference
  • decrementReferenceIfHeld
  • decrementReferenceInternal
  • getVariable
  • materializeVariable

Popular in Java

  • Making http post requests using okhttp
  • onCreateOptionsMenu (Activity)
  • scheduleAtFixedRate (Timer)
  • scheduleAtFixedRate (ScheduledExecutorService)
  • Table (com.google.common.collect)
    A collection that associates an ordered pair of keys, called a row key and a column key, with a sing
  • OutputStream (java.io)
    A writable sink for bytes.Most clients will use output streams that write data to the file system (
  • Socket (java.net)
    Provides a client-side TCP socket.
  • ArrayList (java.util)
    ArrayList is an implementation of List, backed by an array. All optional operations including adding
  • TreeSet (java.util)
    TreeSet is an implementation of SortedSet. All optional operations (adding and removing) are support
  • Loader (org.hibernate.loader)
    Abstract superclass of object loading (and querying) strategies. This class implements useful common
  • Top 12 Jupyter Notebook extensions
Tabnine Logo
  • Products

    Search for Java codeSearch for JavaScript code
  • IDE Plugins

    IntelliJ IDEAWebStormVisual StudioAndroid StudioEclipseVisual Studio CodePyCharmSublime TextPhpStormVimGoLandRubyMineEmacsJupyter NotebookJupyter LabRiderDataGripAppCode
  • Company

    About UsContact UsCareers
  • Resources

    FAQBlogTabnine AcademyTerms of usePrivacy policyJava Code IndexJavascript Code Index
Get Tabnine for your IDE now