Tabnine Logo
BlockPlacementPolicyDefault.logNodeIsNotChosen
Code IndexAdd Tabnine to your IDE (free)

How to use
logNodeIsNotChosen
method
in
org.apache.hadoop.hdfs.server.blockmanagement.BlockPlacementPolicyDefault

Best Java code snippets using org.apache.hadoop.hdfs.server.blockmanagement.BlockPlacementPolicyDefault.logNodeIsNotChosen (Showing top 6 results out of 315)

origin: org.apache.hadoop/hadoop-hdfs

private static void logNodeIsNotChosen(DatanodeDescriptor node,
  NodeNotChosenReason reason) {
 logNodeIsNotChosen(node, reason, null);
}
origin: org.apache.hadoop/hadoop-hdfs

/**
 * Choose a good storage of given storage type from datanode, and add it to
 * the result list.
 *
 * @param dnd datanode descriptor
 * @param blockSize requested block size
 * @param results the result storages
 * @param storageType requested storage type
 * @return the chosen datanode storage
 */
DatanodeStorageInfo chooseStorage4Block(DatanodeDescriptor dnd,
  long blockSize,
  List<DatanodeStorageInfo> results,
  StorageType storageType) {
 DatanodeStorageInfo storage =
   dnd.chooseStorage4Block(storageType, blockSize);
 if (storage != null) {
  results.add(storage);
 } else {
  logNodeIsNotChosen(dnd, NodeNotChosenReason.NOT_ENOUGH_STORAGE_SPACE,
    " for storage type " + storageType);
 }
 return storage;
}
origin: org.apache.hadoop/hadoop-hdfs

/**
 * Determine if a datanode should be chosen based on current workload.
 *
 * @param node The target datanode
 * @return Return true if the datanode should be excluded, otherwise false
 */
boolean excludeNodeByLoad(DatanodeDescriptor node){
 final double maxLoad = considerLoadFactor *
   stats.getInServiceXceiverAverage();
 final int nodeLoad = node.getXceiverCount();
 if ((nodeLoad > maxLoad) && (maxLoad > 0)) {
  logNodeIsNotChosen(node, NodeNotChosenReason.NODE_TOO_BUSY,
    "(load: " + nodeLoad + " > " + maxLoad + ")");
  return true;
 }
 return false;
}
origin: org.apache.hadoop/hadoop-hdfs

logNodeIsNotChosen(node, NodeNotChosenReason.NOT_IN_SERVICE);
return false;
 logNodeIsNotChosen(node, NodeNotChosenReason.NODE_STALE);
 return false;
logNodeIsNotChosen(node, NodeNotChosenReason.TOO_MANY_NODES_ON_RACK);
return false;
origin: ch.cern.hadoop/hadoop-hdfs

              StorageType requiredStorageType) {
if (storage.getStorageType() != requiredStorageType) {
 logNodeIsNotChosen(storage, "storage types do not match,"
   + " where the required storage type is " + requiredStorageType);
 return false;
 logNodeIsNotChosen(storage, "storage is read-only");
 return false;
 logNodeIsNotChosen(storage, "storage has failed");
 return false;
 logNodeIsNotChosen(storage, "the node is (being) decommissioned ");
 return false;
  logNodeIsNotChosen(storage, "the node is stale ");
  return false;
  requiredSize);
if (requiredSize > remaining - scheduledSize) {
 logNodeIsNotChosen(storage, "the node does not have enough "
   + storage.getStorageType() + " space"
   + " (required=" + requiredSize
 final int nodeLoad = node.getXceiverCount();
 if (nodeLoad > maxLoad) {
  logNodeIsNotChosen(storage, "the node is too busy (load: " + nodeLoad
    + " > " + maxLoad + ") ");
  return false;
origin: io.prestosql.hadoop/hadoop-apache

              StorageType requiredStorageType) {
if (storage.getStorageType() != requiredStorageType) {
 logNodeIsNotChosen(storage, "storage types do not match,"
   + " where the required storage type is " + requiredStorageType);
 return false;
 logNodeIsNotChosen(storage, "storage is read-only");
 return false;
 logNodeIsNotChosen(storage, "storage has failed");
 return false;
 logNodeIsNotChosen(storage, "the node is (being) decommissioned ");
 return false;
  logNodeIsNotChosen(storage, "the node is stale ");
  return false;
  requiredSize);
if (requiredSize > remaining - scheduledSize) {
 logNodeIsNotChosen(storage, "the node does not have enough "
   + storage.getStorageType() + " space"
   + " (required=" + requiredSize
 final int nodeLoad = node.getXceiverCount();
 if (nodeLoad > maxLoad) {
  logNodeIsNotChosen(storage, "the node is too busy (load: " + nodeLoad
    + " > " + maxLoad + ") ");
  return false;
org.apache.hadoop.hdfs.server.blockmanagementBlockPlacementPolicyDefaultlogNodeIsNotChosen

Popular methods of BlockPlacementPolicyDefault

  • chooseReplicaToDelete
    Decide whether deleting the specified replica of the block still makes the block conform to the conf
  • chooseTarget
  • useDelHint
    Check if we can use delHint.
  • addToExcludedNodes
    Add localMachine and related nodes to excludedNodes for next replica choosing. In sub class, we can
  • adjustSetsWithChosenReplica
  • chooseDataNode
    Choose a datanode from the given scope with specified storage type.
  • chooseFromNextRack
  • chooseLocalRack
    Choose one node from the rack that localMachine is on. if no such node is available, choose one node
  • chooseLocalStorage
    Choose localMachine as the target. if localMachine is not available, choose a node on the same rack
  • chooseRandom
    Randomly choose numOfReplicas targets from the given scope.
  • chooseRemoteRack
    Choose numOfReplicas nodes from the racks that localMachine is NOT on. if not enough nodes are avail
  • getMaxNodesPerRack
    Calculate the maximum number of replicas to allocate per rack. It also limits the total number of re
  • chooseRemoteRack,
  • getMaxNodesPerRack,
  • getPipeline,
  • getRequiredStorageTypes,
  • initialize,
  • pickupReplicaSet,
  • splitNodesWithRack,
  • addIfIsGoodTarget,
  • isGoodTarget

Popular in Java

  • Start an intent from android
  • findViewById (Activity)
  • setRequestProperty (URLConnection)
  • scheduleAtFixedRate (ScheduledExecutorService)
  • GridLayout (java.awt)
    The GridLayout class is a layout manager that lays out a container's components in a rectangular gri
  • SimpleDateFormat (java.text)
    Formats and parses dates in a locale-sensitive manner. Formatting turns a Date into a String, and pa
  • SortedSet (java.util)
    SortedSet is a Set which iterates over its elements in a sorted order. The order is determined eithe
  • JarFile (java.util.jar)
    JarFile is used to read jar entries and their associated data from jar files.
  • JPanel (javax.swing)
  • FileUtils (org.apache.commons.io)
    General file manipulation utilities. Facilities are provided in the following areas: * writing to a
  • Best IntelliJ plugins
Tabnine Logo
  • Products

    Search for Java codeSearch for JavaScript code
  • IDE Plugins

    IntelliJ IDEAWebStormVisual StudioAndroid StudioEclipseVisual Studio CodePyCharmSublime TextPhpStormVimGoLandRubyMineEmacsJupyter NotebookJupyter LabRiderDataGripAppCode
  • Company

    About UsContact UsCareers
  • Resources

    FAQBlogTabnine AcademyTerms of usePrivacy policyJava Code IndexJavascript Code Index
Get Tabnine for your IDE now