congrats Icon
New! Tabnine Pro 14-day free trial
Start a free trial
Tabnine Logo
FSClusterStats
Code IndexAdd Tabnine to your IDE (free)

How to use
FSClusterStats
in
org.apache.hadoop.hdfs.server.blockmanagement

Best Java code snippets using org.apache.hadoop.hdfs.server.blockmanagement.FSClusterStats (Showing top 12 results out of 315)

origin: org.apache.hadoop/hadoop-hdfs

/**
 * Determine if a datanode should be chosen based on current workload.
 *
 * @param node The target datanode
 * @return Return true if the datanode should be excluded, otherwise false
 */
boolean excludeNodeByLoad(DatanodeDescriptor node){
 final double maxLoad = considerLoadFactor *
   stats.getInServiceXceiverAverage();
 final int nodeLoad = node.getXceiverCount();
 if ((nodeLoad > maxLoad) && (maxLoad > 0)) {
  logNodeIsNotChosen(node, NodeNotChosenReason.NODE_TOO_BUSY,
    "(load: " + nodeLoad + " > " + maxLoad + ")");
  return true;
 }
 return false;
}
origin: org.apache.hadoop/hadoop-hdfs

Node localNode = null;
boolean avoidStaleNodes = (stats != null
  && stats.isAvoidingStaleDataNodesForWrite());
boolean avoidLocalNode = (addBlockFlags != null
  && addBlockFlags.contains(AddBlockFlag.NO_LOCAL_WRITE)
origin: ch.cern.hadoop/hadoop-hdfs

private static int getNumDNInService(FSNamesystem fsn) {
 return fsn.getBlockManager().getDatanodeManager().getFSClusterStats()
  .getNumDatanodesInService();
}
origin: ch.cern.hadoop/hadoop-hdfs

private static double getInServiceXceiverAverage(FSNamesystem fsn) {
 return fsn.getBlockManager().getDatanodeManager().getFSClusterStats()
  .getInServiceXceiverAverage();
}
origin: org.apache.hadoop/hadoop-hdfs

&& stats.isAvoidingStaleDataNodesForWrite();
origin: ch.cern.hadoop/hadoop-hdfs

.getInServiceXceiverAverage(), EPSILON);
.getInServiceXceiverAverage(), EPSILON);
origin: io.prestosql.hadoop/hadoop-apache

  && stats.isAvoidingStaleDataNodesForWrite());
final Node localNode = chooseTarget(numOfReplicas, writer, excludedNodes,
  blocksize, maxNodesPerRack, results, avoidStaleNodes, storagePolicy,
origin: ch.cern.hadoop/hadoop-hdfs

final double maxLoad = 2.0 * stats.getInServiceXceiverAverage();
final int nodeLoad = node.getXceiverCount();
if (nodeLoad > maxLoad) {
origin: ch.cern.hadoop/hadoop-hdfs

  && stats.isAvoidingStaleDataNodesForWrite());
final Node localNode = chooseTarget(numOfReplicas, writer, excludedNodes,
  blocksize, maxNodesPerRack, results, avoidStaleNodes, storagePolicy,
origin: io.prestosql.hadoop/hadoop-apache

final double maxLoad = 2.0 * stats.getInServiceXceiverAverage();
final int nodeLoad = node.getXceiverCount();
if (nodeLoad > maxLoad) {
origin: ch.cern.hadoop/hadoop-hdfs

&& stats.isAvoidingStaleDataNodesForWrite();
origin: io.prestosql.hadoop/hadoop-apache

&& stats.isAvoidingStaleDataNodesForWrite();
org.apache.hadoop.hdfs.server.blockmanagementFSClusterStats

Javadoc

This interface is used for retrieving the load related statistics of the cluster.

Most used methods

  • getInServiceXceiverAverage
    an indication of the average load of non-decommission(ing|ed) nodes eligible for block placement
  • isAvoidingStaleDataNodesForWrite
    Indicate whether or not the cluster is now avoiding to use stale DataNodes for writing.
  • getNumDatanodesInService
    Indicates number of datanodes that are in service.

Popular in Java

  • Parsing JSON documents to java classes using gson
  • setContentView (Activity)
  • setScale (BigDecimal)
  • scheduleAtFixedRate (Timer)
  • FileWriter (java.io)
    A specialized Writer that writes to a file in the file system. All write requests made by calling me
  • Charset (java.nio.charset)
    A charset is a named mapping between Unicode characters and byte sequences. Every Charset can decode
  • Map (java.util)
    A Map is a data structure consisting of a set of keys and values in which each key is mapped to a si
  • PriorityQueue (java.util)
    A PriorityQueue holds elements on a priority heap, which orders the elements according to their natu
  • ThreadPoolExecutor (java.util.concurrent)
    An ExecutorService that executes each submitted task using one of possibly several pooled threads, n
  • Runner (org.openjdk.jmh.runner)
  • 21 Best IntelliJ Plugins
Tabnine Logo
  • Products

    Search for Java codeSearch for JavaScript code
  • IDE Plugins

    IntelliJ IDEAWebStormVisual StudioAndroid StudioEclipseVisual Studio CodePyCharmSublime TextPhpStormVimAtomGoLandRubyMineEmacsJupyter NotebookJupyter LabRiderDataGripAppCode
  • Company

    About UsContact UsCareers
  • Resources

    FAQBlogTabnine AcademyStudentsTerms of usePrivacy policyJava Code IndexJavascript Code Index
Get Tabnine for your IDE now