Tabnine Logo
BlockReceiver.shouldVerifyChecksum
Code IndexAdd Tabnine to your IDE (free)

How to use
shouldVerifyChecksum
method
in
org.apache.hadoop.hdfs.server.datanode.BlockReceiver

Best Java code snippets using org.apache.hadoop.hdfs.server.datanode.BlockReceiver.shouldVerifyChecksum (Showing top 3 results out of 315)

origin: org.apache.hadoop/hadoop-hdfs

if (responder != null && !syncBlock && !shouldVerifyChecksum()) {
 ((PacketResponder) responder.getRunnable()).enqueue(seqno,
   lastPacketInBlock, offsetInBlock, Status.SUCCESS);
 if (checksumReceivedLen > 0 && shouldVerifyChecksum()) {
  try {
   verifyChunks(dataBuf, checksumBuf);
if (responder != null && (syncBlock || shouldVerifyChecksum())) {
 ((PacketResponder) responder.getRunnable()).enqueue(seqno,
   lastPacketInBlock, offsetInBlock, Status.SUCCESS);
origin: ch.cern.hadoop/hadoop-hdfs

if (responder != null && !syncBlock && !shouldVerifyChecksum()) {
 ((PacketResponder) responder.getRunnable()).enqueue(seqno,
   lastPacketInBlock, offsetInBlock, Status.SUCCESS);
 if (checksumReceivedLen > 0 && shouldVerifyChecksum()) {
  try {
   verifyChunks(dataBuf, checksumBuf);
if (responder != null && (syncBlock || shouldVerifyChecksum())) {
 ((PacketResponder) responder.getRunnable()).enqueue(seqno,
   lastPacketInBlock, offsetInBlock, Status.SUCCESS);
origin: io.prestosql.hadoop/hadoop-apache

if (responder != null && !syncBlock && !shouldVerifyChecksum()) {
 ((PacketResponder) responder.getRunnable()).enqueue(seqno,
   lastPacketInBlock, offsetInBlock, Status.SUCCESS);
 if (checksumReceivedLen > 0 && shouldVerifyChecksum()) {
  try {
   verifyChunks(dataBuf, checksumBuf);
if (responder != null && (syncBlock || shouldVerifyChecksum())) {
 ((PacketResponder) responder.getRunnable()).enqueue(seqno,
   lastPacketInBlock, offsetInBlock, Status.SUCCESS);
org.apache.hadoop.hdfs.server.datanodeBlockReceivershouldVerifyChecksum

Javadoc

Check whether checksum needs to be verified. Skip verifying checksum iff this is not the last one in the pipeline and clientName is non-null. i.e. Checksum is verified on all the datanodes when the data is being written by a datanode rather than a client. Whe client is writing the data, protocol includes acks and only the last datanode needs to verify checksum.

Popular methods of BlockReceiver

  • <init>
  • cleanupBlock
    Cleanup a partial block if this write is for a replication request (and not from a client)
  • close
    close files and release volume reference.
  • computePartialChunkCrc
    reads in the partial crc chunk and computes checksum of pre-existing data in partial chunk.
  • handleMirrorOutError
    While writing to mirrorOut, failure to write to mirror should not affect this datanode unless it is
  • receiveBlock
  • receivePacket
    Receives and processes a packet. It can contain many chunks. returns the number of data bytes that t
  • verifyChunks
    Verify multiple CRC chunks.
  • adjustCrcFilePosition
    Adjust the file pointer in the local meta file so that the last checksum will be overwritten.
  • checksum2long
    Convert a checksum byte array to a long
  • claimReplicaHandler
    The caller claims the ownership of the replica handler.
  • copyLastChunkChecksum
  • claimReplicaHandler,
  • copyLastChunkChecksum,
  • flushOrSync,
  • getReplica,
  • manageWriterOsCache,
  • packetSentInTime,
  • sendOOB,
  • setLastSentTime,
  • translateChunks

Popular in Java

  • Running tasks concurrently on multiple threads
  • putExtra (Intent)
  • startActivity (Activity)
  • getOriginalFilename (MultipartFile)
    Return the original filename in the client's filesystem.This may contain path information depending
  • HttpURLConnection (java.net)
    An URLConnection for HTTP (RFC 2616 [http://tools.ietf.org/html/rfc2616]) used to send and receive d
  • Collection (java.util)
    Collection is the root of the collection hierarchy. It defines operations on data collections and t
  • Collections (java.util)
    This class consists exclusively of static methods that operate on or return collections. It contains
  • Enumeration (java.util)
    A legacy iteration interface.New code should use Iterator instead. Iterator replaces the enumeration
  • Modifier (javassist)
    The Modifier class provides static methods and constants to decode class and member access modifiers
  • Reflections (org.reflections)
    Reflections one-stop-shop objectReflections scans your classpath, indexes the metadata, allows you t
  • Top plugins for WebStorm
Tabnine Logo
  • Products

    Search for Java codeSearch for JavaScript code
  • IDE Plugins

    IntelliJ IDEAWebStormVisual StudioAndroid StudioEclipseVisual Studio CodePyCharmSublime TextPhpStormVimGoLandRubyMineEmacsJupyter NotebookJupyter LabRiderDataGripAppCode
  • Company

    About UsContact UsCareers
  • Resources

    FAQBlogTabnine AcademyTerms of usePrivacy policyJava Code IndexJavascript Code Index
Get Tabnine for your IDE now