Public

<init>

Cleanup a partial block if this write is for a replication request (and not from
a client)

cleanupBlock

close files and release volume reference.

close

reads in the partial crc chunk and computes checksum of pre-existing data in
partial chunk.

computePartialChunkCrc

While writing to mirrorOut, failure to write to mirror should not affect this
datanode unless it is 

handleMirrorOutError

receiveBlock

Receives and processes a packet. It can contain many chunks. returns the number
of data bytes that t

receivePacket

verifyChunks

Adjust the file pointer in the local meta file so that the last checksum will be
overwritten.

adjustCrcFilePosition

checksum2long

The caller claims the ownership of the replica handler.

claimReplicaHandler

copyLastChunkChecksum

Flush block data and metadata files to disk.

flushOrSync

getReplica

manageWriterOsCache

It can return false if - upstream did not send packet for a long time - a packet
was received but go

packetSentInTime

sendOOB

setLastSentTime

Check whether checksum needs to be verified. Skip verifying checksum iff this is
not the last one in

shouldVerifyChecksum

Translate CRC chunks from the client's checksum implementation to the disk
checksum implementation. 

translateChunks

OutputStreamWriter

Making http post requests using okhttp

ObjectMapper provides functionality for reading and writing JSON, either to and
from basic POJOs (Pl

com.fasterxml.jackson.databind.ObjectMapper

Wraps either an existing OutputStream or an existing Writerand provides
convenience methods for prin

java.io.PrintWriter

This exception is thrown when a program attempts to create an URL from an
incorrect specification.

java.net.MalformedURLException

A connection to a URL for reading or writing. For HTTP connections, see
HttpURLConnection for docume

java.net.URLConnection

This class provides random read access to a zip file. You pay more to read the
zip file's central di

java.util.zip.ZipFile

The exception that is thrown when a handshake could not be completed
successfully.

javax.net.ssl.SSLHandshakeException

getExternalFilesDir

scheduleAtFixedRate

getSupportFragmentManager

/** 
   * Receives and processes a packet. It can contain many chunks.
   * returns the number of data bytes that the packet has.
   */

"Received an out-of-sequence packet for "

// sync directory for finalize irrespective of syncOnClose config since

// put in queue for pending acks, unless sync was requested

"Slow BlockReceiver write packet to mirror took "

"Receiving an empty packet or the end of the block "

"Invalid checksum length: received length is "

// checksum error detected locally. there is no reason to continue.

// Wait until the responder sends back the response

// overwrite the checksums in the packet buffer with the

// appropriate polynomial for the disk storage.

/** 
   * Receives and processes a packet. It can contain many chunks.
   * returns size of the packet.
   */

"Data remaining in packet does not match "

/* skip verifying checksum iff this is not the last one in the 
       * pipeline and clientName is non-null. i.e. Checksum is verified
       * on all the datanodes when the data is being written by a 
       * datanode rather than a client. Whe client is writing the data, 
       * protocol includes acks and only the last datanode needs to verify 
       * checksum.
       */

// If this is a partial chunk, then verify that this is the only

// chunk in the packet. Calculate new crc for this chunk.

"A packet can have only one partial chunk."

/// flush entire packet before sending ack

"Thread interrupted when flushing bytes to disk. Might cause inconsistent sates"

"InterruptedIOException when flushing bytes to disk. Might cause inconsistent sates"

// checksum is missing, need to calculate it

How to use verifyChunksmethodin org.apache.hadoop.hdfs.server.datanode.BlockReceiver

Best Java code snippets using org.apache.hadoop.hdfs.server.datanode.BlockReceiver.verifyChunks (Showing top 5 results out of 315)

How to use
verifyChunks
method
in
org.apache.hadoop.hdfs.server.datanode.BlockReceiver