Public

<init>

Cleanup a partial block if this write is for a replication request (and not from
a client)

cleanupBlock

close files and release volume reference.

close

reads in the partial crc chunk and computes checksum of pre-existing data in
partial chunk.

computePartialChunkCrc

While writing to mirrorOut, failure to write to mirror should not affect this
datanode unless it is 

handleMirrorOutError

receiveBlock

Receives and processes a packet. It can contain many chunks. returns the number
of data bytes that t

receivePacket

verifyChunks

Adjust the file pointer in the local meta file so that the last checksum will be
overwritten.

adjustCrcFilePosition

checksum2long

The caller claims the ownership of the replica handler.

claimReplicaHandler

copyLastChunkChecksum

Flush block data and metadata files to disk.

flushOrSync

getReplica

manageWriterOsCache

It can return false if - upstream did not send packet for a long time - a packet
was received but go

packetSentInTime

sendOOB

setLastSentTime

Check whether checksum needs to be verified. Skip verifying checksum iff this is
not the last one in

shouldVerifyChecksum

Translate CRC chunks from the client's checksum implementation to the disk
checksum implementation. 

translateChunks

OutputStreamWriter

Updating database using SQL prepared statement

This class represents proxy server settings. A created instance of Proxy stores
a type and an addres

java.net.Proxy

A Uniform Resource Identifier that identifies an abstract or physical resource,
as specified by RFC 

java.net.URI

 Collection is the root of the collection hierarchy. It defines operations on
data collections and t

java.util.Collection

LinkedHashMap is an implementation of Map that guarantees iteration order. All
optional operations a

java.util.LinkedHashMap

javax.management.Notification

org.openjdk.jmh.runner.Runner

putExtra

onCreateOptionsMenu

getApplicationContext

/** 
   * Receives and processes a packet. It can contain many chunks.
   * returns the number of data bytes that the packet has.
   */

"Received an out-of-sequence packet for "

// sync directory for finalize irrespective of syncOnClose config since

// put in queue for pending acks, unless sync was requested

"Slow BlockReceiver write packet to mirror took "

"Receiving an empty packet or the end of the block "

"Invalid checksum length: received length is "

// checksum error detected locally. there is no reason to continue.

// Wait until the responder sends back the response

// overwrite the checksums in the packet buffer with the

// appropriate polynomial for the disk storage.

/** 
   * Receives and processes a packet. It can contain many chunks.
   * returns size of the packet.
   */

"Data remaining in packet does not match "

/* skip verifying checksum iff this is not the last one in the 
       * pipeline and clientName is non-null. i.e. Checksum is verified
       * on all the datanodes when the data is being written by a 
       * datanode rather than a client. Whe client is writing the data, 
       * protocol includes acks and only the last datanode needs to verify 
       * checksum.
       */

// If this is a partial chunk, then verify that this is the only

// chunk in the packet. Calculate new crc for this chunk.

"A packet can have only one partial chunk."

/// flush entire packet before sending ack

"Thread interrupted when flushing bytes to disk. Might cause inconsistent sates"

"InterruptedIOException when flushing bytes to disk. Might cause inconsistent sates"

// checksum is missing, need to calculate it

How to use verifyChunksmethodin org.apache.hadoop.hdfs.server.datanode.BlockReceiver

Best Java code snippets using org.apache.hadoop.hdfs.server.datanode.BlockReceiver.verifyChunks (Showing top 5 results out of 315)

How to use
verifyChunks
method
in
org.apache.hadoop.hdfs.server.datanode.BlockReceiver