Public

getConf

checkAndGenObject

generateMapMetaData

getChildOperators

getExecContext

getOperatorId

getOperatorName

getParentOperators

loadHashTable

process

replaceParent

setChildOperators

setColumnExprMap

setParentOperators

Clean up data participating the join, i.e. in-mem and on-disk files for small
table(s) and big table

cleanupGraceHashJoin

clearAllTableContainers

closeOp

Continue processing join between spilled hashtable(s) and spilled big table

continueProcess

defaultEndGroup

defaultStartGroup

MapJoinOperator

Making http post requests using okhttp

An output stream that writes bytes to a file. If the output file exists, it can
be replaced or appen

java.io.FileOutputStream

This exception is thrown when a program attempts to create an URL from an
incorrect specification.

java.net.MalformedURLException

A Uniform Resource Identifier that identifies an abstract or physical resource,
as specified by RFC 

java.net.URI

The abstract base class for all number formats. This class provides the
interface for formatting and

java.text.NumberFormat

Factory that creates instances of DateTimeFormatter from patterns and styles. 
Datetime formatting i

org.joda.time.format.DateTimeFormat

This is the main interface of a Quartz Scheduler. A Scheduler maintains a registry of org.quartz.Job

org.quartz.Scheduler

Return the contained value, if present, otherwise throw an exception to be
created by the provided s

orElseThrow

compareTo

findViewById

// Gather information about the DPP table scans and store it in the cache

// We enforce a certain order when we do the reutilization.

// In particular, we use size of table x number of reads to

// Execute extended shared work optimization

// We rank by size of table x number of reads

// Execute shared work optimization with semijoin removal

// If it was further optimized, execute a second round of extended shared work optimizer

// Try to reuse cache for broadcast side in mapjoin operators that

// First we group together all the mapjoin operators that share same

// For each group, set the cache key accordingly if there is more than one operator

// Either it is the first map join operator or there was no equivalent RS,

// Set in the conf of the map join operator

// If we are running tests, we are going to verify that the contents of the cache

// correspond with the contents of the plan, and otherwise we fail.

// This check always run when we are running in test mode, independently on whether

// we use the basic or the extended version of the optimizer.

"Error in shared work optimizer: operator cache contents "

// On Tez only: The hash map might already be cached in the container we run

// the task in. On MR: The cache is a no-op.

// The cacheKey may have already been defined in the MapJoin conf spec

// as part of the Shared Work Optimization if it can be reused among

// multiple mapjoin operators. In that case, we take that key from conf

// and append this.getClass().getName() to disambiguate between different

// classes that may be using the same source data, e.g.

// VectorMapJoinInnerGenerateResultOperator and VectorMapJoinLeftSemiLongOperator.

// If the cacheKey is not defined in the conf, then we generate it.

// Reset grace hashjoin context so that there is no state maintained when operator/work is

/*
       * The issue with caching in case of bucket map join is that different tasks
       * process different buckets and if the container is reused to join a different bucket,
       * join results can be incorrect. The cache is keyed on operator id and for bucket map join
       * the operator does not change but data needed is different. For a proper fix, this
       * requires changes in the Tez API with regard to finding bucket id and
       * also ability to schedule tasks to re-use containers that have cached the specific bucket.
       */

How to use getOperatorIdmethodin org.apache.hadoop.hive.ql.exec.MapJoinOperator

Best Java code snippets using org.apache.hadoop.hive.ql.exec.MapJoinOperator.getOperatorId (Showing top 5 results out of 315)

How to use
getOperatorId
method
in
org.apache.hadoop.hive.ql.exec.MapJoinOperator