Tabnine Logo
HCatUtil.getInputJobProperties
Code IndexAdd Tabnine to your IDE (free)

How to use
getInputJobProperties
method
in
org.apache.hive.hcatalog.common.HCatUtil

Best Java code snippets using org.apache.hive.hcatalog.common.HCatUtil.getInputJobProperties (Showing top 5 results out of 315)

origin: apache/hive

private static PartInfo extractPartInfo(HCatSchema schema, StorageDescriptor sd,
          Map<String, String> parameters, Configuration conf,
          InputJobInfo inputJobInfo) throws IOException {
 StorerInfo storerInfo = InternalUtil.extractStorerInfo(sd, parameters);
 Properties hcatProperties = new Properties();
 HiveStorageHandler storageHandler = HCatUtil.getStorageHandler(conf, storerInfo);
 // copy the properties from storageHandler to jobProperties
 Map<String, String> jobProperties = HCatUtil.getInputJobProperties(storageHandler, inputJobInfo);
 for (String key : parameters.keySet()) {
  hcatProperties.put(key, parameters.get(key));
 }
 // FIXME
 // Bloating partinfo with inputJobInfo is not good
 return new PartInfo(schema, storageHandler, sd.getLocation(),
  hcatProperties, jobProperties, inputJobInfo.getTableInfo());
}
origin: org.apache.hive.hcatalog/hive-hcatalog-core

private static PartInfo extractPartInfo(HCatSchema schema, StorageDescriptor sd,
          Map<String, String> parameters, Configuration conf,
          InputJobInfo inputJobInfo) throws IOException {
 StorerInfo storerInfo = InternalUtil.extractStorerInfo(sd, parameters);
 Properties hcatProperties = new Properties();
 HiveStorageHandler storageHandler = HCatUtil.getStorageHandler(conf, storerInfo);
 // copy the properties from storageHandler to jobProperties
 Map<String, String> jobProperties = HCatUtil.getInputJobProperties(storageHandler, inputJobInfo);
 for (String key : parameters.keySet()) {
  hcatProperties.put(key, parameters.get(key));
 }
 // FIXME
 // Bloating partinfo with inputJobInfo is not good
 return new PartInfo(schema, storageHandler, sd.getLocation(),
  hcatProperties, jobProperties, inputJobInfo.getTableInfo());
}
origin: com.github.hyukjinkwon.hcatalog/hive-hcatalog-core

private static PartInfo extractPartInfo(HCatSchema schema, StorageDescriptor sd,
          Map<String, String> parameters, Configuration conf,
          InputJobInfo inputJobInfo) throws IOException {
 StorerInfo storerInfo = InternalUtil.extractStorerInfo(sd, parameters);
 Properties hcatProperties = new Properties();
 HiveStorageHandler storageHandler = HCatUtil.getStorageHandler(conf, storerInfo);
 // copy the properties from storageHandler to jobProperties
 Map<String, String> jobProperties = HCatUtil.getInputJobProperties(storageHandler, inputJobInfo);
 for (String key : parameters.keySet()) {
  hcatProperties.put(key, parameters.get(key));
 }
 // FIXME
 // Bloating partinfo with inputJobInfo is not good
 return new PartInfo(schema, storageHandler, sd.getLocation(),
  hcatProperties, jobProperties, inputJobInfo.getTableInfo());
}
origin: com.facebook.presto.hive/hive-apache

private static PartInfo extractPartInfo(HCatSchema schema, StorageDescriptor sd,
          Map<String, String> parameters, Configuration conf,
          InputJobInfo inputJobInfo) throws IOException {
 StorerInfo storerInfo = InternalUtil.extractStorerInfo(sd, parameters);
 Properties hcatProperties = new Properties();
 HiveStorageHandler storageHandler = HCatUtil.getStorageHandler(conf, storerInfo);
 // copy the properties from storageHandler to jobProperties
 Map<String, String> jobProperties = HCatUtil.getInputJobProperties(storageHandler, inputJobInfo);
 for (String key : parameters.keySet()) {
  hcatProperties.put(key, parameters.get(key));
 }
 // FIXME
 // Bloating partinfo with inputJobInfo is not good
 return new PartInfo(schema, storageHandler, sd.getLocation(),
  hcatProperties, jobProperties, inputJobInfo.getTableInfo());
}
origin: org.spark-project.hive.hcatalog/hive-hcatalog-core

private static PartInfo extractPartInfo(HCatSchema schema, StorageDescriptor sd,
          Map<String, String> parameters, Configuration conf,
          InputJobInfo inputJobInfo) throws IOException {
 StorerInfo storerInfo = InternalUtil.extractStorerInfo(sd, parameters);
 Properties hcatProperties = new Properties();
 HiveStorageHandler storageHandler = HCatUtil.getStorageHandler(conf, storerInfo);
 // copy the properties from storageHandler to jobProperties
 Map<String, String> jobProperties = HCatUtil.getInputJobProperties(storageHandler, inputJobInfo);
 for (String key : parameters.keySet()) {
  hcatProperties.put(key, parameters.get(key));
 }
 // FIXME
 // Bloating partinfo with inputJobInfo is not good
 return new PartInfo(schema, storageHandler, sd.getLocation(),
  hcatProperties, jobProperties, inputJobInfo.getTableInfo());
}
org.apache.hive.hcatalog.commonHCatUtilgetInputJobProperties

Popular methods of HCatUtil

  • getHiveMetastoreClient
    Get or create a hive client depending on whether it exits in cache or not
  • getTable
  • closeHiveClientQuietly
  • deserialize
  • getHiveConf
  • extractSchema
  • getStorageHandler
    Create an instance of a storage handler defined in storerInfo. If one cannot be found then FosterSto
  • serialize
  • validateExecuteBitPresentIfReadOrWrite
    Ensure that read or write permissions are not granted without also granting execute permissions. Ess
  • validateMorePermissive
    Test if the first FsAction is more permissive than the second. This is useful in cases where we want
  • configureOutputStorageHandler
  • copyConf
    Replace the contents of dest with the contents of src
  • configureOutputStorageHandler,
  • copyConf,
  • copyJobPropertiesToJobConf,
  • decodeBytes,
  • encodeBytes,
  • extractThriftToken,
  • getFieldSchemaList,
  • getHCatFieldSchemaList,
  • getJobConfFromContext

Popular in Java

  • Creating JSON documents from java classes using gson
  • setContentView (Activity)
  • getResourceAsStream (ClassLoader)
  • getOriginalFilename (MultipartFile)
    Return the original filename in the client's filesystem.This may contain path information depending
  • Pointer (com.sun.jna)
    An abstraction for a native pointer data type. A Pointer instance represents, on the Java side, a na
  • PrintWriter (java.io)
    Wraps either an existing OutputStream or an existing Writerand provides convenience methods for prin
  • Runnable (java.lang)
    Represents a command that can be executed. Often used to run code in a different Thread.
  • URI (java.net)
    A Uniform Resource Identifier that identifies an abstract or physical resource, as specified by RFC
  • SecureRandom (java.security)
    This class generates cryptographically secure pseudo-random numbers. It is best to invoke SecureRand
  • Pattern (java.util.regex)
    Patterns are compiled regular expressions. In many cases, convenience methods such as String#matches
  • Github Copilot alternatives
Tabnine Logo
  • Products

    Search for Java codeSearch for JavaScript code
  • IDE Plugins

    IntelliJ IDEAWebStormVisual StudioAndroid StudioEclipseVisual Studio CodePyCharmSublime TextPhpStormVimGoLandRubyMineEmacsJupyter NotebookJupyter LabRiderDataGripAppCode
  • Company

    About UsContact UsCareers
  • Resources

    FAQBlogTabnine AcademyTerms of usePrivacy policyJava Code IndexJavascript Code Index
Get Tabnine for your IDE now