org.elasticsearch.hadoop.util.ObjectUtils.isClassPresent java code examples

Add the Codota plugin to your IDE and get smart completions

private void myMethod () {
 BufferedReader b =InputStream in;new BufferedReader(new InputStreamReader(in))
Reader in;new BufferedReader(in)
File file;new BufferedReader(new FileReader(file))
Smart code suggestions by Tabnine
}

static void checkSparkLibraryCompatibility(boolean throwOnIncompatible) {
  // check whether the correct es-hadoop is used with the correct Spark version
  boolean isSpark13Level = ObjectUtils.isClassPresent("org.apache.spark.sql.DataFrame", SparkConf.class.getClassLoader());
  boolean isSpark20Level = ObjectUtils.isClassPresent("org.apache.spark.sql.streaming.StreamingQuery", SparkConf.class.getClassLoader());
  CompatibilityLevel compatibilityLevel = ObjectUtils.instantiate("org.elasticsearch.spark.sql.SparkSQLCompatibilityLevel", CompatUtils.class.getClassLoader());
  boolean isEshForSpark20 = "20".equals(compatibilityLevel.versionId());
  String esSupportedSparkVersion = compatibilityLevel.versionDescription();
  String errorMessage = null;
  if (!(isSpark13Level || isSpark20Level)) {
    String sparkVersion = getSparkVersionOr("1.0-1.2");
    errorMessage = String.format("Incorrect classpath detected; Elasticsearch Spark compiled for Spark %s but used with unsupported Spark version %s",
        esSupportedSparkVersion, sparkVersion);
  } else if (isSpark20Level != isEshForSpark20) { // XOR can be applied as well but != increases readability
    String sparkVersion = getSparkVersionOr(isSpark13Level ? "1.3-1.6" : "2.0+");
    errorMessage = String.format("Incorrect classpath detected; Elasticsearch Spark compiled for Spark %s but used with Spark %s",
        esSupportedSparkVersion, sparkVersion);
  }
  if (errorMessage != null) {
    if (throwOnIncompatible) {
      throw new EsHadoopIllegalStateException(errorMessage);
    } else {
      LogFactory.getLog("org.elasticsearch.spark.rdd.EsSpark").warn(errorMessage);
    }
  }
}

static void checkSparkLibraryCompatibility(boolean throwOnIncompatible) {
  // check whether the correct es-hadoop is used with the correct Spark version
  boolean isSpark13Level = ObjectUtils.isClassPresent("org.apache.spark.sql.DataFrame", SparkConf.class.getClassLoader());
  boolean isSpark20Level = ObjectUtils.isClassPresent("org.apache.spark.sql.streaming.StreamingQuery", SparkConf.class.getClassLoader());
  CompatibilityLevel compatibilityLevel = ObjectUtils.instantiate("org.elasticsearch.spark.sql.SparkSQLCompatibilityLevel", CompatUtils.class.getClassLoader());
  boolean isEshForSpark20 = "20".equals(compatibilityLevel.versionId());
  String esSupportedSparkVersion = compatibilityLevel.versionDescription();
  String errorMessage = null;
  if (!(isSpark13Level || isSpark20Level)) {
    String sparkVersion = getSparkVersionOr("1.0-1.2");
    errorMessage = String.format("Incorrect classpath detected; Elasticsearch Spark compiled for Spark %s but used with unsupported Spark version %s",
        esSupportedSparkVersion, sparkVersion);
  } else if (isSpark20Level != isEshForSpark20) { // XOR can be applied as well but != increases readability
    String sparkVersion = getSparkVersionOr(isSpark13Level ? "1.3-1.6" : "2.0+");
    errorMessage = String.format("Incorrect classpath detected; Elasticsearch Spark compiled for Spark %s but used with Spark %s",
        esSupportedSparkVersion, sparkVersion);
  }
  if (errorMessage != null) {
    if (throwOnIncompatible) {
      throw new EsHadoopIllegalStateException(errorMessage);
    } else {
      LogFactory.getLog("org.elasticsearch.spark.rdd.EsSpark").warn(errorMessage);
    }
  }
}

static void checkSparkLibraryCompatibility(boolean throwOnIncompatible) {
  // check whether the correct es-hadoop is used with the correct Spark version
  boolean isSpark13Level = ObjectUtils.isClassPresent("org.apache.spark.sql.DataFrame", SparkConf.class.getClassLoader());
  boolean isSpark20Level = ObjectUtils.isClassPresent("org.apache.spark.sql.streaming.StreamingQuery", SparkConf.class.getClassLoader());
  CompatibilityLevel compatibilityLevel = ObjectUtils.instantiate("org.elasticsearch.spark.sql.SparkSQLCompatibilityLevel", CompatUtils.class.getClassLoader());
  boolean isEshForSpark20 = "20".equals(compatibilityLevel.versionId());
  String esSupportedSparkVersion = compatibilityLevel.versionDescription();
  String errorMessage = null;
  if (!(isSpark13Level || isSpark20Level)) {
    String sparkVersion = getSparkVersionOr("1.0-1.2");
    errorMessage = String.format("Incorrect classpath detected; Elasticsearch Spark compiled for Spark %s but used with unsupported Spark version %s",
        esSupportedSparkVersion, sparkVersion);
  } else if (isSpark20Level != isEshForSpark20) { // XOR can be applied as well but != increases readability
    String sparkVersion = getSparkVersionOr(isSpark13Level ? "1.3-1.6" : "2.0+");
    errorMessage = String.format("Incorrect classpath detected; Elasticsearch Spark compiled for Spark %s but used with Spark %s",
        esSupportedSparkVersion, sparkVersion);
  }
  if (errorMessage != null) {
    if (throwOnIncompatible) {
      throw new EsHadoopIllegalStateException(errorMessage);
    } else {
      LogFactory.getLog("org.elasticsearch.spark.rdd.EsSpark").warn(errorMessage);
    }
  }
}

static void checkSparkLibraryCompatibility(boolean throwOnIncompatible) {
  // check whether the correct es-hadoop is used with the correct Spark version
  boolean isSpark13Level = ObjectUtils.isClassPresent("org.apache.spark.sql.DataFrame", SparkConf.class.getClassLoader());
  boolean isSpark20Level = ObjectUtils.isClassPresent("org.apache.spark.sql.streaming.StreamingQuery", SparkConf.class.getClassLoader());
  CompatibilityLevel compatibilityLevel = ObjectUtils.instantiate("org.elasticsearch.spark.sql.SparkSQLCompatibilityLevel", CompatUtils.class.getClassLoader());
  boolean isEshForSpark20 = "20".equals(compatibilityLevel.versionId());
  String esSupportedSparkVersion = compatibilityLevel.versionDescription();
  String errorMessage = null;
  if (!(isSpark13Level || isSpark20Level)) {
    String sparkVersion = getSparkVersionOr("1.0-1.2");
    errorMessage = String.format("Incorrect classpath detected; Elasticsearch Spark compiled for Spark %s but used with unsupported Spark version %s",
        esSupportedSparkVersion, sparkVersion);
  } else if (isSpark20Level != isEshForSpark20) { // XOR can be applied as well but != increases readability
    String sparkVersion = getSparkVersionOr(isSpark13Level ? "1.3-1.6" : "2.0+");
    errorMessage = String.format("Incorrect classpath detected; Elasticsearch Spark compiled for Spark %s but used with Spark %s",
        esSupportedSparkVersion, sparkVersion);
  }
  if (errorMessage != null) {
    if (throwOnIncompatible) {
      throw new EsHadoopIllegalStateException(errorMessage);
    } else {
      LogFactory.getLog("org.elasticsearch.spark.rdd.EsSpark").warn(errorMessage);
    }
  }
}

Popular methods of ObjectUtils

Popular in Java

Reactive rest calls using spring rest template
findViewById (Activity)
compareTo (BigDecimal)
getSharedPreferences (Context)
Graphics2D (java.awt)
This Graphics2D class extends the Graphics class to provide more sophisticated control overgraphics
Rectangle (java.awt)
A Rectangle specifies an area in a coordinate space that is enclosed by the Rectangle object's top-
HttpURLConnection (java.net)
An URLConnection for HTTP (RFC 2616 [http://tools.ietf.org/html/rfc2616]) used to send and receive d
NumberFormat (java.text)
The abstract base class for all number formats. This class provides the interface for formatting and
Scanner (java.util)
A parser that parses a text string of primitive types and strings with the help of regular expressio
Pattern (java.util.regex)
Patterns are compiled regular expressions. In many cases, convenience methods such as String#matches

How to use isClassPresentmethodin org.elasticsearch.hadoop.util.ObjectUtils

Best Java code snippets using org.elasticsearch.hadoop.util.ObjectUtils.isClassPresent (Showing top 4 results out of 315)

How to use
isClassPresent
method
in
org.elasticsearch.hadoop.util.ObjectUtils