org.apache.flink.api.common.ExecutionConfig.getDefaultKryoSerializers java code examples

Common ways to obtain ExecutionConfig

private void myMethod () {
 ExecutionConfig e =new ExecutionConfig()
StreamExecutionEnvironment env;env.getConfig().disableSysoutLogging()
ExecutionEnvironment env;env.getConfig().disableSysoutLogging()
Smart code suggestions by Tabnine
}

    config.getRegisteredTypesWithKryoSerializerClasses().size() +
    config.getRegisteredTypesWithKryoSerializers().size();
int defaultKryoSerializers = config.getDefaultKryoSerializers().size() +
    config.getDefaultKryoSerializerClasses().size();
LOG.info("The job has {} registered types and {} default Kryo serializers", registeredTypes, defaultKryoSerializers);
  LOG.debug("Registered Kryo with Serializers types: {}", config.getRegisteredTypesWithKryoSerializers().entrySet().toString());
  LOG.debug("Registered Kryo with Serializer Classes types: {}", config.getRegisteredTypesWithKryoSerializerClasses().entrySet().toString());
  LOG.debug("Registered Kryo default Serializers: {}", config.getDefaultKryoSerializers().entrySet().toString());
  LOG.debug("Registered Kryo default Serializers Classes {}", config.getDefaultKryoSerializerClasses().entrySet().toString());
  LOG.debug("Registered POJO types: {}", config.getRegisteredPojoTypes().toString());

public KryoSerializer(Class<T> type, ExecutionConfig executionConfig){
  this.type = checkNotNull(type);
  this.defaultSerializers = executionConfig.getDefaultKryoSerializers();
  this.defaultSerializerClasses = executionConfig.getDefaultKryoSerializerClasses();
  this.kryoRegistrations = buildKryoRegistrations(
      this.type,
      executionConfig.getRegisteredKryoTypes(),
      executionConfig.getRegisteredTypesWithKryoSerializerClasses(),
      executionConfig.getRegisteredTypesWithKryoSerializers());
}

public FlinkSerializerFactory(ExecutionConfig conf) {
 serializers = instantiateSerializers(
   conf.getRegisteredTypesWithKryoSerializerClasses());
 serializers.putAll(instantiateSerializers(
   conf.getDefaultKryoSerializerClasses()));
 serializers.putAll(conf.getDefaultKryoSerializers());
 serializers.putAll(conf.getRegisteredTypesWithKryoSerializers());
 registeredClasses = new HashSet<>(conf.getRegisteredKryoTypes());
 registeredClasses.addAll(conf.getRegisteredPojoTypes());
}

private static <T, Y extends Serializer<T> & Serializable> void addSerializer(StreamExecutionEnvironment env, Class<T> klass, Y serializer) {
 env.getConfig().getRegisteredTypesWithKryoSerializers().put(klass, new ExecutionConfig.SerializableSerializer<>(serializer));
 env.getConfig().getDefaultKryoSerializers().put(klass, new ExecutionConfig.SerializableSerializer<>(serializer));
}

    config.getRegisteredTypesWithKryoSerializerClasses().size() +
    config.getRegisteredTypesWithKryoSerializers().size();
int defaultKryoSerializers = config.getDefaultKryoSerializers().size() +
    config.getDefaultKryoSerializerClasses().size();
LOG.info("The job has {} registered types and {} default Kryo serializers", registeredTypes, defaultKryoSerializers);
  LOG.debug("Registered Kryo with Serializers types: {}", config.getRegisteredTypesWithKryoSerializers().entrySet().toString());
  LOG.debug("Registered Kryo with Serializer Classes types: {}", config.getRegisteredTypesWithKryoSerializerClasses().entrySet().toString());
  LOG.debug("Registered Kryo default Serializers: {}", config.getDefaultKryoSerializers().entrySet().toString());
  LOG.debug("Registered Kryo default Serializers Classes {}", config.getDefaultKryoSerializerClasses().entrySet().toString());
  LOG.debug("Registered POJO types: {}", config.getRegisteredPojoTypes().toString());

    config.getRegisteredTypesWithKryoSerializerClasses().size() +
    config.getRegisteredTypesWithKryoSerializers().size();
int defaultKryoSerializers = config.getDefaultKryoSerializers().size() +
    config.getDefaultKryoSerializerClasses().size();
LOG.info("The job has {} registered types and {} default Kryo serializers", registeredTypes, defaultKryoSerializers);
  LOG.debug("Registered Kryo with Serializers types: {}", config.getRegisteredTypesWithKryoSerializers().entrySet().toString());
  LOG.debug("Registered Kryo with Serializer Classes types: {}", config.getRegisteredTypesWithKryoSerializerClasses().entrySet().toString());
  LOG.debug("Registered Kryo default Serializers: {}", config.getDefaultKryoSerializers().entrySet().toString());
  LOG.debug("Registered Kryo default Serializers Classes {}", config.getDefaultKryoSerializerClasses().entrySet().toString());
  LOG.debug("Registered POJO types: {}", config.getRegisteredPojoTypes().toString());

    config.getRegisteredTypesWithKryoSerializerClasses().size() +
    config.getRegisteredTypesWithKryoSerializers().size();
int defaultKryoSerializers = config.getDefaultKryoSerializers().size() +
    config.getDefaultKryoSerializerClasses().size();
LOG.info("The job has {} registered types and {} default Kryo serializers", registeredTypes, defaultKryoSerializers);
  LOG.debug("Registered Kryo with Serializers types: {}", config.getRegisteredTypesWithKryoSerializers().entrySet().toString());
  LOG.debug("Registered Kryo with Serializer Classes types: {}", config.getRegisteredTypesWithKryoSerializerClasses().entrySet().toString());
  LOG.debug("Registered Kryo default Serializers: {}", config.getDefaultKryoSerializers().entrySet().toString());
  LOG.debug("Registered Kryo default Serializers Classes {}", config.getDefaultKryoSerializerClasses().entrySet().toString());
  LOG.debug("Registered POJO types: {}", config.getRegisteredPojoTypes().toString());

public KryoSerializer(Class<T> type, ExecutionConfig executionConfig){
  this.type = checkNotNull(type);
  this.defaultSerializers = executionConfig.getDefaultKryoSerializers();
  this.defaultSerializerClasses = executionConfig.getDefaultKryoSerializerClasses();
  this.kryoRegistrations = buildKryoRegistrations(
      this.type,
      executionConfig.getRegisteredKryoTypes(),
      executionConfig.getRegisteredTypesWithKryoSerializerClasses(),
      executionConfig.getRegisteredTypesWithKryoSerializers());
}

public KryoSerializer(Class<T> type, ExecutionConfig executionConfig){
  this.type = checkNotNull(type);
  this.defaultSerializers = executionConfig.getDefaultKryoSerializers();
  this.defaultSerializerClasses = executionConfig.getDefaultKryoSerializerClasses();
  this.kryoRegistrations = buildKryoRegistrations(
      this.type,
      executionConfig.getRegisteredKryoTypes(),
      executionConfig.getRegisteredTypesWithKryoSerializerClasses(),
      executionConfig.getRegisteredTypesWithKryoSerializers());
}

Javadoc

Returns the registered default Kryo Serializers.

Popular methods of ExecutionConfig

<init>
isObjectReuseEnabled
Returns whether object reuse has been enabled or disabled. @see #enableObjectReuse()
disableSysoutLogging
Disables the printing of progress update messages to System.out
getAutoWatermarkInterval
Returns the interval of the automatic watermark emission.
setGlobalJobParameters
Register a custom, serializable user configuration object.
enableObjectReuse
Enables reusing objects that Flink internally uses for deserialization and passing data to user-code
setAutoWatermarkInterval
Sets the interval of the automatic watermark emission. Watermarks are used throughout the streaming
disableObjectReuse
Disables reusing objects that Flink internally uses for deserialization and passing data to user-cod
getRestartStrategy
Returns the restart strategy which has been set for the current job.
isSysoutLoggingEnabled
Gets whether progress update messages should be printed to System.out
registerKryoType
Registers the given type with the serialization stack. If the type is eventually serialized as a POJ
registerTypeWithKryoSerializer
Registers the given Serializer via its class as a serializer for the given type at the KryoSerialize

Popular in Java

Parsing JSON documents to java classes using gson
scheduleAtFixedRate (ScheduledExecutorService)
getSupportFragmentManager (FragmentActivity)
findViewById (Activity)
NoSuchElementException (java.util)
Thrown when trying to retrieve an element past the end of an Enumeration or Iterator.
TreeSet (java.util)
TreeSet is an implementation of SortedSet. All optional operations (adding and removing) are support
HttpServlet (javax.servlet.http)
Provides an abstract class to be subclassed to create an HTTP servlet suitable for a Web site. A sub
JFileChooser (javax.swing)
Options (org.apache.commons.cli)
Main entry-point into the library. Options represents a collection of Option objects, which describ
Table (org.hibernate.mapping)
A relational table

How to use getDefaultKryoSerializersmethodin org.apache.flink.api.common.ExecutionConfig

Best Java code snippets using org.apache.flink.api.common.ExecutionConfig.getDefaultKryoSerializers (Showing top 9 results out of 315)

How to use
getDefaultKryoSerializers
method
in
org.apache.flink.api.common.ExecutionConfig