congrats Icon
New! Announcing Tabnine Chat Beta
Learn More
Tabnine Logo
ExecutionConfig.getRegisteredKryoTypes
Code IndexAdd Tabnine to your IDE (free)

How to use
getRegisteredKryoTypes
method
in
org.apache.flink.api.common.ExecutionConfig

Best Java code snippets using org.apache.flink.api.common.ExecutionConfig.getRegisteredKryoTypes (Showing top 11 results out of 315)

origin: apache/flink

int registeredTypes = config.getRegisteredKryoTypes().size() +
    config.getRegisteredPojoTypes().size() +
    config.getRegisteredTypesWithKryoSerializerClasses().size() +
  LOG.debug("Registered Kryo types: {}", config.getRegisteredKryoTypes().toString());
  LOG.debug("Registered Kryo with Serializers types: {}", config.getRegisteredTypesWithKryoSerializers().entrySet().toString());
  LOG.debug("Registered Kryo with Serializer Classes types: {}", config.getRegisteredTypesWithKryoSerializerClasses().entrySet().toString());
origin: apache/flink

public KryoSerializer(Class<T> type, ExecutionConfig executionConfig){
  this.type = checkNotNull(type);
  this.defaultSerializers = executionConfig.getDefaultKryoSerializers();
  this.defaultSerializerClasses = executionConfig.getDefaultKryoSerializerClasses();
  this.kryoRegistrations = buildKryoRegistrations(
      this.type,
      executionConfig.getRegisteredKryoTypes(),
      executionConfig.getRegisteredTypesWithKryoSerializerClasses(),
      executionConfig.getRegisteredTypesWithKryoSerializers());
}
origin: apache/flink

@Test
public void testDoubleTypeRegistration() {
  ExecutionConfig config = new ExecutionConfig();
  List<Class<?>> types = Arrays.<Class<?>>asList(Double.class, Integer.class, Double.class);
  List<Class<?>> expectedTypes = Arrays.<Class<?>>asList(Double.class, Integer.class);
  for (Class<?> tpe: types) {
    config.registerKryoType(tpe);
  }
  int counter = 0;
  for (Class<?> tpe: config.getRegisteredKryoTypes()){
    assertEquals(tpe, expectedTypes.get(counter++));
  }
  assertEquals(expectedTypes.size(), counter);
}
origin: apache/flink

@Test
public void testGroupByGenericType() throws Exception {
  /*
   * Group by generic type
   */
  final ExecutionEnvironment env = ExecutionEnvironment.getExecutionEnvironment();
  env.setParallelism(1);
  DataSet<CollectionDataSets.PojoWithCollection> ds = CollectionDataSets.getPojoWithCollection(env);
  // f0.f0 is first integer
  DataSet<String> reduceDs = ds.groupBy("bigInt")
      .reduceGroup(new GroupReducer8());
  List<String> result = reduceDs.collect();
  ExecutionConfig ec = env.getConfig();
  // check if automatic type registration with Kryo worked
  Assert.assertTrue(ec.getRegisteredKryoTypes().contains(BigInt.class));
  Assert.assertFalse(ec.getRegisteredKryoTypes().contains(java.sql.Date.class));
  String expected = null;
  String localExpected = "[call\n" +
      "For key 92233720368547758070 we got:\n" +
      "PojoWithCollection{pojos.size()=2, key=0, sqlDate=2033-05-18, bigInt=92233720368547758070, bigDecimalKeepItNull=null, scalaBigInt=10, mixed=[{someKey=1}, /this/is/wrong, uhlala]}\n" +
      "For key 92233720368547758070 we got:\n" +
      "PojoWithCollection{pojos.size()=2, key=0, sqlDate=1976-05-03, bigInt=92233720368547758070, bigDecimalKeepItNull=null, scalaBigInt=31104000, mixed=null}]";
  Assert.assertEquals(localExpected, result.toString());
}
origin: apache/flink

Assert.assertTrue(ec.getRegisteredKryoTypes().contains(Fixed16.class));
origin: seznam/euphoria

public FlinkSerializerFactory(ExecutionConfig conf) {
 serializers = instantiateSerializers(
   conf.getRegisteredTypesWithKryoSerializerClasses());
 serializers.putAll(instantiateSerializers(
   conf.getDefaultKryoSerializerClasses()));
 serializers.putAll(conf.getDefaultKryoSerializers());
 serializers.putAll(conf.getRegisteredTypesWithKryoSerializers());
 registeredClasses = new HashSet<>(conf.getRegisteredKryoTypes());
 registeredClasses.addAll(conf.getRegisteredPojoTypes());
}
origin: DTStack/flinkx

int registeredTypes = config.getRegisteredKryoTypes().size() +
    config.getRegisteredPojoTypes().size() +
    config.getRegisteredTypesWithKryoSerializerClasses().size() +
  LOG.debug("Registered Kryo types: {}", config.getRegisteredKryoTypes().toString());
  LOG.debug("Registered Kryo with Serializers types: {}", config.getRegisteredTypesWithKryoSerializers().entrySet().toString());
  LOG.debug("Registered Kryo with Serializer Classes types: {}", config.getRegisteredTypesWithKryoSerializerClasses().entrySet().toString());
origin: com.alibaba.blink/flink-java

int registeredTypes = config.getRegisteredKryoTypes().size() +
    config.getRegisteredPojoTypes().size() +
    config.getRegisteredTypesWithKryoSerializerClasses().size() +
  LOG.debug("Registered Kryo types: {}", config.getRegisteredKryoTypes().toString());
  LOG.debug("Registered Kryo with Serializers types: {}", config.getRegisteredTypesWithKryoSerializers().entrySet().toString());
  LOG.debug("Registered Kryo with Serializer Classes types: {}", config.getRegisteredTypesWithKryoSerializerClasses().entrySet().toString());
origin: org.apache.flink/flink-java

int registeredTypes = config.getRegisteredKryoTypes().size() +
    config.getRegisteredPojoTypes().size() +
    config.getRegisteredTypesWithKryoSerializerClasses().size() +
  LOG.debug("Registered Kryo types: {}", config.getRegisteredKryoTypes().toString());
  LOG.debug("Registered Kryo with Serializers types: {}", config.getRegisteredTypesWithKryoSerializers().entrySet().toString());
  LOG.debug("Registered Kryo with Serializer Classes types: {}", config.getRegisteredTypesWithKryoSerializerClasses().entrySet().toString());
origin: com.alibaba.blink/flink-core

public KryoSerializer(Class<T> type, ExecutionConfig executionConfig){
  this.type = checkNotNull(type);
  this.defaultSerializers = executionConfig.getDefaultKryoSerializers();
  this.defaultSerializerClasses = executionConfig.getDefaultKryoSerializerClasses();
  this.kryoRegistrations = buildKryoRegistrations(
      this.type,
      executionConfig.getRegisteredKryoTypes(),
      executionConfig.getRegisteredTypesWithKryoSerializerClasses(),
      executionConfig.getRegisteredTypesWithKryoSerializers());
}
origin: org.apache.flink/flink-core

public KryoSerializer(Class<T> type, ExecutionConfig executionConfig){
  this.type = checkNotNull(type);
  this.defaultSerializers = executionConfig.getDefaultKryoSerializers();
  this.defaultSerializerClasses = executionConfig.getDefaultKryoSerializerClasses();
  this.kryoRegistrations = buildKryoRegistrations(
      this.type,
      executionConfig.getRegisteredKryoTypes(),
      executionConfig.getRegisteredTypesWithKryoSerializerClasses(),
      executionConfig.getRegisteredTypesWithKryoSerializers());
}
org.apache.flink.api.commonExecutionConfiggetRegisteredKryoTypes

Javadoc

Returns the registered Kryo types.

Popular methods of ExecutionConfig

  • <init>
  • isObjectReuseEnabled
    Returns whether object reuse has been enabled or disabled. @see #enableObjectReuse()
  • disableSysoutLogging
    Disables the printing of progress update messages to System.out
  • getAutoWatermarkInterval
    Returns the interval of the automatic watermark emission.
  • setGlobalJobParameters
    Register a custom, serializable user configuration object.
  • enableObjectReuse
    Enables reusing objects that Flink internally uses for deserialization and passing data to user-code
  • setAutoWatermarkInterval
    Sets the interval of the automatic watermark emission. Watermarks are used throughout the streaming
  • disableObjectReuse
    Disables reusing objects that Flink internally uses for deserialization and passing data to user-cod
  • getRestartStrategy
    Returns the restart strategy which has been set for the current job.
  • isSysoutLoggingEnabled
    Gets whether progress update messages should be printed to System.out
  • registerKryoType
    Registers the given type with the serialization stack. If the type is eventually serialized as a POJ
  • registerTypeWithKryoSerializer
    Registers the given Serializer via its class as a serializer for the given type at the KryoSerialize
  • registerKryoType,
  • registerTypeWithKryoSerializer,
  • setRestartStrategy,
  • getParallelism,
  • addDefaultKryoSerializer,
  • getGlobalJobParameters,
  • getNumberOfExecutionRetries,
  • setParallelism,
  • getDefaultKryoSerializerClasses

Popular in Java

  • Making http post requests using okhttp
  • setScale (BigDecimal)
  • putExtra (Intent)
  • orElseThrow (Optional)
    Return the contained value, if present, otherwise throw an exception to be created by the provided s
  • LinkedList (java.util)
    Doubly-linked list implementation of the List and Dequeinterfaces. Implements all optional list oper
  • Set (java.util)
    A Set is a data structure which does not allow duplicate elements.
  • Timer (java.util)
    Timers schedule one-shot or recurring TimerTask for execution. Prefer java.util.concurrent.Scheduled
  • Notification (javax.management)
  • DataSource (javax.sql)
    An interface for the creation of Connection objects which represent a connection to a database. This
  • Project (org.apache.tools.ant)
    Central representation of an Ant project. This class defines an Ant project with all of its targets,
  • Best plugins for Eclipse
Tabnine Logo
  • Products

    Search for Java codeSearch for JavaScript code
  • IDE Plugins

    IntelliJ IDEAWebStormVisual StudioAndroid StudioEclipseVisual Studio CodePyCharmSublime TextPhpStormVimGoLandRubyMineEmacsJupyter NotebookJupyter LabRiderDataGripAppCode
  • Company

    About UsContact UsCareers
  • Resources

    FAQBlogTabnine AcademyTerms of usePrivacy policyJava Code IndexJavascript Code Index
Get Tabnine for your IDE now