Tabnine Logo
CheckpointStatsTracker
Code IndexAdd Tabnine to your IDE (free)

How to use
CheckpointStatsTracker
in
org.apache.flink.runtime.checkpoint

Best Java code snippets using org.apache.flink.runtime.checkpoint.CheckpointStatsTracker (Showing top 20 results out of 315)

origin: org.apache.flink/flink-runtime_2.10

@Override
public CheckpointStatsSnapshot getCheckpointStatsSnapshot() {
  if (checkpointStatsTracker != null) {
    return checkpointStatsTracker.createSnapshot();
  } else {
    return null;
  }
}
origin: org.apache.flink/flink-runtime_2.11

@Override
public CheckpointCoordinatorConfiguration getCheckpointCoordinatorConfiguration() {
  if (checkpointStatsTracker != null) {
    return checkpointStatsTracker.getJobCheckpointingConfiguration();
  } else {
    return null;
  }
}
origin: org.apache.flink/flink-runtime_2.10

public JobCheckpointingSettings getJobCheckpointingSettings() {
  if (checkpointStatsTracker != null) {
    return checkpointStatsTracker.getSnapshottingSettings();
  } else {
    return null;
  }
}
origin: com.alibaba.blink/flink-runtime

  latest.getExternalPointer());
statsTracker.reportRestoredCheckpoint(restored);
origin: org.apache.flink/flink-runtime_2.10

/**
 * Creates a new pending checkpoint tracker.
 *
 * @param checkpointId ID of the checkpoint.
 * @param triggerTimestamp Trigger timestamp of the checkpoint.
 * @param props The checkpoint properties.
 * @return Tracker for statistics gathering.
 */
PendingCheckpointStats reportPendingCheckpoint(
    long checkpointId,
    long triggerTimestamp,
    CheckpointProperties props) {
  ConcurrentHashMap<JobVertexID, TaskStateStats> taskStateStats = createEmptyTaskStateStatsMap();
  PendingCheckpointStats pending = new PendingCheckpointStats(
      checkpointId,
      triggerTimestamp,
      props,
      totalSubtaskCount,
      taskStateStats,
      new PendingCheckpointStatsCallback());
  statsReadWriteLock.lock();
  try {
    counts.incrementInProgressCheckpoints();
    history.addInProgressCheckpoint(pending);
    dirty = true;
  } finally {
    statsReadWriteLock.unlock();
  }
  return pending;
}
origin: org.apache.flink/flink-runtime_2.11

registerMetrics(metricGroup);
origin: com.alibaba.blink/flink-runtime

  latest.getExternalPointer());
statsTracker.reportRestoredCheckpoint(restored);
origin: org.apache.flink/flink-runtime_2.11

/**
 * Creates a new pending checkpoint tracker.
 *
 * @param checkpointId ID of the checkpoint.
 * @param triggerTimestamp Trigger timestamp of the checkpoint.
 * @param props The checkpoint properties.
 * @return Tracker for statistics gathering.
 */
PendingCheckpointStats reportPendingCheckpoint(
    long checkpointId,
    long triggerTimestamp,
    CheckpointProperties props) {
  ConcurrentHashMap<JobVertexID, TaskStateStats> taskStateStats = createEmptyTaskStateStatsMap();
  PendingCheckpointStats pending = new PendingCheckpointStats(
      checkpointId,
      triggerTimestamp,
      props,
      totalSubtaskCount,
      taskStateStats,
      new PendingCheckpointStatsCallback());
  statsReadWriteLock.lock();
  try {
    counts.incrementInProgressCheckpoints();
    history.addInProgressCheckpoint(pending);
    dirty = true;
  } finally {
    statsReadWriteLock.unlock();
  }
  return pending;
}
origin: org.apache.flink/flink-runtime_2.10

registerMetrics(metricGroup);
origin: org.apache.flink/flink-runtime

  latest.getExternalPointer());
statsTracker.reportRestoredCheckpoint(restored);
origin: org.apache.flink/flink-runtime_2.11

@Override
public CheckpointStatsSnapshot getCheckpointStatsSnapshot() {
  if (checkpointStatsTracker != null) {
    return checkpointStatsTracker.createSnapshot();
  } else {
    return null;
  }
}
origin: org.apache.flink/flink-runtime

/**
 * Creates a new pending checkpoint tracker.
 *
 * @param checkpointId ID of the checkpoint.
 * @param triggerTimestamp Trigger timestamp of the checkpoint.
 * @param props The checkpoint properties.
 * @return Tracker for statistics gathering.
 */
PendingCheckpointStats reportPendingCheckpoint(
    long checkpointId,
    long triggerTimestamp,
    CheckpointProperties props) {
  ConcurrentHashMap<JobVertexID, TaskStateStats> taskStateStats = createEmptyTaskStateStatsMap();
  PendingCheckpointStats pending = new PendingCheckpointStats(
      checkpointId,
      triggerTimestamp,
      props,
      totalSubtaskCount,
      taskStateStats,
      new PendingCheckpointStatsCallback());
  statsReadWriteLock.lock();
  try {
    counts.incrementInProgressCheckpoints();
    history.addInProgressCheckpoint(pending);
    dirty = true;
  } finally {
    statsReadWriteLock.unlock();
  }
  return pending;
}
origin: com.alibaba.blink/flink-runtime

registerMetrics(metricGroup);
origin: org.apache.flink/flink-runtime

@Override
public CheckpointCoordinatorConfiguration getCheckpointCoordinatorConfiguration() {
  if (checkpointStatsTracker != null) {
    return checkpointStatsTracker.getJobCheckpointingConfiguration();
  } else {
    return null;
  }
}
origin: org.apache.flink/flink-runtime_2.11

  latest.getExternalPointer());
statsTracker.reportRestoredCheckpoint(restored);
origin: com.alibaba.blink/flink-runtime

@Override
public CheckpointStatsSnapshot getCheckpointStatsSnapshot() {
  if (checkpointStatsTracker != null) {
    return checkpointStatsTracker.createSnapshot();
  } else {
    return null;
  }
}
origin: com.alibaba.blink/flink-runtime

/**
 * Creates a new pending checkpoint tracker.
 *
 * @param checkpointId ID of the checkpoint.
 * @param triggerTimestamp Trigger timestamp of the checkpoint.
 * @param props The checkpoint properties.
 * @return Tracker for statistics gathering.
 */
PendingCheckpointStats reportPendingCheckpoint(
    long checkpointId,
    long triggerTimestamp,
    CheckpointProperties props) {
  ConcurrentHashMap<JobVertexID, TaskStateStats> taskStateStats = createEmptyTaskStateStatsMap();
  PendingCheckpointStats pending = new PendingCheckpointStats(
      checkpointId,
      triggerTimestamp,
      props,
      totalSubtaskCount,
      taskStateStats,
      new PendingCheckpointStatsCallback());
  statsReadWriteLock.lock();
  try {
    counts.incrementInProgressCheckpoints();
    history.addInProgressCheckpoint(pending);
    dirty = true;
  } finally {
    statsReadWriteLock.unlock();
  }
  return pending;
}
origin: org.apache.flink/flink-runtime

registerMetrics(metricGroup);
origin: com.alibaba.blink/flink-runtime

@Override
public CheckpointCoordinatorConfiguration getCheckpointCoordinatorConfiguration() {
  if (checkpointStatsTracker != null) {
    return checkpointStatsTracker.getJobCheckpointingConfiguration();
  } else {
    return null;
  }
}
origin: org.apache.flink/flink-runtime_2.10

  latest.getExternalPointer());
statsTracker.reportRestoredCheckpoint(restored);
org.apache.flink.runtime.checkpointCheckpointStatsTracker

Javadoc

Tracker for checkpoint statistics.

This is tightly integrated with the CheckpointCoordinator in order to ease the gathering of fine-grained statistics.

The tracked stats include summary counts, a detailed history of recent and in progress checkpoints as well as summaries about the size, duration and more of recent checkpoints.

Data is gathered via callbacks in the CheckpointCoordinator and related classes like PendingCheckpoint and CompletedCheckpoint, which receive the raw stats data in the first place.

The statistics are accessed via #createSnapshot() and exposed via both the web frontend and the Metric system.

Most used methods

  • createEmptyTaskStateStatsMap
    Creates an empty map with a TaskStateStats instance per task that is involved in the checkpoint.
  • createSnapshot
    Creates a new snapshot of the available stats.
  • registerMetrics
    Register the exposed metrics.
  • reportRestoredCheckpoint
    Callback when a checkpoint is restored.
  • getJobCheckpointingConfiguration
    Returns the job's checkpointing configuration which is derived from the CheckpointConfig.
  • getSnapshottingSettings
    Returns the job's snapshotting settings which are derived from the CheckpointConfig.

Popular in Java

  • Reading from database using SQL prepared statement
  • runOnUiThread (Activity)
  • getSupportFragmentManager (FragmentActivity)
  • setScale (BigDecimal)
  • BufferedReader (java.io)
    Wraps an existing Reader and buffers the input. Expensive interaction with the underlying reader is
  • DateFormat (java.text)
    Formats or parses dates and times.This class provides factories for obtaining instances configured f
  • Queue (java.util)
    A collection designed for holding elements prior to processing. Besides basic java.util.Collection o
  • JarFile (java.util.jar)
    JarFile is used to read jar entries and their associated data from jar files.
  • Get (org.apache.hadoop.hbase.client)
    Used to perform Get operations on a single row. To get everything for a row, instantiate a Get objec
  • Location (org.springframework.beans.factory.parsing)
    Class that models an arbitrary location in a Resource.Typically used to track the location of proble
  • CodeWhisperer alternatives
Tabnine Logo
  • Products

    Search for Java codeSearch for JavaScript code
  • IDE Plugins

    IntelliJ IDEAWebStormVisual StudioAndroid StudioEclipseVisual Studio CodePyCharmSublime TextPhpStormVimGoLandRubyMineEmacsJupyter NotebookJupyter LabRiderDataGripAppCode
  • Company

    About UsContact UsCareers
  • Resources

    FAQBlogTabnine AcademyTerms of usePrivacy policyJava Code IndexJavascript Code Index
Get Tabnine for your IDE now