Public

Reads Avro file(s) containing records of the specified schema.

readGenericRecords

Writes Avro records of the specified schema.

writeGenericRecords

Returns a DynamicAvroDestinations that always returns the same FilenamePolicy,
schema, metadata, and

constantDestinations

Like #parseGenericRecords(SerializableFunction), but reads each filepattern in
the input PCollection

parseAllGenericRecords

Reads records of the given type from an Avro file (or multiple Avro files
matching a pattern).The sc

read

Like #read, but reads each filepattern in the input PCollection.

readAll

Writes a PCollection to an Avro file (or multiple Avro files matching a sharding
pattern).

write

Similar to #writeCustomType(), but specialized for the case where the output
type is GenericRecord. 

writeCustomTypeToGenericRecords

defaultWriteBuilder

Reads Avro file(s) containing records of an unspecified schema and converting
each record to a custo

parseGenericRecords

Like #readGenericRecords(Schema), but reads each filepattern in the input
PCollection.

readAllGenericRecords

A Sink for use with FileIO#write and FileIO#writeDynamic, writing elements of
the given generated cl

sink

A Sink for use with FileIO#write and FileIO#writeDynamic, writing elements by
converting each one to

sinkViaGenericRecords

A PTransform that writes a PCollection to an avro file (or multiple avro files
matching a sharding p

writeCustomType

BufferedReader

Making http requests using okhttp

A thread is a thread of execution in a program. The Java Virtual Machine allows
an application to ha

java.lang.Thread

Formats and parses dates in a locale-sensitive manner. Formatting turns a Date
into a String, and pa

java.text.SimpleDateFormat

A task that returns a result and may throw an exception. Implementors define a
single method with no

java.util.concurrent.Callable

javax.swing.JFrame

XPath provides access to the XPath evaluation environment and expressions.

Evaluation of XPath Expr

javax.xml.xpath.XPath

Reflections one-stop-shop objectReflections scans your classpath, indexes the
metadata, allows you t

org.reflections.Reflections

findViewById

setContentView

onCreateOptionsMenu

// Validate that the data written matches the expected elements in the expected order.

/**
   * Read the Cloud Spanner schema and all the rows in all the tables of the database. Create and
   * write the exported Avro files to GCS.
   */

// Generate a unique output directory name.

// For direct runner or tests we need a deterministic jobId.

"Please specify --testJobId to run with non-dataflow runner"

// The following is to export empty tables from the database.

/**
                       * Resolves the complete path name for Avro files for both GCS and local FS
                       * (for testing).
                       *
                       * @param outputDirectoryPath Initial directory path for the file.
                       * @param outputDirectoryName Terminal directory for the file.
                       * @param fileName Name of the Avro file
                       * @return The full {@link Path} of the output Avro file.
                       */

/**
                       * Creates the {@link OutputStream} for the output file either on GCS or on
                       * local FS (for testing).
                       *
                       * @param outputPath The full path of the output file.
                       * @param c The {@link org.apache.beam.sdk.transforms.DoFn.ProcessContext}
                       * @return An {@link OutputStream} for the opened output file.
                       * @throws IOException if the output file cannot be opened.
                       */

// Avro file is created on local filesystem (for testing).

How to use writeCustomTypeToGenericRecordsmethodin org.apache.beam.sdk.io.AvroIO

Best Java code snippets using org.apache.beam.sdk.io.AvroIO.writeCustomTypeToGenericRecords (Showing top 2 results out of 315)

How to use
writeCustomTypeToGenericRecords
method
in
org.apache.beam.sdk.io.AvroIO