Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

See http://spark.apache.org/docs/latest/streaming-programming-guide.html#output-operations-on-dstreams for information on how to write context of a Spark DStream.

Note: Looks like it will be difficult to write to CDAP datasets. May have to add saveToDataset(String datasetName, JavaPairDStream stream) methods to the JavaSparkExecutionContext.

Note: Investigate support for realtimesink plugin type using the foreachRDD() method.

...