Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Set batch interval to a value that’s greater than the batch processing time. You can see the batch processing time in the Spark Streaming UI, as explained above.

...

Info

The pipeline should be cloned before making configuration changes.

Configuration changes will not take effect if you edit the configuration of a deployed pipeline. Upon restart, spark Spark will read its configuration from checkpoint, so any config changes made in the UI will not take effect.

...