Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Pipeline execution fails when the execution engine is set to Spark with errors in the pipeline logs of the form:

“Lost task x.y in stage z.xx”

...

  • Set the executor vcore to 1, for CDF versions below 6.1.3/6.2.0.

Task killed

Spark framework will kill executor tasks that will result in the following log message:

...