Versions Compared

Old Version 1

changes.mady.by.user Albert Shau

Saved on

compared with

New Version 2

changes.mady.by.user Robin Rielley

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  1. In the Data Fusion pipeline detail page, open the Configuration menu.

  2. In the Engine Config section, check if the pipeline is using MapReduce or Spark.

    1. If the engine is Spark, in the Custom Config section, add a key for spark.task.maxFailures with 1 as the value.

    2. If the engine is MapReduce, in the Custom Config section, add a key for mapreduce.map.maxattempts with 1 as the value, and a key for mapreduce.reduce.maxattempts with 1 as the value. mapreduce.map. maxattempts