Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Orchestrating a Data Fusion pipeline from external services is a common use case. For example, Composer might start data pipelines based on data availability in GCS bucket and then wait for the pipeline to complete. The guide This article walks you through the APIs needed to trigger the pipeline, monitor the pipeline and wait for it to completerun, and get the pipeline status when it completes.

Approach

  1. Triggering of the pipeline should get the Run ID of the pipeline that is started. To get the Run ID, use the following endpoint:

...