Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

Version 1 Next »

This page describe how to launch a pipeline in GCP Shared VPC. To learn more about Shared VPC please refer to GCP documentation.

Before you begin

  • You must have setup a shared VPC

  • The shared VPC must be accessible in the service project in which you want to the Dataproc cluster associated with the pipelines to run.

  • You must have grant Compute Network User role to the Dataproc’s service account of your service project on the shared network.

  • You must have grant Compute Network User role to the Service Account associated with your instance of CDAP/CDF on the shared network.

Doing a task

  1. Create a new profile following the Creating Profiles documentation.

  2. While creating the profile set the Network name to your shared VPC network and the Network Host Project ID to the host project of your shared VPC network.

Now you can use this profile while running your pipeline to launch the pipeline and it’s associated Dataproc cluster in service project and the network will be the Shared VPC network.

  • No labels