Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Note

Warning: This will push your changes to prod instantly, there is no staging environment or rollout. As soon as the upload is done the changes are live. Please double check that all the required artifact files are present and that packages.json contains the correct versions before deploying.

Code Block
gsutil -m cp -r -n packages/ gs://hub-cdap-io/v2/
gsutil cp categories.json gs://hub-cdap-io/v2/categories.json
gsutil cp packages.json gs://hub-cdap-io/v2/packages.json

12. The previous steps copied the artifacts to the central hub. There are also regional hubs are used by CDF 6.1.4 (and newer) instances. Run the following commands to sync all regional hubs to the central hub:

Note

It is possible for the one of the gsutil commands to hang/freeze when processing this volume of data. The best solution is to kill the command (using Ctrl + C) and rerun it.

Code Block
gsutil -m cp -r -n gs://hub-cdap-io/v2/packages gs://cdfhub-us-west1/hub
gsutil -m cp -r gs://hub-cdap-io/v2/*.json gs://cdfhub-us-west1/hub

gsutil -m cp -r -n gs://hub-cdap-io/v2/packages gs://cdfhub-asia-south1/hub
gsutil -m cp -r gs://hub-cdap-io/v2/*.json gs://cdfhub-asia-south1/hub

gsutil -m cp -r -n gs://hub-cdap-io/v2/packages gs://cdfhub-asia-east1/hub
gsutil -m cp -r gs://hub-cdap-io/v2/*.json gs://cdfhub-asia-east1/hub

gsutil -m cp -r -n gs://hub-cdap-io/v2/packages gs://cdfhub-asia-east2/hub
gsutil -m cp -r gs://hub-cdap-io/v2/*.json gs://cdfhub-asia-east2/hub

gsutil -m cp -r -n gs://hub-cdap-io/v2/packages gs://cdfhub-asia-northeast1/hub
gsutil -m cp -r gs://hub-cdap-io/v2/*.json gs://cdfhub-asia-northeast1/hub

gsutil -m cp -r -n gs://hub-cdap-io/v2/packages gs://cdfhub-asia-northeast2/hub
gsutil -m cp -r gs://hub-cdap-io/v2/*.json gs://cdfhub-asia-northeast2/hub

gsutil -m cp -r -n gs://hub-cdap-io/v2/packages gs://cdfhub-asia-southeast1/hub
gsutil -m cp -r gs://hub-cdap-io/v2/*.json gs://cdfhub-asia-southeast1/hub

gsutil -m cp -r -n gs://hub-cdap-io/v2/packages gs://cdfhub-australia-southeast1/hub
gsutil -m cp -r gs://hub-cdap-io/v2/*.json gs://cdfhub-australia-southeast1/hub

gsutil -m cp -r -n gs://hub-cdap-io/v2/packages gs://cdfhub-europe-north1/hub
gsutil -m cp -r gs://hub-cdap-io/v2/*.json gs://cdfhub-europe-north1/hub

gsutil -m cp -r -n gs://hub-cdap-io/v2/packages gs://cdfhub-europe-west1/hub
gsutil -m cp -r gs://hub-cdap-io/v2/*.json gs://cdfhub-europe-west1/hub

gsutil -m cp -r -n gs://hub-cdap-io/v2/packages gs://cdfhub-europe-west2/hub
gsutil -m cp -r gs://hub-cdap-io/v2/*.json gs://cdfhub-europe-west2/hub

gsutil -m cp -r -n gs://hub-cdap-io/v2/packages gs://cdfhub-europe-west3/hub
gsutil -m cp -r gs://hub-cdap-io/v2/*.json gs://cdfhub-europe-west3/hub

gsutil -m cp -r -n gs://hub-cdap-io/v2/packages gs://cdfhub-europe-west4/hub
gsutil -m cp -r gs://hub-cdap-io/v2/*.json gs://cdfhub-europe-west4/hub

gsutil -m cp -r -n gs://hub-cdap-io/v2/packages gs://cdfhub-europe-west6/hub
gsutil -m cp -r gs://hub-cdap-io/v2/*.json gs://cdfhub-europe-west6/hub

gsutil -m cp -r -n gs://hub-cdap-io/v2/packages gs://cdfhub-us-central1/hub
gsutil -m cp -r gs://hub-cdap-io/v2/*.json gs://cdfhub-us-central1/hub

gsutil -m cp -r -n gs://hub-cdap-io/v2/packages gs://cdfhub-us-east1/hub
gsutil -m cp -r gs://hub-cdap-io/v2/*.json gs://cdfhub-us-east1/hub

gsutil -m cp -r -n gs://hub-cdap-io/v2/packages gs://cdfhub-us-east4/hub
gsutil -m cp -r gs://hub-cdap-io/v2/*.json gs://cdfhub-us-east4/hub

gsutil -m cp -r -n gs://hub-cdap-io/v2/packages gs://cdfhub-us-west2/hub
gsutil -m cp -r gs://hub-cdap-io/v2/*.json gs://cdfhub-us-west2/hub

13. Wait a couple minutes for the changes to propagate and try to deploy your new artifact from The Hub in a CDF instance.

...