...
- Gather CDAP runtime jars, program artifacts, program runtime data, configurations, etc.
- Launch the CDAP runtime on the target runtime cluster with the information gathered in step 1
- This is a cluster specific step, but generally involves files localization and launching the CDAP runtime JVM on the cluster. Here are some possibilities:
- ssh + scp files and running command
- Talks to YARN RM directly via the RM Client protocol for localization as well as launching YARN application
- Build and publish a docker image (localization) and interacts with Kubernetes master to launch CDAP runtime in container
- This is a cluster specific step, but generally involves files localization and launching the CDAP runtime JVM on the cluster. Here are some possibilities:
Runtime Monitor
The Runtime Monitor collects information emitted by the running program, including
- Program lifecycle states
- Starting, Running, Suspended, Completed, Killed, Failed
- Metadata
- Lineage, metadata, workflow tokens,
Program Runtime
The Program Runtime is the CDAP component running inside the target execution (cloud) environment. It is responsible for
...