...
The guiding principles of the architecture is as follows:
- Provide a A stable and scalable core for platform that provides essential functionalities
- An application API for Data Application development
- Manages and operates Data Application
- A central catalog for entities' metadata
- Provide a well defined API to add non-core functionssupport addition capabilities
- Enable fast iteration of new ideas
- Allow running data / compute intensive jobs for the system (e.g. Spark, Elastic Search, etc.)
- Individual extended system can be turn on / off independently
# Transaction Service may not be available to application runtime, depending on the target execution cluster
CDAP Core System
The CDAP Core
CDAP Extended System
Metadata Management
This basically contains various services that manage CDAP metadata for artifacts, applications, program runs and dataset. There is no big changes architecturally to those services, except for the removal dataset service, which we will cover in later section.
...