Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

 

The plan then, is to add metadata properties to artifacts. Hydrator can store the widgets and docs for each plugin in the metadata properties of the artifact containing that plugin. We You can already add metadata to apps, programs, datasets, streams. It makes sense to have the feature for artifacts as well.  This set properties on streams and datasets, this would be an analogous feature. This solves the 3 problems mentioned above, while keeping CDAP genericignorant of widgets and UI specific things.

Code Block
GET /namespaces/{namespace-id}/artifacts/{artifact-name}/{versions}/{artifact-version}/metadata
 properties
GET /namespaces/{namespace-id}/artifacts/{artifact-name}/{versions}/{artifact-version}/metadataproperties/properties{property}
POSTPUT /namespaces/{namespace-id}/artifacts/{artifact-name}/{versions}/{artifact-version}/metadataproperties/properties{property}
DELETEPOST /namespaces/{namespace-id}/artifacts/{artifact-name}/{versions}/{artifact-version}/metadata/properties
DELETE /namespaces/{namespace-id}/artifacts/{artifact-name}/{versions}/{artifact-version}/metadata/properties/{property}
 
GET /namespaces/{namespace-id}/artifacts/{artifact-name}/{versions}/{artifact-version}/metadata/tags
POST /namespaces/{namespace-id}/artifacts/{artifact-name}/{versions}/{artifact-version}/metadata/tags
DELETE /namespaces/{namespace-id}/artifacts/{artifact-name}/{versions}/{artifact-version}/metadata/tags/{tag}

Note: It doesn't look like there is an API for getting a specific property. Not sure why there isn't, but seems to make sense to have one.

 

Installing a set of plugins could then be a single command:

Code Block
load artifact <path/toproperties

Installing a set of plugins could then be a single command:

Code Block
load artifact <path/to/artifact> [config-file <config-file>] [with metadata <metadata-file>] 

with properties added to the config file

Jira Legacy
serverCask Community Issue Tracker
serverId45b48dee-c8d6-34f0-9990-e6367dc2fe4b
keyCDAP-4280

 

 

Plugin Selection

User installs CDAP 3.3.0 by downloading the sdk or installing via packages.  Included in CDAP is the Hydrator webapp, cdap-etl-batch-3.3.0, and cdap-etl-realtime-3.3.0 artifacts.  Also included are all the v1.0.0 plugins in the hydrator-plugins repo, like cassandra-1.0.0.  The user creates a pipeline that reads from cassandra and writes to a Table.

...