...
| Code Block |
|---|
[
/** Dataset access operation **/
{
"time": 1456956659468,
"entityId": {
"namespace": "ns1",
"stream": "stream1",
"entity": "STREAM"
},
"user": "user1",
"type": "ACCESS",
"payload": {
"accessType": "WRITE",
"accessor": {
"namespace": "ns1",
"application": "app1",
"type": "Flow",
"program": "flow1",
"run": "run1",
"entity": "PROGRAM_RUN"
}
}
},
/** Explore datasetstream access **/
{
"time": 1456956659469,
"entityId": {
"namespace": "ns1",
"servicestream": "explorestream1",
"entity": "SYSTEM_SERVICESTREAM"
},
"user": "user1",
"type": "ACCESS",
"payload": {
"accessType": "UNKNOWN",
"accessor": {
"service": "explore",
"entity": "SYSTEM_SERVICE"
}
}
},
/** Metadata change **/
{
"time": 1456956659470,
"entityId": {
"namespace": "ns1",
"application": "app1",
"entity": "APPLICATION"
},
"user": "user1",
"type": "METADATA_CHANGE",
"payload": {
"previous": {
"USER": {
"properties": {
"uk": "uv",
"uk1": "uv2"
},
"tags": [
"ut1",
"ut2"
]
},
"SYSTEM": {
"properties": {
"sk": "sv"
},
"tags": []
}
},
"additions": {
"SYSTEM": {
"properties": {
"sk": "sv"
},
"tags": [
"t1",
"t2"
]
}
},
"deletions": {
"USER": {
"properties": {
"uk": "uv"
},
"tags": [
"ut1"
]
}
}
}
},
/** Dataset admin operation **/
{
"time": 1456956659471,
"entityId": {
"namespace": "ns1",
"dataset": "ds1",
"entity": "DATASET"
},
"user": "user1",
"type": "CREATE",
"payload": {}
}
] |
...
- Dataset admin operations can be published by DatasetOpExecutor service.
- Stream admin operations can be published by StreamAdmin class
- Dataset and stream access information can be published by LineageWirterDatasetFramework (can be renamed to AuditingDatasetFramework)piggy backing on lineage capturing code.
- Metadata changes can be published by DefaultMetadataStore class.
...