...
Out-of-scope User Stories (4.0 and beyond)
- Support of accessing entities other than dataset/stream in different namespace. For example, a cdap user in namespace ns1, I should be able to create an application app1 using an artifact artifact2 which is present in namespace ns2.
- Cross namespace access in explore queries with cdap namespace. Currently, users can do cross namespace access by providing the underlying hive database name.
- Admin interface for Dataset should be able to perform crossname namespace access.
References
Appendix A: API changes
Code Block language java title Changes for dataset // Dataset Context: <T extends Dataset> T getDataset(String namespace, String name) <T extends Dataset> T getDataset(String namespace, String name, Map<String, String> arguments) // Add APIs to programs to support accessing dataset from a different namespace: // MapReduce: context.addInput(Input.ofStream("stream").fromNamespace("ns")); // Spark: public <K, V> JavaPairRDD<K, V> fromDataset(String namespace, String datasetName) public <K, V> JavaPairRDD<K, V> fromDataset(String namespace, String datasetName, Map<String, String> arguments) public abstract <K, V> JavaPairRDD<K, V> fromDataset(String namespace, String datasetName, Map<String, String> arguments, @Nullable Iterable<? extends Split> splits);
| Code Block | ||||
|---|---|---|---|---|
| ||||
// Dataset Context:
<T extends Dataset> T getDataset(String namespace, String name)
<T extends Dataset> T getDataset(String namespace, String name, Map<String, String> arguments)
// Add APIs to programs to support accessing dataset from a different namespace:
// MapReduce:
context.addInput(Input.ofStream("stream").fromNamespace("ns"));
// Spark:
public <K, V> JavaPairRDD<K, V> fromDataset(String namespace, String datasetName)
public <K, V> JavaPairRDD<K, V> fromDataset(String namespace, String datasetName, Map<String, String> arguments)
public abstract <K, V> JavaPairRDD<K, V> fromDataset(String namespace, String datasetName, Map<String, String> arguments, @Nullable Iterable<? extends Split> splits); |