User Stories
...
| Code Block |
|---|
{
"name": "SalesforceRealtime",
"plugin": {
"name": "SalesforceRealtime",
"type": "realtimesource",
"label": "SalesforceRealtime",
"properties": {
"clientId": "XXXXXXX",
"clientSecret": "XXXXXXXXX",
"username": "XXXXX",
"password": "XXXXX",
"topic": "/events/InvoiceStatementUpdates",
"outputSchema": "Name:String",
"loginUrl": "https://login.salesforce.com/services/oauth2/token"
}
}
} |
Implementation
Salesforce streaming API will be used for realtime plugin.
Cometd BayeuxClient is used to subscribe to events. When event is received the data is added to a blockingQueue.
Class SalesforceReceiver extends Receiver from Spark Streaming and is used as a receiver stream.
SalesforceReceiver#onStart:
- 1. Establish connection to
instance_url/cometd/45.0 - 2. Start thread which moves data from
blockingQueueto Spark Stream