Introduction

Mixpanel is a business analytics service and tracks user interactions with web and mobile applications and provides tools for targeted communication with them. Its tool set contains in-app A/B tests and user survey forms. Data collected is used to build custom reports and measure user engagement and retention.

Use case(s)

• Retrieve raw events data from Mixpanel service

User Storie(s)

• As a data pipeline developer, I should be able to retrieve raw Mixpanel events data for specified start and end date so that I can enrich and transform raw data for further analysis
• As a data pipeline developer, I should be be able to specify API secret to authenticate the export request
• As a data pipeline developer, I should be able to see all the errors while fetching the raw events data from Mixpanel so that I can review and fix those export issues
• As a data pipeline developer, I should be able to 

Plugin Type

•  Batch Source
•  Batch Sink 
•  Real-time Source
•  Real-time Sink
•  Action
•  Post-Run Action
•  Aggregate
•  Join
•  Spark Model
•  Spark Compute

Configuration

Marketo batch source will support two different plugins:

1. Marketo Reporting Plugin - This plugin would get all the Marketo's entities (e.g. Leads, Activities, Campaigns, Companies etc.)
2. Marketo Entity Plugin - This plugin would get only the data associated with specified entity (e.g. Leads)

Marketo Reporting plugin

This plugin should be used when the user would like to retrieve all of the Marketo datasets, specifically all the entities noted below:

...

Client

User Facing Name	Type	Description	Default value	Notes

Client IDstringMarketo Client ID

API Secret

string

Marketo Client secretREST API EndpointstringREST API endpoint URLREST API IdentitystringREST API identityDaily API limitintegerMarketo enforced daily API limit

Additional daily capacity can be purchased and hence user needs to provide this information.

Mixpanel API secret

https://

developers

developer.

marketo

mixpanel.com/

rest-api/marketo-integration-best-practices/Report formatstringReport formatCSVOptions are CSV, TSV or SSVStart

docs/exporting-raw-data#section-required-parameter
From date	string	Start date for reports data

ISO 8601

YYYY-MM-DD format

End

To date

string

End date for reports data

ISO 8601 format

	YYYY-MM-DD format
Events	string	Comma separated list of events you would like to get data on		Optional
Filter	string	Expression to filter events by		Optional

Design / Implementation Tips

...

• Mixpanel only supports batch source so there will not be any streaming source for Mixpanel
• Data export API always returns data in JSON format.

Design

Approach(s)

Properties

...

• Mixpanel Data Export API: https://developer.mixpanel.com/docs/exporting-raw-data
• Client libraries: https://developer.mixpanel.com/docs/data-export-api#section-client-libraries