Synchronize with Apache Kafka
Apache Kafka is an open-source streaming platform that communicates state changes in a distributed environment. Changes to a datastore are sent to a Kafka topic, which lets customers update other datastores that contain the same information. Although Kafka persists, orders, and transmits changes, it neither detects changes nor applies them to other datastores.
PingDataSync supports Kafka as both a sync source and a sync destination:
-
As a sync source, PingDataSync consumes change events published to a Kafka topic and applies them to a sync destination. This lets you use Kafka as a change feed for propagating updates from an upstream system into a PingDirectory server or another sync destination.
This feature is provided as a Preview, which means that it isn’t supported and should not be used in production environments. Learn more in Feature statuses.
-
As a sync destination, PingDataSync publishes changes from a PingDirectory server to a Kafka topic. The entry is displayed in JSON format both before and after each change. This level of indirection enables other systems and services to react to changes in the PingDirectory server by consuming messages from the topic.
Endpoints that use the Server SDK don’t require custom sync destinations.