Kafka

Overview

The Kafka connector is designed to manage provisioning by streaming from / to Apache Kafka clusters.

Installation

Follow these steps to run the stand-alone connector server:

  1. Download the connector server jar file and store it in the connector server directory (any directory).

  2. Download the connector jar file and store it in the bundles subdirectory.

  3. Start the connector server. For more information, check the page about this topic.

Supported operations

  • Create

  • Delete

  • Update

  • LiveSync

  • Test

  • Schema

Configuration

Configuration Properties

The following table describes all of the properties that you can specify for the configuration:

Configuration Property

Type

Required

Description

Configuration Property

Type

Required

Description

bootstrapServers

String

X

A list of host/port pairs used to establish the initial connection to the Kafka cluster

clientId

String

X

Client id for subscription

consumerGroupId

String

X

A unique string that identifies the consumer group this consumer belongs to

autoOffsetReset

String

X

What to do when there is no initial offset in Kafka or if the current offset does not exist any more on the server (e.g. because that data has been deleted); defaults to earliest in order to make sure the producer sent all messages before the consumer starts

valueSerializerClassName

String

X

Serializer class for value that implements the 'org.apache.kafka.common.serialization.Serializer' interface. Defaults to net.tirasa.connid.bundles.kafka.serialization.SyncDeltaSerializer

valueDeserializerClassName

String

X

Deserializer class for value that implements the 'org.apache.kafka.common.serialization.Deserializer' interface. Defaults to org.apache.kafka.common.serialization.StringDeserializer

accountTopic

String

 

Topic to publish to and being subscribed to for object class __ACCOUNT__

groupTopic

String

 

Topic to publish to and being subscribed to for object class __GROUP__

allTopic

String

 

Topic to publish to and being subscribed to for object class __ALL__

consumerPollMillis

Long

 

The maximum number of milliseconds to block while polling

Â