Consume Messages from an Apache Kafka Topic by Specifying Multiple Offsets and Ranges

You can configure an integration to use the Apache Kafka Adapter to consume messages from an Apache Kafka topic by specifying multiple offsets and ranges.

The following integration provides one example of how to implement this pattern:
  • Create an application integration with a SOAP Adapter or REST Adapter as a trigger connection.
  • Configure the Apache Kafka Adapter to:
    • Consume records from a Kafka topic by specifying multiple offsets and ranges.
    • Specify the topic and message structure to use. For example, specify an XML schema (XSD) document and the headers to use for the message.
  • Configure the mapper to perform appropriate source-to-target mappings between the SOAP Adapter or REST Adapter and the Apache Kafka Adapter.
  • Map or specify the partition and its offset range in the mapping (for example, the Partition can be 0 and the Offset Range format can be 6,10-11,16).