This repository contains set of step-by-step recipes allowing to run and test various Kafka Connect scenarios, using docker and command line interface.

1. Install Docker and docker compose

   [!TIP] In case of Ubuntu install docker from snap it has docker compose built in or install docker-compose-v2

2. Download JDBC Connector (Source and Sink) https://www.confluent.io/hub/confluentinc/kafka-connect-jdbc and unpack jars into data directory in this repo (jars will be mounted as a volume for kafka-connect)

3. Download the newest schema_wrapping jar (in releases) and put it into the data directory (just like jdbc jars) from my other github repository

Start all required containers at once

docker compose up -d

Remove all containers

docker compose down

Scenarios assume all docker services are running.

• kafka to SqlServer using JdbcSinkConnector

• kafka schemaless data from kafka topic to PostgreSQL using JdbcSinkConnector

• kafka schemaless data from kafka topic to SqlServer using JdbcSinkConnector

• sql server to kafka

curl http://localhost:8083/connector-plugins | jq

curl http://localhost:8083/connectors

docker compose down