Administration of Confluent Apache Kafka Training Course

Module 1: Overview of Confluent Apache Kafka Cluster Architecture and Configuration

• The role of Kafka in modern data pipelines
• Key distinctions between Apache Kafka and Confluent Kafka
• Essential components: producers, consumers, brokers, topics, and partitions
• Deployment models and scaling strategies for Kafka clusters

Module 2: Configuring Zookeeper Quorums

• Introduction to Zookeeper
• The function of Zookeeper within a Kafka cluster
• Determining appropriate Zookeeper Quorum sizes
• Setting up Zookeeper configurations
• Implementing SSH on target servers
• Practical session: Configuring Zookeeper (as a team and as a service)
• Utilizing the Zookeeper Command Line Interface (CLI)
• Practical session: Setting up Zookeeper Quorums
• Understanding the Zookeeper internal file system
• Performance factors influencing Zookeeper operations
• Demonstration of management tools for Zookeeper and Zoonavigator

Module 3: Kafka Cluster Configuration

• Fundamental Kafka concepts
• General Kafka configuration practices
• Practical session: Configuring Kafka brokers
• Practical session: Running Kafka commands
• Practical session: Setting up a Kafka Multi-Broker Cluster
• Practical session: Testing Kafka clusters
• Verifying connectivity to Kafka clusters
• Configuring Advertised.listeners: A critical setting
• Topic configuration details
• Settings for downloading and ingesting messages into topics
• Practical session: Demonstrating Kafka resilience
• Kafka performance optimization: I/O
• Kafka performance optimization: Network (RED)
• Kafka performance optimization: RAM
• Kafka performance optimization: CPU
• Kafka performance optimization: Operating System (OS)
• Other Kafka performance considerations
• Practical session: Modifying Kafka broker configurations

Module 4: Advanced Kafka Configuration

• Configuring Landoop Kafka topic UI, Confluent REST Proxy, and Confluent Schema Registry
• Sending and receiving messages via CLI, Java, and the Spring framework
• Monitoring metrics and utilizing tools (Confluent Control Center, Elasticsearch, etc.)
• Managing log files and offsets
• Implementing high availability and disaster recovery
• Achieving high availability through replication
• Optimizing producer and consumer performance
• Strategies for disaster recovery
• Failover control and data recovery mechanisms
• Configuring Kafka Connectors
• Implementing Kafka Connect
• Implementing Kafka security features

Summary and Next Steps