Administration of Confluent Apache Kafka Training Course

Module 1: Overview of Confluent Apache Kafka architecture and configuration

• The role of Kafka in contemporary data pipelines
• Distinguishing between Apache Kafka and Confluent Kafka
• Core elements: producers, consumers, brokers, topics, and partitions
• Deployment models and scaling considerations for Kafka clusters

Module 2: Setting up Zookeeper Quorum

• Understanding Zookeeper
• The function of Zookeeper within a Kafka cluster
• Determining Zookeeper Quorum size
• Configuring Zookeeper
• Implementing SSH on servers
• Practical: Configuring Zookeeper (as a team and as a service)
• Utilizing the Zookeeper Command Line Interface (CLI)
• Practical: Configuring Zookeeper Quorum
• Zookeeper internal file system
• Performance factors influencing Zookeeper
• Demonstration of management tools for Zookeeper and Zoonavigator

Module 3: Configuring the Kafka Cluster

• Foundational Kafka concepts
• Configuring Kafka
• Practical: Setting up Kafka brokers
• Practical: Executing Kafka commands
• Practical: Configuring a Kafka Multi-Broker Cluster
• Practical: Testing the Kafka cluster
• Connectivity verification: Can I connect to my Kafka cluster?
• Advertised.listeners configuration: a critical setting
• Topic configuration
• Settings for downloading and ingesting messages within topics
• Practical: Demonstrating Kafka resilience
• Kafka performance: I/O
• Kafka performance: Network (RED)
• Kafka performance: RAM
• Kafka performance: CPU
• Kafka performance: Operating System (OS)
• Kafka performance: Other factors
• Practical: Modifying Kafka broker configuration

Module 4: Advanced Kafka Setup

• Configuring Landoop Kafka topic UI, Confluent REST Proxy, and Confluent Schema Registry
• Message transmission and reception (CLI, Java, and Spring framework)
• Monitoring metrics and tools (Confluent Control Center, Elasticsearch, etc.)
• Log files and offset management
• High availability and disaster recovery
• Maintaining high availability via replication
• Optimizing producer and consumer performance
• Disaster recovery strategies
• Failover control and data recovery
• Connector configuration
• Implementing Kafka Connect
• Kafka security features

Summary and Next Steps