Get in Touch

Course Outline

Module 1: Overview of Confluent Apache Kafka Architecture and Cluster Setup

  • Defining Apache Kafka and the Confluent Platform
  • Core concepts: Kafka brokers, producers, consumers, and topics
  • The role of Kafka in data streaming and messaging workflows
  • Confluent-specific features: REST Proxy, Schema Registry, and Control Center
  • Cluster architecture details: brokers, partitions, and replication

Module 2: Configuring Zookeeper Quorums

  • Introduction to Zookeeper
  • The function of Zookeeper within a Kafka cluster
  • Determining appropriate Zookeeper quorum sizes
  • Zookeeper configuration parameters
  • Setting up SSH access on servers
  • Hands-on: Configuring Zookeeper (both as a team and as a service)
  • Utilizing the Zookeeper Command Line Interface (CLI)
  • Hands-on: Establishing a Zookeeper quorum
  • Understanding the Zookeeper internal file system
  • Performance factors that impact Zookeeper
  • Demo: Managing Zookeeper using tools like Zoonavigator

Module 3: Kafka Cluster Configuration

  • Fundamentals of Kafka
  • General Kafka configuration practices
  • Hands-on: Configuring Kafka on a single broker
  • Hands-on: Running Kafka commands
  • Hands-on: Setting up a multi-broker Kafka cluster
  • Hands-on: Testing Kafka cluster integrity
  • Verifying connectivity to the Kafka cluster
  • Configuring advertised.listeners: essential settings
  • Topic-specific configurations
  • Establishing message ingestion and delivery for topics
  • Hands-on: Demonstrating Kafka resilience capabilities
  • Kafka performance drivers: I/O, network, RAM, CPU, and OS
  • Kafka performance: additional influencing factors
  • Hands-on: Modifying broker configurations

Module 4: Advanced Kafka Configuration

  • Configuring Landoop Kafka Topics UI, Confluent REST Proxy, and Confluent Schema Registry
  • Sending and receiving messages via CLI, Java, or the Spring Framework
  • Monitoring and metrics tools (including Confluent Control Center and Elasticsearch)
  • Managing log files and offsets
  • High availability and disaster recovery planning
  • Achieving high availability through replication
  • Performance tuning for producers and consumers
  • Disaster recovery methodologies
  • Controlling failover and recovering data
  • Setting up connectors
  • Implementing Kafka Connect
  • Reviewing Kafka security features

Summary and Recommended Next Steps

Requirements

  • Proficiency with Linux-based systems and command-line utilities
  • Knowledge of distributed systems principles
  • Comprehension of fundamental networking and system configuration

Target Audience

  • DevOps and SRE teams overseeing Kafka deployments
  • System administrators working with Confluent and Zookeeper
  • Kafka developers and architects focused on building scalable systems
 16 Hours

Number of participants


Price per participant

Testimonials (2)

Upcoming Courses

Related Categories