Apache Kafka Training
Level
IntermediateDuration
24h / 3 daysDate
Individually arrangedPrice
Individually arrangedApache Kafka Training
The “Apache Kafka” training is an intensive 2–3 day workshop (80% practice, 20% theory) that will comprehensively introduce you to streaming and real-time data integration with Apache Kafka. You will learn to design and implement fault-tolerant event queuing systems, understand the architecture, and gain practical skills in building and managing a distributed data transfer platform. The training covers both key administrative and programming topics, preparing you to work effectively with data in modern IT environments.
What You Will Learn
- Understand Apache Kafka architecture and the role of streaming in modern IT systems
- Design and run a Kafka cluster, manage security and monitoring
- Gain hands-on programming skills (producer, consumer, offset handling) in Java or Python
- Integrate Kafka with other systems, automate processes, and ensure high availability and performance
- Use Kafka Streams and Confluent Platform for enterprise deployments
Requirements
- Knowledge of SQL and NoSQL databases is welcome
- Programming skills in Java or Python
Who is this training for?
Programmers and data engineers implementing event-driven systems and stream processing.-
Administrators and DevOps responsible for maintaining and scaling communication platforms.
-
Analysts, solution architects, and consultants deploying Big Data and integration solutions.
Training Program
-
Day 1: Fundamentals and Architecture of Apache Kafka
-
Module 1: Introduction to Streaming Architecture
- Publish–subscribe systems and stream processing concepts
- Role of Apache Kafka in the Big Data ecosystem vs classic queues
- Message brokers: queues and pub/sub model
- Producer types: synchronous vs asynchronous sending
- Delivery guarantees in Kafka
- Typical Kafka use cases: ETL, system integration, monitoring
-
Module 2: Apache Kafka Architecture and Components
- Core concepts: broker, topic, partition, producer, consumer, Zookeeper
- Internal mechanisms: durability, scalability, consistency, high availability
- Partitioning, rebalancing, and replication
- Architecture from developer and administrator perspectives
- High availability with MirrorMaker and cross-cluster replication
-
Day 2: Working with Apache Kafka – Programming, Administration, and Security
-
Module 3: Installation, Configuration, and Basic Administration
- Installing Kafka and Zookeeper locally and in the cloud
- Configuration, security policies, administration tools, diagnostics
- Managing topics, partitions, and replication (CLI and GUI)
- Hardware and system considerations for performance
-
Module 4: Programming Kafka-based Applications
- Creating producers and consumers in Java and Python
- Sending, receiving, and transforming streaming data
- Offset management, consumer groups, and load balancing
-
Module 5: Security and Monitoring
- Encrypting communication with SSL/TLS
- Authentication using SASL and Kerberos
- Access control with ACLs at topic and cluster level
- Monitoring with Kafka Manager, Prometheus, and Grafana
-
Day 3: Advanced Kafka in Enterprise Architectures
-
Module 6: Integrations, Stream Processing, and Connectors
- Integrating Kafka with external systems (Kafka Connect, JDBC, REST, S3)
- Kafka Streams: transformations, joins, windowing
- Kafka in microservices and event-driven architectures
- Backup strategies: manual and automated tools
-
Module 7: Scaling, Tuning, and Best Practices
- Cluster expansion and partition optimization
- Safe configuration changes and retention strategies
- Backup, recovery, and disaster scenarios
- Real-world case studies, challenges, and solutions
