Apache Kafka

Duration (in days): 

2

Description:

Apache Kafka has become the essential information bus for many of the Fortune-500 companies. At Northscaler, Kafka is often used in the achitecture we build for our clients.

In the course, we'll teach not only how to use Kafka, but how Kafka works under the hood so that you can use Kafka in the correct way. We'll also show Kafka Streams, Mirror Maker, Exactly Once Delivery, and much more.

Objectives:

  • Learn how Kafka is used in the industry

  • Learn how to publish to Kafka

  • Learn how to read from Kafka

  • Learn how to use Kafka Streams

  • Learn how to use Kafka Connect

  • Master Exactly Once Delivery

Prerequisites:

Apache Kafka has become the essential information bus for many of the Fortune-500 companies. At Northscaler, Kafka is often used in the achitecture we build for our clients.

In the course, we'll teach not only how to use Kafka, but how Kafka works under the hood so that you can use Kafka in the correct way. We'll also show Kafka Streams, Mirror Maker, Exactly Once Delivery, and much more.

Audience

  • Software Engineers

  • Software Arcfhitefts

Outline

Kafka Fundamentals

  • What is Kafka?

  • Why Kafka?

  • Some real world use cases

  • Topics

  • Partitions

  • How Kafka works

Kafka publishers

  • What is a publisher?

  • How to use the Kafka publisher?

  • Kafka configuration and why you care

Kafka consumers

  • What is a consumer?

  • What is a consumer group?

  • Proper use of consumers

  • Kafka configuration of consumers and why you care

Advanced topics and partitions

  • How to design topics?

  • How to select partitions?

  • Replication and compremizes

  • Best practices

  • Marshalling options

  • Compression

  • Encryption

Kafka Streams

  • What is Kafka Streams?

  • Alternatives (such as Spark and Flink) and tradeoffs

  • The Kafka Streaming DSL

  • Streaming API's

  • Windowing

  • Forks and Joins

  • Some real world use cases

Kafka administration

  • Kafka tools

  • Mirror maker

  • Kafka connect

  • Best practices

Exactly once delivery

  • Common failures in Kafka

  • Naive use of Kafka and the consequences

  • Idempotency

  • Exactly once deilivery guarantees in Kafka, what does it mean?

© 2020 Northscaler