Data Engineering Foundations Part 2: Building Data Pipelines with Kafka and Nifi

Data Engineering Foundations Part 2: Building Data Pipelines with Kafka and Nifi | Livelessons
English | Size: 988.88 MB
Genre: eLearning

The Perfect Way to Get Started with Data Pipelines, Kafka, and NiFi

Data Engineering Foundations Part 2: Building Data Pipelines with Kafka and NiFi provides over four hours of video introducing you to creating data pipelines at scale with Kafka and NiFi. You learn to work with the Kafka message broker and discover how to establish NiFi dataflow. You also learn about data movement and storage. All software used in videos is open source and freely available for your use and experimentation on the included virtual machine.

Skill Level:

Beginner
Intermediate

Learn How To:

Understand Kafka topics, brokers, and partitions
Implement basic Kafka usage modes
Use Kafka producers and consumers with Python
Utilize the KafkaEsque graphical user interface
Understand the core concepts of NiFi
Understand NiFi flow and web UI components
Understand direct data movement with HDFS
Use HBase with Python Happybase
Use Sqoop for database movement

Who Should Take This Course:
Users, developers, and administrators interested in learning the fundamental aspects and operations of date engineering and scalable systems