首页 Data Engineering

课程

Streaming Concepts

基础技能水平

更新时间 2025年1月

Learn about the difference between batching and streaming, scaling streaming systems, and real-world applications.

免费开始课程

TheoryData Engineering2 小时16 视频47 练习3,750 经验值6,630成就声明

创建您的免费帐户

或

继续操作即表示您接受我们的《使用条款》和《隐私政策》，并同意您的数据存储在美国。

深受数千家公司学习者的喜爱

培训2人或更多？

试用DataCamp for Business

课程描述

Streaming is a huge aspect of the data world right now and is being used by nearly every industry from manufacturing to healthcare. Would you like to learn more about the general concepts behind data pipelines and how the processes work?This course provides a general introduction to streaming concepts including batching, queuing, and stream processing along with where they fit into data processing frameworks. It covers real-world examples of how streaming is implemented in production. It is designed as a general introduction to these concepts and does not require an extensive background in data processing.

先决条件

Understanding Data Engineering

1

Methods for Processing Data

In this chapter, you’ll be given an introduction to basic concepts in batch data processing, revolving around implementation, scaling, and potential challenges during use.

Intro to batch processing

50 经验值

Batch characteristics

100 经验值

Batch ordering

100 经验值

Scaling batch processing

50 经验值

On the scale

100 经验值

Horizontally opposed

50 经验值

Batch issues

50 经验值

Batch problems

50 经验值

Batch scenarios

100 经验值

2

Intro to Streaming

Here, you’ll learn about the basics of streaming, event-based data processing, and the advantages over traditional batch-based data processing.

Intro to event-based computing

50 经验值

In the event of...

100 经验值

Welcome to the event!

100 经验值

50 经验值

Queue characteristics

100 经验值

To queue or not to queue

100 经验值

Single system data streaming

50 经验值

Log stream order

100 经验值

Log options

100 经验值

Batching vs. streaming

50 经验值

Batch, queue, or stream?

100 经验值

Log stream processor

100 经验值

3

Streaming Systems

This chapter introduces the concepts behind modern streaming systems, how to scale them, and some of the issues found in using streaming processes.

Intro to real-time streaming

50 经验值

100 经验值

Is it real this time?

100 经验值

Vertically scaling streaming systems

50 经验值

Scaling reasons

50 经验值

To vertically scale...?

100 经验值

Horizontally scaling streaming systems

50 经验值

Upscaled out

100 经验值

SLA guarantees

100 经验值

Streaming roadblocks

50 经验值

Streaming attributes

100 经验值

Issue types

100 经验值

Streaming challenges

100 经验值

4

Real-World Use Cases

In this final chapter, you’ll learn about common streaming systems and consider the implementation of streaming data processing in different use cases.

Popular streaming systems

50 经验值

Streaming truths

100 经验值

Crossing the streams...

100 经验值

Real-world use case: streaming music service

50 经验值

Message components

100 经验值

Answer me this...

100 经验值

Real-world use case: sensor data

50 经验值

Great order of the SLAs

100 经验值

Sensor scaling considerations

100 经验值

Real-world use case: vaccination clinic

50 经验值

Vaccination clinic - classify areas

100 经验值

A new problem...

100 经验值

Congratulations!

50 经验值

Streaming Concepts

课程完成

获得成就证明

将此证书添加到你的 LinkedIn 档案、简历或履历中
在社交媒体和绩效评估中分享立即注册

加入超过19百万学习者，今天就开始Streaming Concepts！

创建您的免费帐户

或

继续操作即表示您接受我们的《使用条款》和《隐私政策》，并同意您的数据存储在美国。

通过 DataCamp for Mobile 提升您的数据技能

随时随地通过我们的移动课程和每日 5 分钟编程挑战提升技能。