Skip to main content
HomeData EngineeringStreaming Concepts

Streaming Concepts

Learn about the difference between batching and streaming, scaling streaming systems, and real-world applications.

Comece O Curso Gratuitamente
2 Horas16 Videos47 Exercicios
2.695 AprendizesTrophyDeclaração de Realização

Create Your Free Account

GoogleLinkedInFacebook

or

By continuing, you accept our Terms of Use, our Privacy Policy and that your data is stored in the USA.
GroupTreinar 2 ou mais pessoas?Experimente o DataCamp For Business

Loved by learners at thousands of companies

Descrição do Curso

Streaming is a huge aspect of the data world right now and is being used by nearly every industry from manufacturing to healthcare. Would you like to learn more about the general concepts behind data pipelines and how the processes work?

This course provides a general introduction to streaming concepts including batching, queuing, and stream processing along with where they fit into data processing frameworks. It covers real-world examples of how streaming is implemented in production. It is designed as a general introduction to these concepts and does not require an extensive background in data processing.
Para Empresas

GroupTreinar 2 ou mais pessoas?

Obtenha acesso à biblioteca completa do DataCamp, com relatórios, atribuições, projetos e muito mais centralizados
Experimente O DataCamp for BusinessPara uma solução sob medida , agende uma demonstração.
  1. 1

    Methods for Processing Data

    Grátis

    In this chapter, you’ll be given an introduction to basic concepts in batch data processing, revolving around implementation, scaling, and potential challenges during use.

    Reproduzir Capítulo Agora
    Intro to batch processing
    50 xp
    Batch characteristics
    100 xp
    Batch ordering
    100 xp
    Scaling batch processing
    50 xp
    On the scale
    100 xp
    Horizontally opposed
    50 xp
    Batch issues
    50 xp
    Batch problems
    50 xp
    Batch scenarios
    100 xp
  2. 2

    Intro to Streaming

    Here, you’ll learn about the basics of streaming, event-based data processing, and the advantages over traditional batch-based data processing.

    Reproduzir Capítulo Agora
    Intro to event-based computing
    50 xp
    In the event of...
    100 xp
    Welcome to the event!
    100 xp
    Queuing
    50 xp
    Queue characteristics
    100 xp
    To queue or not to queue
    100 xp
    Single system data streaming
    50 xp
    Log stream order
    100 xp
    Log options
    100 xp
    Batching vs. streaming
    50 xp
    Batch, queue, or stream?
    100 xp
    Log stream processor
    100 xp
  3. 3

    Streaming Systems

    This chapter introduces the concepts behind modern streaming systems, how to scale them, and some of the issues found in using streaming processes.

    Reproduzir Capítulo Agora
    Intro to real-time streaming
    50 xp
    Real-time?
    100 xp
    Is it real this time?
    100 xp
    Vertically scaling streaming systems
    50 xp
    Scaling reasons
    50 xp
    To vertically scale...?
    100 xp
    Horizontally scaling streaming systems
    50 xp
    Upscaled out
    100 xp
    SLA guarantees
    100 xp
    Streaming roadblocks
    50 xp
    Streaming attributes
    100 xp
    Issue types
    100 xp
    Streaming challenges
    100 xp
  4. 4

    Real-World Use Cases

    In this final chapter, you’ll learn about common streaming systems and consider the implementation of streaming data processing in different use cases.

    Reproduzir Capítulo Agora
    Popular streaming systems
    50 xp
    Streaming truths
    100 xp
    Crossing the streams...
    100 xp
    Real-world use case: streaming music service
    50 xp
    Message components
    100 xp
    Answer me this...
    100 xp
    Real-world use case: sensor data
    50 xp
    Great order of the SLAs
    100 xp
    Sensor scaling considerations
    100 xp
    Real-world use case: vaccination clinic
    50 xp
    Vaccination clinic - classify areas
    100 xp
    A new problem...
    100 xp
    Congratulations!
    50 xp
Para Empresas

GroupTreinar 2 ou mais pessoas?

Obtenha acesso à biblioteca completa do DataCamp, com relatórios, atribuições, projetos e muito mais centralizados

Colaboradores

Collaborator's avatar
Hadrien Lacroix
Collaborator's avatar
Kelsey McNeillie

Pre Requisitos

Understanding Data Engineering
Mike Metzger HeadshotMike Metzger

Data Engineer Consultant @ Flexible Creations

Veja Mais

O que os outros alunos têm a dizer?

    Cadastre-se mais 13 milhões de alunos e comece Streaming Concepts Hoje!

    Create Your Free Account

    GoogleLinkedInFacebook

    or

    By continuing, you accept our Terms of Use, our Privacy Policy and that your data is stored in the USA.