Interactive Course

Parallel Programming in R

This course covers in detail the tools available in R for parallel computing.

  • 4 hours
  • 15 Videos
  • 55 Exercises
  • 999 Participants
  • 4,350 XP

Loved by learners at thousands of top companies:

siemens-grey.svg
rei-grey.svg
dell-grey.svg
ikea-grey.svg
intel-grey.svg
nielsen-grey.svg

Course Description

With an increasing amount of data and more complex algorithms available to scientists and practitioners today, parallel processing is almost always a must, and in fact, is expected in packages implementing time-consuming methods. This course introduces you to concepts and tools available in R for parallel computing and provides solutions to a few important non-trivial issues in parallel processing like reproducibility, generating random numbers and load balancing.

  1. 1

    Can I Run My Application in Parallel?

    Free

    In order to take advantage of parallel environment, the application needs to be split into pieces. In this introductory chapter, you will learn about different ways of partitioning and how it fits different hardware configurations. You will also be introduced to various R packages that support parallel programming.

  2. foreach, future.apply and Load Balancing

    In this chapter, you will look at two user-contributed packages, namely foreach and future.apply, which make parallel programming in R even easier. They are built on top of the parallel and future packages. In the last lesson of this chapter, you will learn about the advantages and pitfalls of load balancing and scheduling.

  3. The parallel Package

    This chapter will dive deeper into the parallel package. You'll learn about the various backends and their differences and get a deep understanding about the workhorse of the package, namely the clusterApply() function. Strategies for task segmentation including their pitfalls will also be discussed.

  4. Random Numbers and Reproducibility

    Now you might ask, can I reproduce my results if the application uses random numbers? Can I generate the same results regardless of if the code runs sequentially or in parallel? This chapter will answer these questions. You will learn about a random number generator well suited to a parallel environment and how the various packages make use of it.

  1. 1

    Can I Run My Application in Parallel?

    Free

    In order to take advantage of parallel environment, the application needs to be split into pieces. In this introductory chapter, you will learn about different ways of partitioning and how it fits different hardware configurations. You will also be introduced to various R packages that support parallel programming.

  2. The parallel Package

    This chapter will dive deeper into the parallel package. You'll learn about the various backends and their differences and get a deep understanding about the workhorse of the package, namely the clusterApply() function. Strategies for task segmentation including their pitfalls will also be discussed.

  3. foreach, future.apply and Load Balancing

    In this chapter, you will look at two user-contributed packages, namely foreach and future.apply, which make parallel programming in R even easier. They are built on top of the parallel and future packages. In the last lesson of this chapter, you will learn about the advantages and pitfalls of load balancing and scheduling.

  4. Random Numbers and Reproducibility

    Now you might ask, can I reproduce my results if the application uses random numbers? Can I generate the same results regardless of if the code runs sequentially or in parallel? This chapter will answer these questions. You will learn about a random number generator well suited to a parallel environment and how the various packages make use of it.

What do other learners have to say?

Devon

“I've used other sites, but DataCamp's been the one that I've stuck with.”

Devon Edwards Joseph

Lloyd's Banking Group

Louis

“DataCamp is the top resource I recommend for learning data science.”

Louis Maiden

Harvard Business School

Ronbowers

“DataCamp is by far my favorite website to learn from.”

Ronald Bowers

Decision Science Analytics @ USAA

Hana Sevcikova
Hana Sevcikova

Senior Research Scientist, University of Washington

Hana works as a senior research scientist at the University of Washington’s Center for Statistics and the Social Sciences, in the area of statistical computing. She also works as a data scientist at the Puget Sound Regional Council in Seattle. She has been involved in projects advancing parallel computing in statistics. She contributed to the snow package which became the R core package parallel. She developed a methodology for fault tolerant and reproducible parallel computing, implemented in snowFT, as well as the first interface to the L’Ecuyer's random number generator, the rlecuyer package. Currently, she’s been working in the area of statistical demography, developing R packages used by the United Nations for projecting demographic indicators for all countries of the world.

See More
Collaborators
  • Richie Cotton

    Richie Cotton

  • Benjamin  Feder

    Benjamin Feder

Icon Icon Icon professional info