Skip to main content

Introduction to Bash Scripting

Bash scripting allows you to build analytics pipelines in the cloud and work with data stored across multiple files.

Start Course for Free
4 Hours13 Videos43 Exercises17,840 Learners3350 XPData Engineer Track

Create Your Free Account

GoogleLinkedInFacebook

or

By continuing, you accept our Terms of Use, our Privacy Policy and that your data is stored in the USA. You confirm you are at least 16 years old (13 if you are an authorized Classrooms user).

Loved by learners at thousands of companies

Course Description

Bash is a concise, superfast, and robust scripting language for data and file manipulation. It’s a vital skill for building analytics pipelines in the cloud, favored by Linux users to work with data stored across multiple files. In this course, we’ll guide you through the basics of Bash scripting. We begin with an introduction to Bash script structures, including inputting arguments and outputting results. You’ll then work through data structures, such as variables and arrays, and control statements, including loops and conditionals. You’ll then put what you’ve learned into practice, by creating your own Bash functions and scheduling automated scripts to run like clockwork with cron.

  1. 1

    From Command-Line to Bash Script

    Free

    Save yourself time when performing complex repetitive tasks. You’ll begin this course by refreshing your knowledge of common command-line programs and arguments before quickly moving into the world of Bash scripting. You’ll create simple command-line pipelines and then transform these into Bash scripts. You’ll then boost your skills and learn about standard streams and feeding arguments to your Bash scripts.

    Play Chapter Now
    Introduction and refresher
    50 xp
    Extracting scores with shell
    50 xp
    Searching a book with shell
    50 xp
    Your first Bash script
    50 xp
    A simple Bash script
    100 xp
    Shell pipelines to Bash scripts
    100 xp
    Extract and edit using Bash scripts
    100 xp
    Standard streams & arguments
    50 xp
    Using arguments in Bash scripts
    100 xp
    Using arguments with HR data
    100 xp
  2. 2

    Variables in Bash Scripting

    Master the bread and butter of Bash scripts—variables! In this chapter, you’ll learn how to create basic string and numeric variables, and perform calculations on these variables. You’ll also learn about the magic of a shell-within-a-shell (shell-ception), opening up huge opportunities for advanced scripting.

    Play Chapter Now
    Basic variables in Bash
    50 xp
    Using variables in Bash
    100 xp
    Shell within a shell
    50 xp
    Numeric variables in Bash
    50 xp
    Converting Fahrenheit to Celsius
    100 xp
    Extracting data from files
    100 xp
    Arrays in Bash
    50 xp
    Creating an array
    100 xp
    Creating associative arrays
    100 xp
    Climate calculations in Bash
    100 xp
  3. 3

    Control Statements in Bash Scripting

    Life isn't always linear and neither should your Bash scripts. In this chapter, you’ll take your Bash scripts to the next level by learning control statements. You’ll learn the differences between FOR, WHILE, IF, and CASE statements and how to use them in your Bash scripts. Armed with these new tools, you’ll be ready to create more advanced Bash scripts with conditional logic.

    Play Chapter Now
    IF statements
    50 xp
    Sorting model results
    100 xp
    Moving relevant files
    100 xp
    FOR loops & WHILE statements
    50 xp
    A simple FOR loop
    100 xp
    Correcting a WHILE statement
    50 xp
    Cleaning up a directory
    100 xp
    CASE statements
    50 xp
    Days of the week with CASE
    100 xp
    Moving model results with CASE
    100 xp
    Finishing a CASE statement
    50 xp
  4. 4

    Functions and Automation

    Give your Bash scripts a powerful new addition by building useful functions to process data and variables. In this last chapter, you will learn the structure of functions in Bash, how to use functions to help automate frequent tasks, and program your scripts to run on schedule without needing to even lift a finger.

    Play Chapter Now
    Basic functions in Bash
    50 xp
    Uploading model results to the cloud
    100 xp
    Get the current day
    100 xp
    Arguments, return values, and scope
    50 xp
    A percentage calculator
    100 xp
    Sports analytics function
    100 xp
    Summing an array
    100 xp
    Scheduling your scripts with Cron
    50 xp
    Analyzing a crontab schedule
    50 xp
    Creating cronjobs
    100 xp
    Scheduling cronjobs with crontab
    100 xp
    Thanks and wrap up
    50 xp

In the following tracks

Data Engineer

Datasets

New HiresSoccer ScoresHire DataModel ResultsRob's FilesModel OutputInherited Folder

Collaborators

maggiematsuiMaggie Matsuilis-sulmontLis Sulmont

Prerequisites

Introduction to Shell
Alex Scriven Headshot

Alex Scriven

Data Scientist @ New South Wales Government

Alex is a Data Scientist working for the New South Wales Government in Sydney, Australia. He is also a Lecturer at the University of Technology Sydney where he teaches into several courses in their Master of Data Science & Innovation program in machine learning & deep learning. He is also a partner of a boutique data analytics firm, Madlytics and is passionate about building communities around technology & entrepreneurship.
See More

What do other learners have to say?

I've used other sites—Coursera, Udacity, things like that—but DataCamp's been the one that I've stuck with.

Devon Edwards Joseph
Lloyds Banking Group

DataCamp is the top resource I recommend for learning data science.

Louis Maiden
Harvard Business School

DataCamp is by far my favorite website to learn from.

Ronald Bowers
Decision Science Analytics, USAA