Skip to content
Project: Designing a Bank Marketing Database
  • AI Chat
  • Code
  • Report

  • Personal loans are a lucrative revenue stream for banks. The typical interest rate of a two year loan in the United Kingdom is around 10%. This might not sound like a lot, but in September 2022 alone UK consumers borrowed around £1.5 billion, which would mean approximately £300 million in interest generated by banks over two years!

    You have been asked to work with a bank to clean and store the data they collected as part of a recent marketing campaign, which aimed to get customers to take out a personal loan. They plan to conduct more marketing campaigns going forward so would like you to set up a PostgreSQL database to store this campaign's data, designing the schema in a way that would allow data from future campaigns to be easily imported.

    They have supplied you with a csv file called "bank_marketing.csv", which you will need to clean, reformat, and split, in order to save separate files based on the tables you will create. It is recommended to use pandas for these tasks.

    Lastly, you will write the SQL code that the bank can execute to create the tables and populate with the data from the csv files. As the bank are quite strict about their security, you'll save SQL files as multiline string variables that they can then use to create the database on their end.

    You have been asked to design a database that will have three tables:

    client

    columndata typedescriptionoriginal column in dataset
    idserialClient ID - primary keyclient_id
    ageintegerClient's age in yearsage
    jobtextClient's type of jobjob
    maritaltextClient's marital statusmarital
    educationtextClient's level of educationeducation
    credit_defaultbooleanWhether the client's credit is in defaultcredit_default
    housingbooleanWhether the client has an existing housing loan (mortgage)housing
    loanbooleanWhether the client has an existing personal loanloan

    campaign

    columndata typedescriptionoriginal column in dataset
    campaign_idserialCampaign ID - primary keyN/A - new column
    client_idserialClient ID - references id in the client tableclient_id
    number_contactsintegerNumber of contact attempts to the client in the current campaigncampaign
    contact_durationintegerLast contact duration in secondsduration
    pdaysintegerNumber of days since contact in previous campaign (999 = not previously contacted)pdays
    previous_campaign_contactsintegerNumber of contact attempts to the client in the previous campaignprevious
    previous_outcomebooleanOutcome of the previous campaignpoutcome
    campaign_outcomebooleanOutcome of the current campaigny
    last_contact_datedateLast date the client was contactedA combination of day, month, and the newly created year

    economics

    columndata typedescriptionoriginal column in dataset
    client_idserialClient ID - references id in the client tableclient_id
    emp_var_ratefloatEmployment variation rate (quarterly indicator)emp_var_rate
    cons_price_idxfloatConsumer price index (monthly indicator)cons_price_idx
    euribor_three_monthsfloatEuro Interbank Offered Rate (euribor) three month rate (daily indicator)euribor3m
    number_employedfloatNumber of employees (quarterly indicator)nr_employed
    import pandas as pd
    import numpy as np
    
    # Start coding here...
    csv = 'bank_marketing.csv'
    data = pd.read_csv(csv)
    print(data.info())
    
    # Split the data into three DataFrames using information provided about the desired tables as your guide: one with information about the client, another containing campaign data, and a third to store information about economics at the time of the campaign
    client = pd.read_csv(csv, usecols=['client_id','age','job','marital','education','credit_default','housing','loan'])
    campaign = pd.read_csv(csv, usecols=['client_id','campaign','duration','pdays','previous','poutcome','y','day','month'])
    economics = pd.read_csv(csv, usecols=['client_id','emp_var_rate','cons_price_idx','euribor3m','nr_employed'])
    
    #Rename the column "client_id" to "id" in client
    client = client.rename(columns={'client_id': 'id'})
    
    #Rename the columns "duration" to "contact_duration", "previous" to "previous_campaign_contacts", "y" to "campaign_outcome", "poutcome" to "previous_outcome", and "campaign" to "number_contacts" in campaign
    campaign = campaign.rename(columns={'duration': 'contact_duration','previous':'previous_campaign_contacts','y':'campaign_outcome','poutcome':'previous_outcome','campaign':'number_contacts'})
    
    #Rename the columns "euribor3m" to "euribor_three_months" and "nr_employed" to "number_employed" in economics
    economics = economics.rename(columns={'euribor3m':'euribor_three_months','nr_employed':'number_employed'})
    
    #Clean the "education" column, changing "." to "_" and "unknown" to NumPy's null values
    client['education'] = client['education'].str.replace('.',"_")
    client['education'] = client['education'].replace('unknown',np.nan)
    
    #Remove periods from the "job" column
    client['job'] = client['job'].str.replace('.',"")
    
    #Convert "success" and "failure" in the "previous_outcome" and "campaign_outcome" columns to binary (1 or 0), along with the changing "nonexistent" to NumPy's null values in "previous_outcome"
    campaign['previous_outcome'] = campaign['previous_outcome'].map({'success':True,'failure':False})
    campaign['campaign_outcome'] = campaign['campaign_outcome'].map({'success':True,'failure':False})
    campaign['previous_outcome'] = campaign['previous_outcome'].replace('nonexistent',np.nan)
    
    #Add a column called campaign_id in campaign, where all rows have a value of 1
    campaign['campaign_id'] = 1
    
    #Create a datetime column called last_contact_date, in the format of "year-month-day", where the year is 2022, and the month and day values are taken from the "month" and "day" columns
    campaign['year'] = '2022'
    campaign["month"] = campaign["month"].str.capitalize()
    campaign['day'] = campaign['day'].astype(str)
    campaign["last_contact_date"] = campaign["year"] + "-" + campaign["month"] + "-" + campaign["day"]
    campaign["last_contact_date"] = pd.to_datetime(campaign["last_contact_date"], 
                                                   format="%Y-%b-%d")
    
    #Remove any redundant data that might have been used to create new columns, ensuring the columns in each subset of the data match the table displayed in the notebook.
    campaign.drop(columns=['month','day','year'], inplace=True)
    
    #Save the three DataFrames to csv files without an index as client.csv, campaign.csv, and economics.csv respectively.
    client.to_csv('client.csv',index=False)
    campaign.to_csv('campaign.csv',index=False)
    economics.to_csv('economics.csv',index=False)
    
    #Create a Python variable called client_table, containing SQL code as a multi-line string to create a table called client using values from client.csv
    client_table = """CREATE TABLE client
    (
        id SERIAL PRIMARY KEY,
        age INTEGER,
        job TEXT,
        marital TEXT,
        education TEXT,
        credit_default BOOLEAN,
        housing BOOLEAN,
        loan BOOLEAN
    );
    \copy client from 'client.csv' DELIMITER ',' CSV HEADER
    """
    
    #Create a Python variable called campaign_table, containing SQL code as a multi-line string to create a table called campaign using values from campaign.csv
    campaign_table = """CREATE TABLE campaign
    (
        campaign_id SERIAL PRIMARY KEY,
        client_id SERIAL references client (id),
        number_contacts INTEGER,
        contact_duration INTEGER,
        pdays INTEGER,
        previous_campaign_contacts INTEGER,
        previous_outcome BOOLEAN,
        campaign_outcome BOOLEAN,
        last_contact_date DATE    
    );
    \copy campaign from 'campaign.csv' DELIMITER ',' CSV HEADER
    """
    
    #Create a Python variable called economics_table, containing SQL code as a multi-line string to create a table called economics using values from economics.csv
    economics_table = """CREATE TABLE economics
    (
        client_id SERIAL references client (id),
        emp_var_rate FLOAT,
        cons_price_idx FLOAT,
        euribor_three_months FLOAT,
        number_employed FLOAT
    );
    \copy economics from 'economics.csv' DELIMITER ',' CSV HEADER
    """