Climate Change and Impacts in Africa
According to the United Nations, Climate change refers to long-term shifts in temperatures and weather patterns. Such shifts can be natural, due to changes in the sun’s activity or large volcanic eruptions. But since the 1800s, human activities have been the main driver of climate change, primarily due to the burning of fossil fuels like coal, oil, and gas.
The consequences of climate change now include, among others, intense droughts, water scarcity, severe fires, rising sea levels, flooding, melting polar ice, catastrophic storms, and declining biodiversity.
You work for a Non-governmental organization tasked with reporting the state of climate change in Africa at the upcoming African Union Summit. The head of analytics has provided you with IEA-EDGAR CO2 dataset which you will clean, combine and analyze to create a report on the state of climate change in Africa. You will also provide insights on the impact of climate change on African regions (with four countries, one from each African region, as case studies).
Dataset
The dataset, IEA-EDGAR CO2, is a component of the EDGAR (Emissions Database for Global Atmospheric Research) Community GHG database version 7.0 (2022) including or based on data from IEA (2021) Greenhouse Gas Emissions from Energy, www.iea.org/statistics, as modified by the Joint Research Centre. The data source was the EDGARv7.0_GHG website provided by Crippa et. al. (2022) and with DOI.
The dataset contains three sheets - IPCC 2006, 1PCC 1996, and TOTALS BY COUNTRY on the amount of CO2 (a greenhouse gas) generated by countries between 1970 and 2021. You can download the dataset from your workspace or inspect the dataset directly here.
TOTALS BY COUNTRY SHEET
This sheet contains the annual CO2 (kt) produced between 1970 - 2021 in each country. The relevant columns in this sheet are:
| Columns | Description | 
|---|---|
| C_group_IM24_sh | The region of the world | 
| Country_code_A3 | The country code | 
| Name | The name of the country | 
| Y_1970 - Y_2021 | The amount of CO2 (kt) from 1970 - 2021 | 
IPCC 2006
These sheets contain the amount of CO2 by country and the industry responsible.
| Columns | Description | 
|---|---|
| C_group_IM24_sh | The region of the world | 
| Country_code_A3 | The country code | 
| Name | The name of the country | 
| Y_1970 - Y_2021 | The amount of CO2 (kt) from 1970 - 2021 | 
| ipcc_code_2006_for_standard_report_name | The industry responsible for generating CO2 ~~ | 
Instructions
The head of analytics in your organization has specifically asked you to do the following:
- Clean and tidy the datasets.
- Create a line plot to show the trend of CO2levels across the African regions.
- Determine the relationship between time (Year) andCO2levels across the African regions.
- Determine if there is a significant difference in the CO2levels among the African Regions.
- Determine the most common (top 5) industries in each African region.
- Determine the industry responsible for the most amount of CO2 (on average) in each African Region.
- Predict the CO2levels (at each African region) in the year 2025.
- Determine if CO2levels affect annualtemperaturein the selected African countries.
# Setup
import pandas as pd
import numpy as np
import pingouin
from sklearn.linear_model import LinearRegression
from statsmodels.regression.linear_model import OLS
import seaborn as sns
import matplotlib.pyplot as plt
import inspect
plt.style.use('ggplot')
# The sheet names containing our datasets
sheet_names = ['IPCC 2006', 'TOTALS BY COUNTRY']
# The column names of the dataset starts from rows 11
# Let's skip the first 10 rows
datasets = pd.read_excel('IEA_EDGAR_CO2_1970-2021.xlsx', sheet_name = sheet_names, skiprows = 10)
# we need only the African regions
african_regions = ['Eastern_Africa', 'Western_Africa', 'Southern_Africa', 'Northern_Africa']
ipcc_2006_africa = datasets['IPCC 2006'].query('C_group_IM24_sh in @african_regions')
totals_by_country_africa = datasets['TOTALS BY COUNTRY'].query('C_group_IM24_sh in @african_regions')
# Read the temperatures datasets containing four African countries
# One from each African Region:
# Nigeria:    West Africa
# Ethiopa :   East Africa
# Tunisia:    North Africa
# Mozambique: South Africa
temperatures = pd.read_csv('temperatures.csv')# The solution code and the test runner
import tests as runner
import solutions1. Clean and tidy the datasets
Tasks Performed
- Rename C_group_IM24_shtoRegion,Country_code_A3toCode, andipcc_code_2006_for_standard_report_nametoIndustryin the corresponding African datasets.
- Drop IPCC_annex,ipcc_code_2006_for_standard_report, andSubstancefrom the corresponding datasets.
- Melt Y_1970toY_2021into a two columnsYearandCO2. Drop rows whereCO2is missing.
- Convert Yeartointtype.
ipcc_2006_africa.columns
totals_by_country_africa.columns# Rename columns
ipcc_2006_africa = ipcc_2006_africa.rename(columns={
    'C_group_IM24_sh': 'Region',
    'Country_code_A3': 'Code',
    'ipcc_code_2006_for_standard_report_name': 'Industry'
})
totals_by_country_africa = totals_by_country_africa.rename(
        columns={
            'C_group_IM24_sh': 'Region',
            'Country_code_A3': 'Code'})
# Drop columns
ipcc_2006_africa = ipcc_2006_africa.drop(columns=['IPCC_annex', 'ipcc_code_2006_for_standard_report', 'Substance'])
totals_by_country_africa = totals_by_country_africa.drop(['IPCC_annex', 'Substance'], axis=1)
def melt_clean(df):
    value_vars = list(filter(lambda x: x.startswith('Y_'), df.columns))
    id_vars = list(set(df.columns).difference(value_vars))
    # melt
    long = df.melt(
        id_vars=id_vars,
        value_vars=value_vars,
        var_name='Year',
        value_name='CO2')
    # drop rows where co2 is missing
    long = long[~long.CO2.isnull()]
    # convert year to integer
    long.Year = long.Year.str.replace('Y_', '').astype(int)
    return long
ipcc_2006_africa = melt_clean(ipcc_2006_africa)
totals_by_country_africa = melt_clean(totals_by_country_africa)2. Show the trend of CO2 levels across the African regions
CO2 levels across the African regionsTasks Performed
- Using totals_by_country_africa, create a line plot ofCO2vs.Yearin eachRegionto show the trend of CO2 levels by year.
sns.set(style="darkgrid")
sns.lineplot(x="Year", y="CO2", hue="Region", data=totals_by_country_africa, ci=None)
plt.title('CO2 levels across the African Regions between 1970 and 2021')
plt.ylabel('CO2 (kt)')3. Determine the relationship between time (Year) and CO2 levels across the African regions
Year) and CO2 levels across the African regionsTasks Performed
- Using the totals_by_country_africadataset, conduct a Spearman's correlation to determine the relationship between time (Year) andCO2within each AfricanRegion.
- Save the results in a variable called relationship_btw_time_CO2.
# Group by Region and calculate Spearman's correlation
relationship_btw_time_CO2 = totals_by_country_africa.groupby('Region')[['Year', 'CO2']].corr(method='spearman')
relationship_btw_time_CO2 = totals_by_country_africa.groupby(
        'Region')[['Year', 'CO2']].corr(method='spearman')4. Determine if there is a significant difference in the CO2 levels among the African Regions
Tasks Performed
- Using totals_by_country_africa, conduct an ANOVA usingpingouin.anova()on theCO2byRegion. Save the results asaov_results.
- Conduct a posthoc test (with Bonferroni correction) using pingouin.pairwise_tests()to find the source of the significant difference. Save the results aspw_ttest_result.
- Is it true that the CO2levels of theSouthern_AfricaandNorthern_Africaregion do not differ significantly? The previous task should provide you with the answer.
# Conduct ANOVA
aov_results = pingouin.anova(data=totals_by_country_africa, dv='CO2', between='Region')
# Conduct posthoc test
pw_ttest_result = pingouin.pairwise_ttests(data=totals_by_country_africa, dv='CO2', between='Region', padjust='bonf')
# Check if Southern_Africa and Northern_Africa CO2 levels differ significantly
print(pw_ttest_result)No, it is not true that the CO2 levels of the Southern_Africa and Northern_Africa region do not differ significantly.
The p-adjust column shows the adjusted p-values for each comparison. The comparison between Northern_Africa and Southern_Africa has an adjusted p-value of 0.079, which is not less than 0.05, so we cannot reject the null hypothesis that CO2 levels do not differ significantly between the two regions.