Learn Data Skills
Beta
Igor de Oliveira Patrocinio

Igor de Oliveira Patrocinio

Data Engineer

Critical River | Juiz de Fora, Minas Gerais, Brazil

Technologies

My Portfolio Highlights

My New Course

Writing Efficient Python Code

My New Course

Object-Oriented Programming in Python

My New Track

Python Programmer

My New Course

Writing Efficient Python Code

Data Engineer. Passionate about solving problems.

My Work

Take a look at my latest work.

course

Data Manipulation in SQL

course

Data-Driven Decision Making in SQL

course

Cleaning Data in Python

course

Data Manipulation in SQL

My Certifications

These are the industry credentials that I’ve earned.

Other Certificates

Astronomer Astronomer Certification DAG Authoring for Apache Airflow

Astronomer Astronomer Certification for Apache Airflow Fundamentals

DataCamp Course Completion

Take a look at all the courses I’ve completed on DataCamp.

Courses

Introduction to Python
Intermediate Python
Data Manipulation with pandas
Understanding Data Engineering

My Work Experience

Where I've interned and worked during my career.

CriticalRiver Inc. | Oct 2023 - Present

Data Engineer

Working as Data Engineer in a technology and food delivery company based in the United States. - Maintain and create data pipelines to provide data in Snowflake. - Create Single Source of Truth (SSOT) tables and their ETLs. - Develop ad hoc requests from analytics teams, creating and scheduling ETLs as needed. - Implement data quality measures within the data pipelines. - Migrate ETL processes from an old to a new functional design. - Integrate observability and alerting mechanisms within the Data Pipeline. - Investigate and analyze the efficiency of the data pipelines. - Provide support to analysts and stakeholders regarding data-related issues.
Show More

Autoglass | Apr 2023 - Oct 2023

Data Engineer

- Work in a Hybrid Ecosystem: On-Premises and AWS. - Migrate the On-Premises data ecosystem (Oracle) to AWS cloud. - Implement the Delta Lakehouse Architecture. - Perform Data Ingestion into the Data Lake using CDC through Qlik/Attunity Replicate. - Develop PySpark scripts to perform ETL. - Execute PySpark scripts through AWS EMR Serverless. - Develop DAGs in Airflow for job orchestration. - Provide refined tables for consumption by users from different business areas.

Descomplica | Jun 2022 - Mar 2023

Data Engineer

- Work on the migration of the Data Lake from AWS (RDS) to GCP (BigQuery). - Collaborate with the Data Engineering Team to implement and maintain the Data Lake. - Develop Data Pipelines using Airflow and Python. - Work with data from different sources such as: Postgres, SQL Server, AWS Aurora, S3, APIs (Mixpanel, Hubspot and others), MongoDB, and Google Sheets. - Implement data quality metrics for the Data Lake. - Define data ingestion strategies. - Use Object-Oriented Programming in Airflow DAG development. - Maintain the deployment pipeline (Docker / Jenkins). - Develop Dashboards and Visualizations with Looker / Data Studio to monitor area KPIs. - Provide queries in Metabase with Data Lake data.

Afferolab | Jan 2021 - Jun 2022

Data Engineer

- Work alongside the Data Squad on deliveries using Agile Scrum Methodology. - Assist in the creation and maintenance of Data Lakes (Cloud Storage) and Data Warehouses (Big Query) in the GCP environment. - Assist in orchestrating Data Pipelines through Airflow in Google Cloud Composer. - Develop Python scripts for Airflow orchestration and Task Automation. - Work with the client, create Dashboards, and develop KPIs. - Document and create Data Architecture designs.

Afferolab | Aug 2019 - Jan 2021

Mid Level BI Analyst

- Automate/Optimize Excel Reports using Power Query. - Develop dashboards in Power BI using data visualization techniques and Data Storytelling. - Automate Dashboards through API connections and SQL (in MySQL and SQL Server databases). - Model and integrate data from different Platforms/Data Sources in the Power BI tool. - Program automatic data updates through Gateways/APIs/Cloud to Cloud Connections. - Create Data Flows in the Cloud (Power BI Service) for query reuse.

Afferolab | Oct 2016 - Aug 2019

Entry Level BI Analyst

- Work on studies for tracking metrics of Digital Products. - Develop Reports and Dashboards with Service Indicators for Internal and External Clients. - Create Reports on Employee Performance. - Enable the Support Team through the Management of the Service Desk Platform.

City Hall of Juiz de Fora | May 2013 - Mar 2014

Intern

- Budget spreadsheet control - Inventory control - Demand analysis - Material purchasing planning - Project and construction cost calculation - Quotation and acquisition of requested products - Contact with suppliers - Follow-up on purchases

My Education

Take a look at my formal education

Executive MBA, Big Data and Competitive Intelligence  · (SeptemberDescomplica | 2024
Strategic Business Management Pontifical Catholic University of Minas Gerais | 2017
Bachelor of Production Engineering Machado Sobrinho College | 2015

About Me

Igor de Oliveira Patrocinio

Data Engineer

Powered by

  • Work
  • Certifications
  • Courses
  • Experience
  • Education
  • About Me
  • Create Your Data Portfolio for Free