Learn Data Skills
Divyam Srivastava

Divyam Srivastava

Data Engineer

Deloitte USI | Bangalore

Technologies

My Portfolio Highlights

My New Course

Understanding Data Engineering

My New Course

Understanding Data Engineering

A Data enthusiast currently working as a data engineer and interested in exploring the depths of the domain.

My Work

Take a look at my latest work.

course

Understanding Data Engineering

PythonSQLBigQuery
course

Understanding Data Engineering

PythonSQLBigQuery

DataCamp Course Completion

Take a look at all the courses I’ve completed on DataCamp.

Courses

Introduction to SQL
Intermediate SQL
Joining Data in SQL
Understanding Data Engineering

My Work Experience

Where I've interned and worked during my career.

Deloitte USI | Jan 2022 - Present

Data Engineer

For client CTRMA Developed Cloud Run and Cloud Function scripts in Python for data extraction, loading, and transformation tasks. Implemented automation solutions using SQL and Python with SQL Alchemy to generate email alerts for system monitoring. Utilized BigQuery for data reporting and created Looker dashboards to enhance data reporting and visualization. Designed and executed Data Fusion pipelines to migrate data from PostgreSQL Database to BigQuery - Operational Data Store (ODS) layer and Data Warehouse (DWH) layers. Achieved significant reductions in manual tasks through Python-based automations. Improved system monitoring capabilities with automated email alerts. Contributed to enhancing data reporting capabilities through effective utilization of BigQuery and Looker dashboards. Ensured seamless data migration processes with the design and execution of Data Fusion pipelines. Familiar with Google Apigee for API management, utilized for monitoring system performance. For Thomson Reuters onboarded 4 profiles to AWS cloud from legacy systems, leveraging AWS Glue, Step Functions, Lambda, and other AWS services. Utilized Fargate for pre-processing data to be used by Glue and stored in S3. Developed multi-record processing Glue conversion jobs for map-reduce and data transformation to XML format. Managed profile metadata using Aurora database and performed data analysis using Athena. Proficient in core development with Boto3 and stack deployments using sam-cli and CloudFormation. Conducted a proof of concept on Data Reconciliation using AWS services such as Lambda, CloudWatch, S3, DynamoDB, and Athena.
Show More

Titan|Flock (Directi) | Sep 2019 - Dec 2021

Product Support Engineer

In Flock Products work on/for and with: Flock, Titan, Radix, Explore. Developed dashboards and reports for internal team analysis and discussions with business partners using Explore. Collaborated with the Data Science team to gain insights into the Data Science profile and created data dashboards and reports in Metabase and Explore for industrial exposure. Producing documentation for the help center to provide guidelines and structure for the application and product. Assistance with regard to email services and troubleshooting with command line logs for the client-side applications using Kibana and other internal tools. Communicating and managing issues faced by partner companies on a B2B level.

My Education

Take a look at my formal education

Post Graduate Program in Data Science and Business AnalyticsUniversity of Texas At Austin | 2021
B.Tech in Computer ScienceInderprastha Engineerning College | 2015

About Me

Divyam Srivastava

I am looking for a job in Data Engineering or Data Science area. Currently working as a Data Engineer. Would be interested to get an exposure towards Data Science domain as well.

Powered by

  • Work
  • Courses
  • Experience
  • Education
  • About Me
  • Create Your Data Portfolio for Free