Ozair Khan

• Provided technical leadership, stakeholder management, and direct client interaction to ensure smooth end-to-end migration from Oracle to BigQuery. • Developed automated pipeline for incremental and full load ETL processing, orchestrated through Apache NiFi and Airflow, with monitoring and alerting capabilities, reducing manual efforts and errors by 70%. • Designed robust staging and raw data management layers in BigQuery, to preserve data integrity and improve traceability. • Implemented a centralized data quality validation framework with custom checksum logic for real-time discrepancy detection between source and target systems. • Automated daily reporting to surface anomalies promptly, enabling proactive resolution, transparency on the overall migration progress and enhancing analytics reliability.

Impetus | Sep 2022 - Aug 2023

Lead Data Engineer

• Migrated legacy SAS system application to cloud-native architecture on Azure Data Factory and Databricks using PySpark, Delta Lake and ADLS Gen2. • Designed, developed and deployed complex pipeline automation and ensured high-quality, scalable deliverables. • Integrated data from multiple source systems, enabling unified analytics and business intelligence solutions.

Capgemini | Dec 2014 - Sep 2022

Senior Consultant

• Led a 15-member cross functional team with direct client interactions, delivering high-impact data migration projects and generating significant additional revenue. • Eliminated Ab Initio licensing costs by migrating workloads to other existing solutions, generating 900 man days of additional revenue. • Migrated successfully from on-premise to cloud with detailed planning for parallel execution, validations, cutover planning and decommissioning. • Designed reusable and configurable frameworks to export data from data warehouses to downstream sinks, improving developer productivity. • Redesigned and optimised critical business application "Monthly Revenue Per User (MoRPU)", reducing execution time by 80% and decoupling dependencies across 90 sources. • Implemented robust logging, exception handling and auditing, significantly improving issue detection and resolution turnaround. • Achieved substantial improvements in application performance and availability. • Analysed & reviewed business, functional and high-level technical requirements; designing detailed technical components for complex applications utilizing high-level architecture, design patterns and reusable code. • Created source to target mappings and physical data models to support scalable solutions and enforce enterprise-wide data standards and governance. • Provided technical leadership, established best practices and mentored team members.

UST | Jun 2014 - Nov 2014

System Analyst

• Optimized database code, implemented improved ETL orchestration strategies and parallel processing, improving overall performance by 90% and ensuring high quality deliverables.

Accelya Kale Solutions Limited | May 2013 - Jun 2014

Senior Programmer Analyst

• Worked on ETL development, developed, debugged and enhanced complex PL/SQL, shell scripting and Pro*C processes for the Revera- passenger revenue accounting product, significantly improving system functionality and reliability.

Capgemini | Jun 2010 - Apr 2013

Consultant

• Enhanced a demand forecasting and segmentations application system for a UK energy provider, developing new functionality and fixing existing issues to improve forecasting accuracy and performance. • Enabled more informed business decisions of whether to trade or generate the electricity to meet current (post half an hour) and future electricity and gas consumption demand of residential and business class customers by showing accurate forecasts. • Optimized data processes for a US telecom company by developing inventory tracking and vendor specific interfaces to filter data depending upon frontend search criteria that delivered XML output via message queues. • Received Project Star award for best performance – the first recipient in the project's eight year history – along with a written client commendation.

My Education

Take a look at my formal education

Bachelor of Engineering, Electronics and TelecommunicationAmrutvahini College of Engineering - AVCOE | 2009

About Me

Result oriented Senior Data Engineer with 15+ years of global experience specializing in cloud data engineering, large scale migrations, and big data development across diverse industries including Telecom, Airlines, Market Research and Energy domain

Create Your Data Portfolio for Free