Learn Data Skills
Bhavishya Karan

Bhavishya Karan

data

nyu

Technologies

Innovative thinker, shaping the future through data intelligence.

My Work

Take a look at my latest work.

course

Introduction to Power BI

course

Intermediate Python

DataCamp Course Completion

Take a look at all the courses I’ve completed on DataCamp.

My Work Experience

Where I've interned and worked during my career.

Trinity Industries, Inc. | Apr 2023 - Present

Data Engineer

N/A

RSA Security | May 2021 - Mar 2023

Data Engineer

β—† Developed ETL solutions to migrate data from existing on-Prem solutions to AWS services to create and maintain a cloud based Data Warehouse for storing business data for analytical reporting. β—† Designed pipelines using tools such as AWS Glue, AWS DMS, Kinesis and customized Python scripts to implement business rules, logic, cleansing for ingesting data on S3 buckets and Amazon Redshift and Snowflake. β—† Created and maintained Databricks notebooks for collaborating with business users and developers to provide robust analysis and setting up an environment for machine learning. β—† Responsible for transforming raw data into flattened files using ETL and SQL stored procedures. β—† Developed and maintained reusable Spark scripts to be used with AWS Glue for ETL implementation. β—† Automated and monitored the ETL processes run by Python queries using Airflow. Developed a robust alerting system to make sure issues are fixed in a timely manner. β—† Created BI Dashboards using AWS Quicksight and Power BI. Conducted Proof of Concepts for other potential tools such as Tableau which can be implemented at the organization level in the future. β—† Designed data models for consumption on Redshift from sources such as Salesforce and NetSuite. β—† Responsible for sizing, configuring, launching, and administrating Amazon Redshift clusters to host data for business analytics.
Show More

Amazon | Dec 2020 - May 2021

Business Intelligence Engineer

β—† Analyzed technical and business requirements for reporting requirements for the Transport Risk and Compliance team. β—† Built ETL pipelines for data extraction, transformation, loading, and integration, using internal ETL tools such as Datanet, AWS Glue and Hammerstone. β—† Worked on architecting the ETL transformation layers and wrote spark jobs for big data processing. β—† Implemented Apache Airflow for authoring, scheduling and monitoring Data Pipelines. β—† Responsible for developing and maintaining data services and data movement infrastructures. β—† Developed Power BI dashboards to visualize metrics to identify risks and ensure compliance with policy requirements. β—† Collaborated with third-party vendors to ingest data which helped Amazon keep in compliance with regional regulations. β—† Participated in the full software development lifecycle with requirements, solution design, development, QA implementation, and product support using Scrum and other Agile methodologies. β—† Prepared associated documentation for specifications, requirements, and testing.

Tata Consultancy Services | Client: Microsoft | Jan 2020 - Dec 2020

Data Warehousing Specialist

β—† Designed, built, and tested data pipelines leveraging Azure Databricks and Azure Data Factory. β—† Experienced in developing spark applications using spark sql and pyspark in Databricks for analyzing data from multiple data sources. β—† Hands-on experience with various Azure data storage solutions such as Azure Cosmos DB, Azure Data Lake Storage, and Azure Blob Storage. β—† Developed advanced analytical reports using machine learning tools for customer segmentation and forecasting. β—† Responsible for estimating the cluster size, monitoring, and troubleshooting the Spark Databricks cluster. β—† Part of Microsoft Gaming Data Services team responsible for building Data Marts & creating, enhancing and supporting reporting and analytical needs of the client for customer behavior analytics. β—† Designed and developed data models, reports and scorecards for various analytical needs across various products and services of Microsoft such as Xbox and PC Gaming. β—† Maintained data acquisition platform system for Gaming Data Services team and provided the desired data in an efficient way from various sources like Multidimensional cubes, Tabular cubes, SharePoint, Excel, Flat File, etc.

Blue Lotus | Nov 2019 - Jan 2020

Data Analyst

β—† Developed and implemented Cloud infrastructure using various platforms for customers. β—† Implemented fact-dimensional modeling (Star schema, Snowflake schema), transactional modeling and SCD. β—† Developed KPIs for customers in retails to report on stock inventory and P/L statements. β—† Created and maintained data reports in Cloud visualization tools such as Tableau and Power BI. β—† Implemented migration of on-premises infrastructure to cloud solutions such as AWS and Azure. β—† Developed Proof of Concept for migrating customer data to Cloud platforms including AWS and Azure.

Amazon | Jan 2019 - Sep 2019

Data Engineer/BI Developer

β—† Analyzed the business and technical environment for data requirements at EHS using established compliance guidelines. β—† Built and scaled out cloud environment in AWS using services such as Redshift, Lambda, DMS and Airflow to help migrate from existing AWS cloud accounts. β—† Implemented analytical data projects to create ETL pipelines from third-party databases to local redshift clusters using AWS Glue and AWS DMS services for reporting on compliance and action tasks assigned to site workers thus saving at least 20 hours of manual work every week. β—† Provided recommendations to reduce costs of existing AWS services by 30% and streamlined the data-pipelining process. β—† Performed gap and impact analysis to identify dependencies, roadblocks & risks in the implementation of agile methodology. β—† Enabled decision-making for global fulfillment centers around storage, transportation of hazmat and disposal of waste by implementing projects on compliance regulations i.e. OSHA, EPA, and WEEE. β—† Improved data quality in source systems by establishing a feedback mechanism between source teams and data brokers. β—† Developed reporting process for Amazon's donations to charities in lieu of disposing to landfills thus reducing compliance vendor bills.

Cable & Wireless Communications | Aug 2018 - Dec 2018

Data Analyst

β—† Analyzed and implemented complex data and business processes to create process maps to implement a customer targeting model for promotions and rewards cycles. Increased the revenues for the last quarter by 30% compared to last financial year. β—† Partnered with business consultants to implement projects for visualizing customer behavior, trends and identifying KPIs to reduce customer churn by 20%. β—† Implemented ETL projects using Informatica and RDS to migrate 25 TB data from vendor application to local Redshift storage. β—† Delivered visibility into customer demographics across 8 countries to develop customized marketing campaigns by reporting on KPIs. β—† Reduced ETL cost on AWS by 30% with reusable data pipeline design and optimizing around MPP capabilities of AWS Redshift.

Shutterfly, Inc. | Jan 2018 - Aug 2018

Business Intelligence Consultant/Developer

β—† Developed scope, processes and alternatives to optimize fulfillment strategy for the client and third-party sellers. β—† Guided the users with expertise to select a BI solution between Tableau, Domo and Incorta. Engaged with each vendor and created proofs of concept for the client to choose the tool best suited to the underlying technology stack. β—† Defined KPIs to show trends for business costs, the volume of products, profits and analyzed competition to provide actionable insights. β—† Developed ETL pipelines in Informatica to extract data from transactional systems and load it onto redshift for reporting key metrics for evaluating third- party sellers that led to an increase of 30% in order fulfillments. β—† Reduced run times of Tableau Dashboards by 80% by optimizing SQL queries and implementing Python scripts for data loads.

NYU Stern School of Business | Aug 2017 - Dec 2017

Graduate Teaching Fellow

β—† Tutored Stern students in the course Web and Mobile Application Development. β—† Helped to formulate a plan to implement technology projects pertaining to different industries. β—† Graded and helped students understand multiple quizzes and mid-term tests.

Thando's | Jan 2017 - May 2017

Data Analytics Intern

β—† Developed a brand communication and expansion strategy using data analytics for the client new to the US market. β—† Leveraged a variety of internal data sources to better understand and visualize shopper behaviour and drive value for the client. β—† Handled complete website migration to an e-commerce solution called Shopify.

Accenture | Dec 2012 - Dec 2015

BI Consultant/Data Analyst

β—† Developed a financial asset data solution for a client bank for portfolio/risk management and trade settlements. β—† Analyzed the business requirement and created ETL logic to extract data from flat files and relational tables coming from vendors, transform and load data in the data warehouse. β—† Successfully migrated 15 TB referential data from legacy systems to Informatica in three phases with 99.9% data accuracy. β—† Defined business and functional requirements of the client to create business rules, data models and ETL data flows. β—† Delivered multiple client projects gathering, integrating, and analyzing financial data for reporting to end-users for risk mitigation. β—† Developed SQL queries for ad hoc reporting on portfolios for financial advisors necessary for daily settlements. β—† Optimized dashboard refresh times by 30% through performance tuning on SQL queries and dashboard visualizations. β—† Worked with the client team to resolve defects of user acceptance testing and data issues for client handover.

Seasia Infotech | May 2012 - Dec 2012

Data Analyst

β—† Conducted analysis and reporting of inventory turnover, promotions and supply chain optimization for a retail client. β—† Developed, built and automated dashboards tracking KPIs related to Growth, Engagement and Revenue using R and SQL. β—† Assisted the Revenue Operations team in providing key stakeholders with actionable insights.

My Education

Take a look at my formal education

Master of Science,Β Information SystemsNew York University | 2018
Bachelor's degree,Β Computer ScienceGuru Nanak Dev University | 2012

Powered by

  • Work
  • Courses
  • Experience
  • Education
  • Create Your Data Portfolio for Free