Learn Data Skills
Beta
bijith komalan

bijith komalan

Architect

NTT Data | India

Technologies

My Portfolio Highlights

My New Track

Python Fundamentals

My New Course

Introduction to Python

My New Track

Python Fundamentals

Data ninja, stealthily extracting insights from complex datasets.

My Work

Take a look at my latest work.

course

Introduction to SQL

DataLab

Course Notes: Database Design

course

Introduction to Python

course

Introduction to SQL

DataCamp Course Completion

Take a look at all the courses I’ve completed on DataCamp.

Courses

Introduction to Python
Introduction to SQL
Introduction to R
Intermediate SQL

My Work Experience

Where I've interned and worked during my career.

Apisero Inc. | Sep 2021 - Present

Solutions Architect

Skills: Python, PySpark, Azure, Kubernetes, Docker, Elastic Search, FastAPI, SQL Server, Oracle, Snowflake, PowerBI,Kafka, Azure Event Hub,Azure Data Factory -Leading a team of 10 developers -Involved in the migration of a data engineering platform from Sql Server to Snowflake cloud Data warehouse -Designed and implemented multi tenant containerized cloud application in Azure -Implemented the migration of PowerBI reports from SQL Server source to snowflake. - Designing a data management platform in Azure Data Factory -Lead the team in the Implementation of CI/CD pipeline in Jenkins -Leading the team to onboard new clients into the new DMS Platform on Azure
Show More

UST Global | Mar 2020 - Jun 2021

Application Architect

Skills: Python, PySpark, Azure, Kubernetes, Docker, Elastic Search, Flask, Mysql, Mongo Architect in a ML Engineering team Rest API Development using Python, Flask, ElasticSearch, MongoDB Design and Implemented a streaming service with Pyspark and Kafka Developing Docker scripts and Kubernetes config files for deployment in Azure Mentoring junior resources in the team

Trianz | Apr 2018 - Mar 2020

Architect

Placed in client site - Netapp India Pvt Ltd Conceptualized and Implemented a parsing micro service for XML data in Python Integration of the microservice to a Big Data Service in Spark Streaming and Kafka The Spark service is written in Scala and microservice is written in Java Designing and Implementing a greenfield Data Science project with Frontend in Angular4 and Backend Services in Python/Flask.

Crystal Equation Corporation | Sep 2017 - Feb 2018

BI Operations Engineer @ Facebook

• Provide Oncall support to Facebook Data pipelines • Build Data pipelines using Dataswarm (Python Library) • Build Big Data solutions using Hive and Presto

Insight Centre for Data Analytics | Mar 2017 - Aug 2017

Research Assistant

Skills Used: Python, Pandas, Vagrant, AWS, Scikit Learn • Responsible for Data extraction, cleansing and Integration of Linked & Web Data • Building analytic tools with scikit learn,Pandas, tensorflow

MaREI | Mar 2016 - Mar 2017

Research Support Officer

Skills Used: Python, PHP, JavaScript, PostgreSQL, Angular2, Django, R • Working on Online Geographical Information systems • Developed PIPS Data Portal Using Angular2 and Django. • Working on Major modules in the AquaCross Platform an Online data management portal for spatial data funded by UNESCO • AquaCross is a Project developed using CKAN a Python Framework which uses the Jinja templating language and JQuery for Frontend and Python for Backend. • R is used to do offline user and data management

NetApp | Jun 2009 - Aug 2014

Member Technical Staff(MTS3)

Skills: Perl, Java, Oracle, Hadoop, Shell Script, Oracle, Hive • Researched, designed and developed a Load balancer System • Implemented using Perl and Shell Script • Was involved in the Data cleaning part of a Data Warehouse Team. • Data Cleaning was performed using Perl parsers using regular expressions • Was involved in porting applications to the Hadoop Platform • Worked on mappers written in Perl and Reducers written in Java • Owned and Lead 4 critical application teams • All 4 critical applications were implemented in Perl for file ingestion and retention • Worked in APL Loader an Log processing Platform in Java and Hive • Lead teams in driving changes and performance optimization initiatives • Worked on creating specs for changes and new feature requirement • Lead performance optimization initiatives that has brought about 90% performance improvements • Coordinated the efforts of multiple teams in resolving infrastructural issues • Lead the efforts of both engineering and support teams in deployment • and troubleshooting activities • Mentored team members from both engineering and support teams • Was awarded the Netapp Spot award for project excellence • Filed Netapp NIR(New Invention Report) , precursor to a patent

Prithvi Information Solutions | Aug 2008 - May 2009

System Analyst

Skills: PHP, MySQL • Lead a team of 4 developers in building an online platform for property valuation • The platform provided means to track a property right from the moment it is taken up for valuation and to the point where a valuation report for the property is created. • Implemented using PHP, MySQL • Lead the project from start to finish and won client appreciation • Successfully trained a team of 3 engineers in PHP and made them productive in 3 weeks

Marlabs | Sep 2005 - Mar 2008

Member Technical/Sr Member Technical/Project Lead

Skills : Perl, Oracle • Member of the developing team developing an online platform to facilitate Ad Campaigns • The tool provided utilities to develop content for the ad campaigns , to schedule the campaigns and trackers to measure the effectiveness of the campaign • Implemented using Perl, MySQL • Lead a team of 2 engineers each in 2 critical modules • Was invited to work alongside the overseas client team in Toronto, Canada in delivering a critical project

TA | Aug 2004 - Aug 2005

Member Technical

Skills:Perl,Python,MySQL • Developed and Implemented Web crawling tools in Perl ,MySQL • Developed and Implemented Natural Language Processing Tools using Python • Developed and Implemented utility tools that would improve the functional staff productivity • Implemented using Perl, PHP, MySQL

Cybernet Software Systems | Jan 2003 - Jul 2004

Assistant System Analyst

Skills:PHP,PostgreSQL • Member in the overseas delivery team of Sourceforge Enterprise edition an online project management tool. • Sourceforge provided an online platform for managing a project it provided a document store to consolidate all project documentation, a bug tracker, Timesheet tracker and other Project Management utilities • Worked in PHP, PostgreSQL

Spectrum Softech Solutions | Aug 2001 - Dec 2002

Programmer

Skills:Perl,PHP,MySQL • Developed an online lead management system for the Marketing department which helped them to track the history of a lead, right from the moment of generation to conversion as a customer, also helped the company to track the reasons of a non-conversion of a lead • Developed Online Leave Management system for the HR department which provided an online platform for applying and approving leaves and also help each employee to keep track of his leave balance • Implemented using Perl, PHP, MySQL

My Education

Take a look at my formal education

Msc Data science and Analytics, Data ScienceUniversity College Cork | 2015
MCA, Computer ScienceBharathiar University | 2001
Bcom, Commerce,Financial Accounting, Cost AccountingMahatma Gandhi University | 1997
PDC, Pysics,Chemistry,MathsMahatma Gandhi University | 1994
SSLC, Maths,Science,Social Studies,LanguagesRajaGiri HS | 1992

Powered by

  • Work
  • Courses
  • Experience
  • Education
  • Create Your Data Portfolio for Free