Beta

Muhammad Hasbi

Certified

Data Engineer

Cloud Kinetics | Jakarta Barat, DKI Jakarta, Indonesia

Technologies

My Portfolio Highlights

My New Workbook

Competition - HR Analytics in Tableau

My New Workbook

Competition - HR Analytics in Tableau

Highly experienced Data Engineer with 8+ years in building and optimizing scalable data platforms. Expertise in end-to-end data engineering. Passionate about creating robust, cost-effective data solutions to drive analytics and AI.

My Work

Take a look at my latest work.

DataLab

Competition - HR Analytics in Tableau

github

hasbi93 (Muhammad Hasbi) · GitHub

PythonSQLSnowflake

DataLab

Competition - HR Analytics in Tableau

My Certifications

These are the industry credentials that I’ve earned.

Data Analyst Associate

Data Engineer Associate

Data Engineer

Python Data Associate

AI Engineer for Data Scientists Associate

Data Scientist Associate

SQL Associate

AI Fundamentals

Data Literacy

DataCamp Course Completion

Take a look at all the courses I’ve completed on DataCamp.

Courses

Understanding Artificial Intelligence

Courses

Understanding Artificial Intelligence

My Work Experience

Where I've interned and worked during my career.

Cloud Kinetics | Jul 2025 - Present

Data Engineer

Service Delivery Department Responsibilities: • Managed Project Implementation data architecture and pipelines that adhere to ETL principles and business goals. • Solve complex data problems to deliver insights that helps the organization’s business to achieve their goals. • Create data products for analytics and data scientist team members to improve their productivity • Managed implementation and deployment of emerging tools and processes for analytic data engineering in order to improve the organization’s productivity as a team. • Develop and deliver communication and education plans on analytic data engineering capabilities, standard and processes. • Partner with business analyst and solution architects to develop technical architectures for strategic enterprise projects and initiatives. • Learn about machine learning, data science, computer vision, artificial intelligence, statistics, and/or applied mathematics. • Deliver Sharing Knowledge related to Data engineering, analytics to member organizations.

PT. Mastersystem Infotama, Tbk. | Jan 2024 - Jun 2025

Senior System Engineer - Data & AI

Data & AI Department, Cloud & Security DIvision Responsibilities: Data Engineering: - Developed and implemented an AWS ETL Dashboard to streamline data extraction, transformation, and loading processes, significantly enhancing data processing efficiency for machine learning applications. - Established a comprehensive Data Platform using AWS tools such as AWS Step Functions, AWS Lambda, Amazon Athena, Amazon Redshift, AWS Glue, AWS S3, AWS Secrets Manager, and AWS CloudWatch, facilitating efficient data management and analysis for machine learning models. - Spearheaded data engineering initiatives by constructing and optimizing data pipelines, databases, and data warehouses to ensure scalability and meet the increasing demands of machine learning workloads. AWS/IBM AI Development: - Built and deployed AI solutions using AWS Bedrock, leveraging foundation models like Titan and Anthropic Claude (Haiku, Instant) for various applications. - Developed and integrated Amazon Q and Amazon Kendra for advanced knowledge management and search capabilities within AI applications. - Implemented LangChain framework for building applications with LLMs, utilizing RAG techniques for accurate and contextually relevant responses. - Engineered effective prompts to optimize LLM performance and achieve desired outputs. - Developed AI backend infrastructure using FastAPI and Swagger, ensuring efficient and scalable API endpoints for AI models using Python 3. - Created AI-powered dashboards using Dash for batch processing and analysis of data. - Developed real-time AI streaming applications using native JavaScript for seamless user experiences. - Built AI-driven user interfaces with Horizon AI, React, and Next.js, enhanced with Chakra UI for modern and responsive design. - Deployed a Gemini Flash 1.5 chatbot on Vercel using Next.js for interactive conversational experiences. - Integrated IBM Watson services (Watson X, Watson Assistant) into applications for enhanced AI capabilities.

PT. Sicepat Ekspres Indonesia | Mar 2022 - Jan 2024

Senior Data Engineer

IT Data Department, IT Engineering Division, Technology Directorate Responsibilities: - Cloud Data Platform Management: Architected scalable data pipelines using Databricks and AWS (Redshift, S3, EC2), optimizing for machine learning workflows. - Data Processing and Analysis: Developed and ran batch and near real-time data processing jobs with PySpark and Spark on Databricks clusters, leveraging Databricks Notebooks for seamless ML model data preparation. - Data Integration and Management: Integrated datasets across production, staging, and data mart environments, ensuring consistent and reliable data flow for machine learning model training and evaluation. - Database Management: Administered Databricks SQL and Redshift to handle large datasets required for ML feature engineering and analysis, maintaining optimal performance. - Automation and Orchestration: Automated data pipelines within Databricks, orchestrating complex workflows with Apache Airflow to streamline machine learning pipelines. - Cluster Management: Managed data engineering clusters, provisioning Python 3, Pandas, and PySpark environments for data transformation, analysis, and model training support. - Data Visualization and Reporting: Designed dashboards using Dash Plotly to provide the IT Data Department with insights from ML-driven data analysis, supporting data-informed decision-making. - Business Intelligence Tools: Used Metabase to generate reports and summaries that feed into business intelligence, aligning insights with machine learning outcomes. - Version Control and Containerization: Managed code with Git for collaboration, and containerized applications using Docker for deploying data engineering solutions that support machine learning models efficiently.

PT. Mitra Integrasi Informatika | Jan 2019 - Mar 2022

Technical Consultant Associate - Data Engineer

Big Data and Analytics-2 Departement, Analytics Division, PT. Mitra Integrasi Informatika, Member of PT. Metrodata Electronics, TBK. Responsibilities: - Data Platform Expertise: Managed large-scale data engineering projects using Talend Real-Time Big Data Platform, Cloudera Enterprise Data Platform, and Google Cloud Platform (GCP), ensuring optimized pipelines for machine learning workflows. - Data Analysis & Tool Proficiency: Utilized BigQuery, Cloud Data Fusion, Cloud Composer, and Python3 to handle and analyze complex datasets, enabling effective data preparation for ML models. - Platform & Technology Integration: Designed and implemented robust data solutions for diverse machine learning projects using GCP, Cloudera, Talend, NoSQL, and Hadoop, ensuring seamless data management. - Process Optimization: Streamlined complex data structures and optimized workflows, improving efficiency in the data pipeline for machine learning model training and performance. - Actionable Insights Generation: Analyzed data to uncover insights, leveraging expertise in data engineering to address challenges that impact machine learning pipeline outputs.

PT. XSIS Mitra Utama | Oct 2016 - Dec 2018

Software Engineer

IT Expert Division, PT. XSIS Mitra Utama, Member of Equine Technology Group. Responsibilities: - Full-Stack Web Application Development: Developed comprehensive web applications, integrating frontend, backend, and database components to manage data essential for machine learning models and processing pipelines. - Technology Stack Implementation: Utilized JavaScript, PHP (with Bootstrap, CodeIgniter), and Java EE (with Spring Framework) for frontend and backend tasks, while managing database operations using PL/SQL, ensuring efficient data access and transformation for ML workflows. - Frontend Development for ML Applications: Created responsive and user-friendly interfaces using HTML, CSS, JavaScript, and jQuery, enhancing interaction with machine learning model dashboards and data visualization tools. - API Integration: Integrated Google Maps API to enrich application functionality, providing spatial data for machine learning models requiring geolocation data. - Agile Project Management: Followed Agile methodologies to adapt to evolving requirements in data pipelines and machine learning projects, ensuring continuous delivery and improvement. - Database Optimization: Migrated existing database procedures to PL/SQL, leading to significant performance gains (e.g., query execution times reduced by 20%) for faster ML data retrieval and storage operations. - Version Control and Collaboration: Ensured code quality with Git and collaborated with cross-functional teams to meet the data needs for machine learning projects. - Object-Oriented Programming: Applied OOP principles to develop scalable, maintainable code structures for data processing and machine learning tasks. - Project Management Tools: Used Microsoft Excel for data analysis and task tracking to ensure project deadlines were met, contributing to machine learning pipeline efficiency.

My Education

Take a look at my formal education

Bachelor of Engineering in Engineering FacultyUniversitas Gadjah Mada | 2015

About Me

Data & AI Engineer

Create Your Data Portfolio for Free