Learn Data Skills
Dirk Steynberg

Dirk Steynberg

Big Data Engineer

Synthesis Software Technologies

Technologies

My Portfolio Highlights

My New Project

Creating Functions to Register App Users

My New Course

Introduction to Python for Developers

My New Project

Creating Functions to Register App Users

Analytical maestro, orchestrating the symphony of insights with precision.

My Work

Take a look at my latest work.

project

Creating Functions to Register App Users

course

Introduction to Python for Developers

course

Intermediate Python for Developers

project

Creating Functions to Register App Users

DataCamp Course Completion

Take a look at all the courses I’ve completed on DataCamp.

Courses

Introduction to Python for Developers
Intermediate Python for Developers

My Work Experience

Where I've interned and worked during my career.

Synthesis Software Technologies | Nov 2024 - Present

Senior Data Engineer

As a consulting Data Specialist and Senior Data Engineer, I design and implement cloud-native data solutions on AWS and GCP that deliver highly scalable platforms for enterprise clients. My work spans the full data lifecycle— from building bespoke data processing and streaming pipelines to architecting comprehensive data lakes and lake houses. Core Responsibilities: Data Platform Architecture & Modeling: Design relational and semantic data models that support business intelligence and analytics initiatives ML Engineering & AI Integration: Develop modern NLP solutions and integrate large language models (LLMs) into production systems Technical Leadership: Guide development teams using Apache frameworks, Python, Data Vault methodology, and Medallion Architecture patterns Advanced Analytics Solutions: Build low-level LLM, NLP, and OCR capabilities to extract insights from diverse business data sources
Show More

Equal Experts | Jan 2024 - Nov 2024

Senior Data Engineer

As a consulting Data Engineer, I engaged with the largest e-commerce partnership in the UK, focusing on improving technical processes and engineering standards. In an extended capacity, I took on the role of Technical Lead, driving initiatives to enhance code quality, SDLC standards, and technical processes within the team. My primary responsibilities included: - Developing and maintaining large-scale data products for customer enablement on the business enterprise data platform, leveraging Snowflake, DBT, Airflow, and GCP for batch and stream ETL processes. - Conducting a critical technical assessment of the team's current standards of work, providing actionable insights to business stakeholders for improvement. As the technical lead and Snr Data Engineer, I served as the direct contact for specific 3rd party solutions and liaison for business stakeholders, ensuring seamless collaboration and effective communication.

Teraflow.ai | Making AI Work | Jun 2022 - Dec 2023

Data Engineer

As a consultant, I worked with the largest FinTech companies and banks in South Africa, designing and implementing enterprise data platforms, products, and warehouses. My key responsibilities included: - Spearheading teams of cloud engineers to develop complex solutions, driving client collaborations, and establishing robust data platforms. - Delivering efficient data processing pipelines using cutting-edge cloud technologies. - Mentoring junior team members through code reviews, training programs, and guidance, ensuring their growth and development. - Ensuring project delivery within timelines and exceeding expectations. As the direct point of contact for stakeholders, I ensured expectations were managed and requirements were fulfilled, fostering strong collaboration and communication.

Ringier South Africa | Oct 2020 - May 2022

Data Engineer

As the technical lead for a Data Platform, I was responsible for designing and implementing event-driven data lakes and orchestrating data warehouses for cross-functional teams. My key responsibilities included: - Elevating stakeholder relationships by implementing scalable solutions for new data sources. - Guiding team members through change management during the migration from legacy systems to the new data platform, which hosted over 2000 ingestion endpoints. - Architecting, designing, proof-of-concepting, developing, and maintaining a robust Data Platform. As a result of my work, the business was able to access data from multiple external and internal data feeds directly, enabling analytics and data science teams to scale. Additionally, I facilitated the analysis of external systems, gathering and sending information as needed.

Perceptech | Jan 2015 - Dec 2020

Founder

As the founder of Perceptech, I developed open-source reporting suites and Python-based solutions for global clients. My key responsibilities included: - Designing and implementing data engineering strategies that aligned with clients' business objectives. - Transforming business processes and data utilization through customized solutions. Initially, my work involved freelancing my programming skills on platforms like Upwork, where I worked with clients to solve coding issues for Python solutions, including frameworks like Django and Pandas. As the business progressed, I transitioned to consulting as a Data Engineer and specialist, suggesting architectures and ideal tools and technologies, and aiding in the implementation of proposed solutions when required. Throughout my work, I collaborated closely with clients to fulfill their requirements, working on contracts that ranged from code creation to short- term stints of work. I also analyzed external systems, gathering and sending information as needed.

Howler | Oct 2019 - Oct 2020

Data Guru

As a Data Guru and Data Specialist, I spearheaded the architecture and development of a modern data analytics platform, revolutionizing data-driven insights for the organization. My key responsibilities included: - Designing and implementing automation and Extract, Transform, Load (ETL) pipelines, centralizing data warehousing and data lake solutions. - Collaborating closely with cross-functional teams to interpret business requirements and transform them into scalable data solutions. - Ensuring data accuracy, integrity, and security by implementing robust data governance practices. Streamlining data processes and optimizing performance to enhance overall system efficiency and effectiveness. Throughout my work, I collaborated directly with the founders, product team, and events managers, ensuring seamless communication and effective solution delivery.

Ovations Technologies (Pty) Ltd | Oct 2017 - Oct 2019

Data Engineer

As a consultant, I developed and implemented modern cloud data warehousing and Extract, Transform, Load (ETL) solutions for the financial sector, optimizing data processing and insights. My key responsibilities included: - Collaborating closely with in-house teams to conceptualize and develop proof-of-concepts (POCs), resulting in innovative data products tailored to the unique needs of the industry. - Streamlining existing products through refactoring, enhancing system efficiency and performance. - Championing the application of best practices in cloud data architecture and operations, elevating data engineering standards within the organization. - Actively contributing to strategic discussions and decision-making processes for data-related initiatives. - Maintaining a strong emphasis on data accuracy, security, and compliance throughout all stages of development. Throughout my work, I collaborated directly with engagement managers, clients, and their stakeholders to ensure seamless communication and effective solution delivery.

Africa Film Studios | Oct 2015 - Dec 2015

Production Assistant

A contract position as a Production Assistant both in Studio and on Set.

My Education

Take a look at my formal education

Bachelor of Science - BS Honours, Computing & IT  · (JanuaryUniversity of Derby | 2025
Bachelor of Science - BS Undergrad, Computing & IT  · (JanuaryOnline Business School | 2023
TQUK Level 4, Business & InnovationADL Online | 2022
Coursera Specialization, Data Analysis and Interpretation Wesleyan University | 2019
Big Data Micromasters, University Of Adelaide, Dig Data and Data ScienceedX | 2019

About Me

Dirk Steynberg

Data engineering specialist with 9+ years building innovative, scalable solutions and leading teams to deliver complex data architectures.

Powered by

  • Work
  • Courses
  • Experience
  • Education
  • About Me
  • Create Your Data Portfolio for Free