Carlysle Human CapitalSouth Africa

Data Engineer (contract)

Project-Based

Description

About the position Our client in the NETHERLANDS is looking for a SA-based Data Engineer to assist remotely on the development of a data management platform. You will report directly to the Data Manager and the main requirements are to code and build the platform for the first phase of the project which is estimated at around one month. The work may continue thereafter as the project is ongoing. But for now the estimated duration for this phase is one month. You will support the design and build of their new data platform. In this role, you will work closely with the manager and the broader data team to develop scalable data pipelines, integrate diverse data sources, and lay the foundational components of a modern, reliable data platform. You will collaborate with data analysts, engineers, and business stakeholders to ensure that high-quality, trusted data becomes available across the organization. This temporary role is ideal for someone with solid experience in data engineering who is eager to apply their skills in modern data architectures, DevOps-oriented ways of working, and emerging AI-driven approaches—while helping accelerate the delivery of their new platform. Tech Stack Azure (Data Factory / Fabric / Synapse) Azure DevOps (Repos & Pipelines) Power BI Python, SQL, dbt Key Responsibilities Design, develop, and maintain data pipelines and ETL/ELT processes Transform and model data using tools such as dbt Write efficient and scalable SQL queries Develop and maintain Python-based data workflows Implement and manage CI/CD pipelines for data solutions Collaborate using Azure DevOps for version control, task tracking, and deployments Monitor data pipelines and troubleshoot issues to ensure reliability Contribute to data quality, testing, and documentation practices Required Skills & Experience 2–4 years of solid experience in a data engineering Strong knowledge of SQL and relational databases Experience with Python for data processing Familiarity with dbt or similar transformation frameworks Experience with CI/CD concepts and tools Hands-on experience with Azure DevOps (repos, pipelines, boards) Understanding of data warehousing concepts and data modeling Basic understanding of cloud environments (preferably Azure) Nice to Have Experience with Microsoft Fabric, Azure Data Factory, or Synapse Knowledge of data lake architectures (e.g., medallion architecture) Experience with version control (Git) in a team setting Familiarity with Power BI or other BI tools Experience with automated testing in data pipelines Familiarity with Generative AI tools and use cases (e.g., Microsoft Copilot, Azure OpenAI, or similar tools) Understanding of how GenAI can support data workflows (e.g., code generation, documentation, or data exploration) Soft Skills Strong problem-solving mindset Good communication skills and ability to work in a team Proactive attitude Attention to detail and data quality Desired Skills: SQL Development Python Relational Databases Azure DevOps dvt

Skills

DevOpsETLData EngineeringOpenAIAzureCI/CDPythondbtPower BIGitAIAzure DevOpsSQL

Want AI to find more roles like this?

Upload your CV once. Get matched to relevant assignments automatically.

Try personalized matching