To design, build, and maintain robust, scalable data infrastructure that ensures secure, real-time access to operational and supply chain data. This role underpins accurate reporting, advanced analytics, and automationenabling performance optimisation, cost reduction, and smarter decision-making across the logistics value chain 1. Design, build, and maintain ELT pipelines Pipeline success...
Key Skills and previous experience required: - Software development using C#/.net/ASP.Net/ Typescript 5+ years - Azure Data Factory - Design pipelines (not just modify existing ones) - Pipelines orchestration of data workflows/ Copy Activity/ Data Flow (Mapping Data Flows)/ Lookup / Stored Procedure / Web Activity - Linked Services connecting to: SQL Server / Azure SQL/ REST APIs/ Blob Storage /...
Applicants must have the following requirements:Must have a Matric or Tertiary qualification in Computer Science, Information Systems, Data Engineering, Analytics, Mathematics, or Statistics.Must have 6-8 years of experience in data engineering, database development, or data management in production environments.Must have hands-on experience with SQL Server, including advanced T-SQL development,...
JOB OUTPUTS AND KEY PERFORMANCE INDICATORS - Design, build, and maintain ELT pipelines - Pipeline success rate (% jobs completed without failure) - Data latency (extraction to availability) - Error resolution turnaround time - Integrate data across systems (WMS, TMS, ERP, IoT) - Number of successful system integrations % data completeness and consistency across sources - Average time to onboard...
Senior Data Engineer | South Africa | Permanent Build the data backbone that powers smarter logistics decisions. Own complex pipelines that turn operational data into real-time insight across the supply chain. This role sits at the core of a Business Intelligence environment, responsible for designing, building, and maintaining a scalable data infrastructure that supports reporting, advanced...
What you will be doing: - Design, develop, and deliver innovative, reusable Business Intelligence solutions that support strategic and operational decision-making - Build and maintain robust BI data models, dashboards, reports, and analytics solutions - Collaborate closely with Business Development Managers (BDMs) and Delivery Heads to recommend the use of new and emerging technologies -...
Skills & Experience: Data Mastery in SQL: Advanced queries, clever CTEs, and the skills to turn complex data challenges into clear, usable insights ETL/ELT Excellence: Building smooth data pipelines with tools like SSIS, ADF, and Talend, plus creating reliable data warehouses in Snowflake and BigQuery Performance Tuning Expertise: Optimizing queries, resolving deadlocks, and improving execution...
Role overview You will: - Design and maintain scalable, secure, high-performance data architecture - Build robust ETL/ELT pipelines for batch and streaming data - Enable analytics, BI, and AI workloads through reliable data platforms - Ensure regulatory compliance and data governance for sensitive financial data Duties: - Design and maintain scalable, secure, and high-performance data...
ESSENTIAL SKILLS: - Strong experience with Azure data services (Azure Data Factory, Azure SQL Database, Azure Data Lake Storage, Azure Data Explorer/Kusto) - Proficiency in SQL for data extraction, transformation and analysis - Experience building ETL/ELT pipelines and data integration workflows in Azure Data Factory Pipelines or Databricks Workflows - Skilled in dimensional modelling and...
ROLE OVERVIEW: We are seeking an Analytics Developer with expertise in Databricks, Power BI/Fabric, and ETL technologies to design, develop, and deploy advanced analytics solutions. The ideal candidate will focus on creating robust, scalable data pipelines, implementing actionable business intelligence frameworks, and delivering insightful dashboards and reports that drive strategic...
Requirements - You have gained experience with data, and various skills related to Python or SQL during your studies, before starting your career, or in a previous job. - It is mandatory that you hold the following certification: - Google Cloud Professional - Machine Learning Engineer - A completed degree that included Data Science and/or Marketing Analytics is an advantage. Preferred Skills -...
Key Responsibilities: - Maintain and update existing reports and dashboards in Power BI to reflect evolving business requirements - Assist with data extraction and execute defined SQL queries - Perform data validation and reconciliations between reporting layers. - Work closely with the analytics and engineering teams to resolve data discrepancies - Support the documentation of reports,...
Key Responsibilities - Design, build, and maintain robust data pipelines and data architectures - Develop and optimise ETL/ELT processes for structured and unstructured data - Work with large datasets across cloud and on-prem environments - Collaborate with data scientists, analysts, and business stakeholders - Ensure data quality, reliability, and performance across systems - Support data...
About the Role We are seeking a highly skilled Senior Business Intelligence Developer to join our dynamic data team. You will be responsible for designing, building, and maintaining robust and scalable BI solutions, dashboards, and data models that enable analytics and business intelligence at enterprise scale. This role is ideal for professionals who thrive in complex data environments, value...
ENVIRONMENT: YOUR passion for leading teams, driving Business Intelligence & Microsoft Fabric expertise is sought to fill the role of a MS Fabric Data Engineer wanted by a provider of tailored Financial Solutions. You will lead the initial phases of a warehouse rework project and support the ongoing expansion of a newly created data warehouse within the Microsoft Fabric platform. You will also...
Job & Company Description: Im looking to connect with Cloud Data Engineers who have solid experience across cloud data platforms, pipeline development, and data architecture. By partnering with me, youll be considered for multiple upcoming roles where your cloud data expertise will be in high demand. Key Responsibilities: - Design, build, and maintain cloud-based data pipelines and ETL/ELT...
Azure Data Engineer Build enterprise-scale data pipelines and modern cloud data solutions in a high-growth environment. Johannesburg (Bryanston) · Hybrid Work · R700 000 to R1 400 000 CTC per annum About Our Client Our client specialises in delivering advanced, cloud-based data solutions for large enterprises across diverse sectors. They leverage the Microsoft data ecosystem to build...
What you will be doing: - Architect, develop, and maintain high-performance Python applications supporting AI and machine learning use cases. - Lead peer code reviews and enforce best practices in software engineering and coding standards. - Design, build, and manage ELT/ETL data pipelines in massively parallel processing environments (e.g. Spark, Ray, or similar). - Oversee the full machine...
ESSENTIAL SKILLS: - Data Engineering - SQL and databases ETL/ELT - Proficiency in at least one programming language (Python, Java) Hand-on experience with cloud data platforms - Understanding data warehousing and Lakehouse concepts. - Understanding of data security, governance, and compliance. Data modelling - CI/CD - IaC - Terraform - APIs - Business Intelligence tools - Understanding of big...
What you will be doing: - Design, develop, and implement scalable data warehouse solutions. - Develop, maintain, and optimize ETL/ELT processes for efficient data extraction, transformation, and loading. - Build and enhance Power BI solutions from high-level technical and business requirements. - Perform quality assurance checks and ensure data accuracy and integrity. - Configure real-time data...