Senior Data Platform Engineer – Oil Assets Senior Data Engineer (Oil Assets)

  • Full Time
  • Gauteng
  • Applications have closed

Website Glencore

Glencore is one of the world’s largest global diversified natural resource companies. As a leading integrated producer and marketer of commodities with a well-balanced portfolio of diverse industrial assets, we are strongly positioned to capture value at every stage of the supply chain, from sourc… read moreing materials deep underground to delivering products to an international customer base. The Group’s industrial and marketing activities are supported by a global network of more than 90 offices located in over 50 countries. Our diversified operations comprise around 150 mining and metallurgical sites, offshore oil production assets, farms and agricultural facilities. We employ approximately 155,000 people including contractors. Baarermattstrasse 3 CH-6340 Baar Switzerland

Join us as an experienced Senior Data Platform Engineer, you will lead the design and governance of scalable, secure, and compliant data architectures on Microsoft Azure. You will work across oil trading, refining, and retail fuel operations to align cloud data strategies with business goals, regulatory requirements, and industry best practices.
You will play a hands-on technical role within the data engineering team, interfacing with the CloudOps team in London to design and implement cost effective solutions across our suite of Azure products adhering to best practice principles. Experience in DevOps is highly desirable as you will be responsible for designing CI/CD pipelines using Github Actions and containerization technologies.
In addition, the role will involve exploring new technologies and navigating implementation within Glencore’s private Azure tenant, according to the guidelines enforced at Group level. With these in mind, you will play an advisory role across the Assets, assisting with design and implementation, and on-premises to cloud migrations as required.

Responsibilities:

Platform Engineering & Architecture

Design and implement scalable, secure, and cost-effective data platform solutions using Azure Synapse Analytics, Azure Data Lake, and related services.
Translate business and regulatory requirements into cloud-native data architectures.
Contribute to the architectural roadmap, including the adoption and integration of Microsoft Fabric for unified data experiences.
Define and enforce platform standards, patterns, and reusable components to accelerate delivery across the team.

CI/CD, Automation & Containerization

Lead the implementation of CI/CD pipelines for data engineering workflows using Azure DevOps and Git.
Automate infrastructure provisioning and deployment using Infrastructure as Code (e.g., Bicep, Terraform).
Develop and maintain containerized data services using Docker and orchestrate deployments using Kubernetes (AKS).
Establish automated testing, validation, and monitoring practices to ensure data quality and platform reliability.

Team Enablement & Collaboration

Collaborate closely with the other Senior Engineer to co-lead technical direction and ensure consistency across projects.
Mentor and support data engineers and developers, providing guidance on best practices, code reviews, and technical upskilling.
Work cross-functionally with Data Architects, Analysts, and Product Owners to translate business needs into robust data solutions.

Governance, Security & Operations

Implement data governance and lineage practices using Microsoft Purview and Fabric-native tools.
Ensure compliance with security and privacy standards through RBAC, encryption, and secure data handling.
Monitor platform performance and proactively address operational issues and bottlenecks.

Innovation & Continuous Improvement

Stay current with Microsoft’s evolving data ecosystem, including Fabric, and evaluate new tools and services for team adoption.
Drive continuous improvement in engineering workflows, platform scalability, and developer experience.
Maintain understanding of the latest trends and advancements in AI and machine learning and advise on incorporation of these innovations across the department, alongside governance.

The ideal candidate will have:

Bachelor’s degree in Computer Science, Information Technology, or equivalent experience.

Essential Technical Skill:

Cloud & Platform: Azure Synapse Analytics, Microsoft Fabric (emerging), Azure Data Lake Gen2, Azure SQL, Azure DatabricksReal-Time & IoT: Azure Event Hubs, Azure Stream Analytics, Azure IoT Hub
Data Engineering: Azure Data Factory, Synapse Pipelines, Spark, Delta Lake, T-SQL, Python
Governance and Security: Microsoft Purview, Key Vault, RBAC, Data Masking, Encryption
Monitoring and Observability: Azure Monitor, Log Analytics, Application Insights
Governance and Security: Microsoft Purview, Key Vault, RBAC, Data Masking, Encryption
Monitoring and Observability: Azure Monitor, Log Analytics, Application Insights
DevOps and Automation: Azure DevOps, Git/GitHub, CI/CD, Bicep, Terraform, YAML pipelines
Containerization and Orchestration: Docker, Kubernetes (AKS), Helm

Experience:

10 years of experience, including 2–4 years leading cloud-native data architecture initiatives.
Proven track record in designing and delivering scalable, end-to-end data platform solutions across hybrid and multi-cloud environments.
Adept at driving best practices in data engineering, modernizing legacy systems, and advising stakeholders on strategic data platform decisions.
Strong focus on performance, reliability, and governance across enterprise-grade data ecosystems.
Skilled in setting up foundational components, enforcing engineering standards, and enabling team-wide productivity through automation, CI/CD, and reusable frameworks.
Plays a key leadership role in a growing data engineering team, working alongside senior and junior data engineers.
Excellent understanding of core data modelling concepts and techniques.
Ability to manage stakeholders and develop effective relationships across different cultures.

Deadline:31st August,2025

go to method of application »

Apply via company website ( http://www.glencore.com ) or

 

More posts