Job Description<\/p>\n
\tThe Senior Data Engineer will lead the development and optimization of our data infrastructure, playing a critical role in shaping the future of our data architecture. They will be responsible for designing and implementing complex data solutions, mentoring team members, and collaborating with stakeholders to drive innovative data initiatives. This position requires extensive experience in data engineering, a deep understanding of advanced data technologies, and the ability to provide strategic guidance.<\/p>\n
Key Responsibilities<\/p>\n
\tArchitectural Leadership: Lead the design and implementation of scalable, high-performance data architectures.
\n\tProvide strategic input into the evolution of the company’s data infrastructure and technology stack.
\n\tAdvanced Data Modelling: Design and implement advanced data models to meet complex business requirements. Optimize data storage and retrieval mechanisms for optimal performance.
\n\tBig Data and Advanced Analytics: Champion the use of advanced analytics and big data technologies to derive valuable insights.
\n\tWork on advanced analytics solutions, including machine learning pipelines and predictive modelling.
\n\tPerformance Optimization: Oversee the optimization of data pipelines, databases, and ETL processes for maximum efficiency. Conduct in-depth performance tuning and troubleshooting of complex data workflows.
\n\tTeam Leadership and Mentorship: Lead a team of data engineers, providing technical guidance and mentorship. Foster a culture of continuous learning and collaboration within the data engineering team.
\n\tCross-functional Collaboration: Collaborate with data scientists, analysts, software developers, and other stakeholders to understand business needs and deliver comprehensive data solutions.
\n\tAct as a key liaison between the data engineering team and other business units.
\n\tData Governance and Compliance: Establish and enforce data governance policies, ensuring data quality, integrity, and compliance with regulatory requirements.
\n\tStay abreast of industry best practices and emerging trends in data governance.<\/p>\n
Qualifications<\/p>\n
\tBachelor’s or Master’s degree in Computer Science, Information Technology, or a related field.
\n\t10+ years of experience in data engineering with a focus on complex data solutions.
\n\tExpert proficiency in programming languages such as Python, SQL, and advanced scripting languages.
\n\tIn-depth knowledge of data warehousing concepts, big data technologies, and cloud platforms (e.g., AWS, Azure, Google Cloud).
\n\tProven experience in leading and mentoring a team of data engineers.
\n\tStrong analytical and problem-solving skills with a strategic mindset.
\n\tExcellent communication and collaboration skills.<\/p>\n
Preferred Skills<\/p>\n
\tCertifications in relevant data engineering, cloud, or advanced analytics technologies.
\n\tExperience with real-time data processing and streaming technologies.
\n\tKnowledge of containerization and orchestration tools (e.g., Docker, Kubernetes).
\n\tFamiliarity with data security and privacy considerations.<\/p>\n
Tech Stack<\/p>\n
Core Tech Skills<\/p>\n
\tSQL
\n\tPython
\n\tSpark (PySpark & SQL)
\n\tHadoop<\/p>\n
Specific Tech Skills<\/p>\n
\tAWS S3
\n\tAWS Lambda
\n\tAWS Redshift (Serverless, including Redshift Spectrum)
\n\tAWS EMR
\n\tAWS Step Functions
\n\tAWS EventBridge Rules & Pipes
\n\tAWS Glue
\n\tAWS SQS
\n\tAWS SNS
\n\tAWS API Gateway
\n\tAWS Athena
\n\tAWS VPC
\n\tAWS KMS
\n\tAWS Secrets Manager
\n\tio tables (Open table format)
\n\tUnity Catalog (Open Catalog of Tables, Views, Functions, Models)
\n\tDynamo DB
\n\tDeveloper\/Productivity Tools
\n\tAWS Cloud Development Kit (CDK)
\n\tDocker (for Dev Containers)
\n\tAzure DevOps
\n\tXray
\n\tJIRA
\n\tConfluence (Wiki)
\n\tDraw.io<\/p>\n
Apply via company website ( N \/ A ) or<\/p>\n
juru.simplify.hr<\/p>\n
<\/p>\n","protected":false},"author":2,"featured_media":0,"template":"","meta":{"_promoted":"","_job_location":"","_application":"http:\/\/juru.simplify.hr","_company_name":"Juru Holdings","_company_website":"http:\/\/N%20\/%20A","_company_tagline":"Juru is a specialist recruitment and IT project delivery company, providing specialised talent and technology agnostic implementation solutions across South Africa. Combining decades of project management experience, backed by leading solution architects, business analysts, developers, systems analy... read morests and quality assurance resources; Juru helps clients across the investment and insurance industries to achieve their business objectives by getting the right talent and delivering IT projects with precision.","_company_twitter":"","_company_video":"","_filled":0,"_featured":0,"_remote_position":0,"_job_salary":"","_job_salary_currency":"","_job_salary_unit":""},"job_listing_region":[15],"job-types":[18],"class_list":["post-13622","job_listing","type-job_listing","status-expired","hentry","job_listing_region-western-cape","job-type-contract"],"jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/jobs.dataaxisnode.com\/southafrica\/wp-json\/wp\/v2\/job-listings\/13622","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/jobs.dataaxisnode.com\/southafrica\/wp-json\/wp\/v2\/job-listings"}],"about":[{"href":"https:\/\/jobs.dataaxisnode.com\/southafrica\/wp-json\/wp\/v2\/types\/job_listing"}],"author":[{"embeddable":true,"href":"https:\/\/jobs.dataaxisnode.com\/southafrica\/wp-json\/wp\/v2\/users\/2"}],"wp:attachment":[{"href":"https:\/\/jobs.dataaxisnode.com\/southafrica\/wp-json\/wp\/v2\/media?parent=13622"}],"wp:term":[{"taxonomy":"job_listing_region","embeddable":true,"href":"https:\/\/jobs.dataaxisnode.com\/southafrica\/wp-json\/wp\/v2\/job_listing_region?post=13622"},{"taxonomy":"job_listing_type","embeddable":true,"href":"https:\/\/jobs.dataaxisnode.com\/southafrica\/wp-json\/wp\/v2\/job-types?post=13622"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}