Senior Azure Data Engineer, Johannesburg

What you will do:

The Data Engineer will work collaboratively with the Data Team to define data sources and to build a custom data framework that empowers businesses with decision-making capabilities.

Core responsibilities include:

• Work within a highly specialized and growing team to enable delivery of data and advanced analytics system capability
• Update the existing data environment with modern techniques and technologies.
• Develop, implement and maintain a reusable architecture of data pipelines to make data available for various purposes.
• Identify, design, and implement internal process improvements.
• Create the infrastructure required for optimal extraction, transformation and loading of data from multiple data sources by using the ideal tools and technologies.
• Work comfortably with structured and unstructured data in a variety of different programming languages
• Responsible for Data Modeling
• Understanding of distributing programming and advising data scientists on how to optimally structure program code for maximum efficiency
• System integration skills between Business Intelligence and source transactions
• Installation of Data Warehousing solutions

Qualification & Experience:

• Honours or Masters degree in BSc Computer Science or Engineering or Software Engineering with solid experience in data mining and machine learning
• 5 to 15 years of work experience
• Expert in programming languages such as R, Python, Scala and Java
• Expert database knowledge in SQL and experience with MS Azure tools such as Data Factory, Synapse Analytics, Data Lake, Databricks, Azure stream analytics and PowerBI
• Modern Azure Datawarehouse skills
• Expert Unix/Linux admin experience including shell script development
• Exposure to AI or model development
• Experience working on large and complex datasets
• Understanding and application of Big Data and distributed computing principles (Hadoop and MapReduce)
• ML model optimization skills in a production environment
• Production environment machine learning and AI
• DevOps/DataOps and CI/CD experience
• Azure experience

Intellinexus in a nutshell:

Intellinexus is a business-led data and business intelligence consultancy that empowers organisations with data-driven decision-making capabilities. We combine innovation and expertise with access to the best talent to help organisations become smarter, more agile, and more resilient to the changes in their operating environments. Our expert teams apply a mastery of data and technology to craft strategies that revolutionise business decision-making, and give organisations access to real-time, actionable insights into the performance of their business. For more information, please visit

Intellinexus, What we offer:

• Intellinexus offers remote and hybrid opportunities
• Intellinexus is an SME and therefore you get a lot more exposure to different technologies, solutions, techniques and perspectives during projects, which you might be excluded from in other firms with specialists in those areas
• Training and development are very important to Intellinexus and time and resources are allocated to grow the consultants careers