RFX 4921036 _ Data Engineer Services, Pretoria

Objective of this Scope of Work
The main purpose of this position is to ensure that data quality and integrity, creating advanced algorithms, develop and maintain datasets and architecture design of high calibre to also support the business goals and to build systems by collecting, validating and preparing high quality data objectives of client PA Transformation Programme:

Scope of Services Definition
The scope will include but will not be limited to:

Data Engineering is a critical discipline within the realm of data management.
Involving designing, construction and architectures of efficiently collecting, storing and processing data.
Applying needs analysis and systems analysis methods and techniques to identify where and how adoption improvements can be necessitated either by internal or external training (for both systems and processes).
Work collaboratively with Client Academy to identify and prioritize new data that which plays a pivotal role in insuring that data is accessible, reliable, and has ready analysis according to Umoja PA Client.
Needs to enable the Client PA to derive meaningful insights and make informed decisions keeping current with advancements in the Umoja.
Provides a continuous learning path for assigned programs and audiences. Creates effective methods of evaluation.

Key responsibilities:

Programming knowledge with expertise in Python, Java etc. These languages will be used to build a pipeline, implement data transformation and automate data workflow.
A deep understand of relational databases for specific design of efficient schemas.
Understanding of tools to enable efficient analysis of large data.
Ability and knowledge to design and manage software processes.
Ability and understanding strengths and weaknesses of various databases.
Proficiency in cloud platforms and data management.
Grasping of distributed systems to design scalable and fault-tolerant data architectures.
Proficient in software and its ecosystem components e.g. MapReduce.
SQL is the fundamental skill set to manage relational database management system.
Knowledge to build complex business database system. This will be associated with operations that tackle data motion, data rest, datasets and the relationship between data-dependent processes and applications.
Ability of coding to link your database and work with all the applications.
Proficiency in operating a system e.g. UNIX
Machine learning is an advantage and mostly linked to data

Knowledge, experience and skill sets
Data Security
ETL (Extraction, transform, load)
Algorithmic Bias Mitigation
Scalability
Data Quality Assurance

Data Pipeline Construction

Education and experience:
A minimum of a bachelor's degree in computer science, Business Informatics.
Min of 3 years' experience of Data Engineering