Data Engineer: Python, ETL&Big Data Pipelines, Johannesburg
Data Engineer: Python, ETL&Big Data Pipelines, Johannesburg
-
Johannesburg, South Africa -
Posted: less than a week ago
-
Save -
Share
Description
About the Company:
Khonology is a digital services company focused on software development, Application Support, data analytics and engineering. We are looking for a skilled Data Engineer to join our team. The ideal candidate will have a strong background in Python, AWS/Azure Cloud technologies, data pipeline management, ETL and ELT principles, and Big Data technologies. You will be responsible for designing, building, and maintaining scalable and robust data systems to support our data-driven initiatives and productionizing data related systems.Core Responsibilities and Competencies:
Programming: Write efficient and maintainable code in Python and SQL. Data Pipeline Management: Design, develop, and maintain data pipelines to ensure smooth data flow from various sources to the data warehouse. Production Systems: Apply best practices in production systems management to ensure reliability and scalability.ETL and ELT Processes: Implement and optimize ETL (Extract, Transform, Load) and ELT (Extract, Load, Transform) processes to ensure data is correctly ingested, transformed, and loaded. Data API Integration: Develop and maintain data APIs to facilitate seamless data access and integration with other systems.Big Data Technologies: Utilize Hadoop and Spark to process large volumes of data efficiently. Database Management: Manage and optimize relational databases to ensure high performance and reliability. Data Modeling: Design and implement data models to support data product and machine learning needs.Query Optimization: Ensure that queries are always optimized for performance to enhance system efficiency. Our current tech stack:
The ideal candidate should be familiar with our current tech stack: Cloud Platforms: AWS, Microsoft Azure Main Programming language: Python, SQL (Domain-Specific Language) Big Data technologies (On prem): Hadoop, Spark Code Repositories: BitBucket, GitHub, CodeCommit Deployment frameworks: Bamboo, Octopus Deploy, Codebuild and CodeDeploy
#J-18808-Ljbffr
Khonology is a digital services company focused on software development, Application Support, data analytics and engineering. We are looking for a skilled Data Engineer to join our team. The ideal candidate will have a strong background in Python, AWS/Azure Cloud technologies, data pipeline management, ETL and ELT principles, and Big Data technologies. You will be responsible for designing, building, and maintaining scalable and robust data systems to support our data-driven initiatives and productionizing data related systems.Core Responsibilities and Competencies:
Programming: Write efficient and maintainable code in Python and SQL. Data Pipeline Management: Design, develop, and maintain data pipelines to ensure smooth data flow from various sources to the data warehouse. Production Systems: Apply best practices in production systems management to ensure reliability and scalability.ETL and ELT Processes: Implement and optimize ETL (Extract, Transform, Load) and ELT (Extract, Load, Transform) processes to ensure data is correctly ingested, transformed, and loaded. Data API Integration: Develop and maintain data APIs to facilitate seamless data access and integration with other systems.Big Data Technologies: Utilize Hadoop and Spark to process large volumes of data efficiently. Database Management: Manage and optimize relational databases to ensure high performance and reliability. Data Modeling: Design and implement data models to support data product and machine learning needs.Query Optimization: Ensure that queries are always optimized for performance to enhance system efficiency. Our current tech stack:
The ideal candidate should be familiar with our current tech stack: Cloud Platforms: AWS, Microsoft Azure Main Programming language: Python, SQL (Domain-Specific Language) Big Data technologies (On prem): Hadoop, Spark Code Repositories: BitBucket, GitHub, CodeCommit Deployment frameworks: Bamboo, Octopus Deploy, Codebuild and CodeDeploy
#J-18808-Ljbffr
Highlights
-
Company nameKhonology (Pty) Ltd -
Job positionData Engineer: Python, ETL&Big Data Pipelines
-
Flag -
Block ad
Safety Tips
Be careful: if it seems too good to be true, it most likely is.
Related searches
More info about this ad
Data Engineer: Python, ETL&Big Data Pipelines has been posted in the Johannesburg Information Technology category on Locanto.
If you’re looking for something similar, check out Software Quality Engineer (Finance/Banking Sector), Johannesburg, ESB Developer, Johannesburg or Business Development Manager I in Johannesburg, also posted in Information Technology. Right now, there are 396 classified ads in Information Technology in Johannesburg on Locanto.
Interested in more? Widen your search to view ads in nearby areas of Johannesburg. This includes Information Technology in Primrose, Bedfordview and Sandton. There are more ads within a 15 km radius for this category. If you want to view those ads, click here.
