You are viewing a preview of this job. Log in or register to view more details about this job.

Data Engineer

Role

We are looking for a Data Engineer to produce scalable software solutions. You’ll be part of a cross-functional team that’s responsible for the full software development life cycle, from conception to deployment.

As a Data Engineer, you should be comfortable with manipulating large dataset and understanding the underlying, development frameworks and third-party libraries. You should also be a team player with a knack for getting into the details of complex datasets.

If you also have a keen interest in AI/ML, we’d like to meet you.

Responsibilities

·      Design, construct, install, test and maintain data management systems.
·      Build high-performance algorithms, predictive models, and prototypes.
·      Ensure that all systems meet the business/company requirements as well as industry standard.
·      Integrate new data management and software engineering technologies into existing data structures.
·      Develop set processes for data mining, data modeling, and data production.
·      Create custom software components and analytics applications.
·      Research new uses for existing data.
·      Employ an array of technological languages and tools to connect systems together.
·      Collaborate with members of your team (eg, infrastructure team, UI/UX team) on the project’s goals.
·      Recommend different ways to constantly improve data reliability and quality.

Requirements

·      Proven experience as a Data Engineer or similar role
·      Experience using cloud services/tools (e.g Azure)
·      Familiarity with common stacks
·      In-depth database knowledge (SQL & NoSQL)
·      Comfortable with data warehousing & data lakes – Hadoop, Apache Spark, Kafka
·      Basic machine learning familiarity
·      Degree in Computer Science, Information Systems or relevant field