Data Engineer
This critical role for one of Alight's largest clients will be involved in the critical building and deploying of data pipelines to ensure we can deliver accurate information for reporting.
Duties and responsibilities for a Data Engineer position may include:
- Assembling large, complex sets of data that meet non-functional and functional business requirements
- Activities include creating and maintaining AI/ML enabled data pipeline for analytics and insights
- Identifying, designing and implementing process improvements for greater scalability, optimizing data delivery, and automating manual processes
- Building required infrastructure for optimal extraction, transformation and loading of data from various data sources using Cloud and Big data technologies
- Building analytical tools to utilize the data pipeline, providing actionable insight into key business performance metrics including operational efficiency
- Working with stakeholders including data, design, product and executive teams and assisting them with data-related technical issues
Knowledge of following programming languages
- Python
- Java
- C++
- Scala
Knowledge of following:
- Data oriented foundational technologies
- Advanced working knowledge of SQL (writing and debugging)
- Knowledge of query authoring, relational databases, and a familiarity with a variety of databases
- Knowledge of Hadoop, Kafka, and Spark
- Analytical skills when working with unstructured data sets
- Knowledge of cloud-based data solutions (e.g., AWS, EC2, EMR, RDS, and Redshift)
- Knowledge on manipulating, processing, and extracting value from large and disconnected data sets
- Dev Testing