You are viewing a preview of this job. Log in or register to view more details about this job.

DATA ENGINEER

Spark IT Solutions
Email
Qualifications
•
3+ years of experience working with Hadoop, Spark, and SQL
•
2+ years of experience developing streaming data applications using Kafka
•
Strong Java, SQL, and Python development skills
•
Experience with common data-science toolkits, especially python-based
•
Strong statistical analysis skills
•
Demonstrated ability to troubleshoot and conduct root-cause analysis
•
Unix scripting experience (bash, tcsh, zsh, python, etc)
•
Experience with DevOps tools such as TeamCity,  JIRA
•
User-focused: driven to deliver a usable product to users, rather than by technology itself
Responsibilities
•
Build data pipelines using common big data tools: Hadoop, Kafka, Spark, AWS
•
Consult with traders and developers on data solutions: assist in identifying solutions which match their problem space and harmonize with our internal data platform
•
Improve the performance of financial analytics platforms built ar