Big Data Engineer
Role : Big Data Engineer
Location: NEW YORK, NY (Remote)
Duration: 12 Months
JOB DESCRIPTION
· Good programming knowledge in Python, Scala & SQL.
· Experienced Big Data developer with 5+ years of experience in Apache Spark, Databricks, Kubernetes.
· Experienced in working with AWS components - Glue, Lambda, S3, DynamoDB, Athena, CloudWatch etc.
· Analytical and problem-solving skills, particularly for a big data environment
· Experienced in handling large scale Developments & deployments.
· Good knowledge in OAuth application or authentications.
· Developing Modern Data Warehouse solutions using Databricks and AWS.
· Experienced in Databricks CICD or CICD in general (Preferred - Concourse).