Client: Capgemini- Versant Media Job description: Design and implement ETL/ELT pipelines using Databricks and Apache Spark. Strong proficiency in Python, SQL, and PySpark. Knowledge of Delta Lake, data lakehouse concepts, and s…
Role: Senior Databricks Engineer
Location: Englewood Cliffs, NJ(Onsite)
Rate: $65hr on C2C
Experience: Must have 14+ years
Client: Capgemini- Versant Media
Job description
Design and implement ETL/ELT pipelines using Databricks and Apache Spark.
Strong proficiency in Python, SQL, and PySpark.
Knowledge of Delta Lake, data lakehouse concepts, and streaming data.
Familiarity with CI/CD pipelines, version control (Git), and DevOps practices.
Understanding of data modeling, data warehousing, and performance tuning.
Develop and maintain data lakehouse architectures for structured and unstructured data.
Optimize data workflows for performance, scalability, and cost efficiency.
Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality data solutions.
Monitor and troubleshoot data pipelines, ensuring reliability and accuracy.
Integrate Databricks with cloud services (AWS, Azure, or GCP) and other enterprise systems.
Hands-on experience with cloud platforms (AWS, Azure, or GCP).
Interested in this position?
Review your details and resume before submitting your application.