Databricks Engineer (relocation to Cyprus)
Company
EPAM Systems
Location
Rockaway, NJ
Type
Full Time
Job Description
We are looking for a Databricks Engineer with expertise in cloud infrastructure, big data processing, data integration and analytics, particularly with Azure.
In this role, you will play a crucial part in advancing our client's Data-Driven Company initiative within the insurance sector. Your role will involve designing and building robust data architecture to support various aspects of the client's business.
Join us at our Cyprus office, which offers a flexible hybrid work setup. If you're ready to leverage your skills and perspective to make a significant impact, apply now and help us transform our data capabilities in the finance and insurance industries.
#LI-DNI
Responsibilities
- Design, development and maintenance of scalable data pipelines and architectures
- Collaborate with Machine Learning engineers to integrate AI-driven insights and recommendations
- Develop and optimize data models and ETL processes using Databricks and other technologies
- Implement data quality checks and monitoring to ensure high data integrity
- Stay updated with emerging trends and technologies in data engineering and propose adoption of new tools where beneficial
- Troubleshoot and resolve data-related issues in a timely manner
- Participate in code reviews and maintain high standards of code quality
Want more jobs like this?
Get jobs in Rockaway, NJ delivered to your inbox every week.
- Experience as a Data Engineer in a project employing the Databricks platform
- Hands-on experience with Databricks (Delta Lake, workflows, Delta Live Tables, deployment and versioning)
- Solid understanding of data architectures, data modeling skills; experience in designing and building ETL pipelines with Databricks using external orchestrators like Airflow
- Expertise in Python, PySpark and SQL
- Proficiency in cloud-native technologies and software engineering best practices (containers, unit tests, linting and code style checks)
- Engineering experience with either AWS, Azure or both
- Experience with big data and performance optimization of data-intensive applications
- Proactivity and client-facing experience
- Ability to deal with ambiguity and work independently without constant direction
- Desire to work in a transparent and fast-moving startup environment
- Fluent English communication skills at a B2+ level
- Experience setting up or maintaining CI/CD pipelines on Azure DevOps
- Understanding of Data Observability and Data Quality Monitoring; experience integrating data quality checks in data pipelines
- Knowledge of Ingestion Pipelines, PostgreSQL and Terraform
- Private healthcare insurance
- Regular performance assessments
- Family friendly initiatives
- Corporate Programs including Employee Referral Program with rewards
- Learning and development opportunities including in-house training and coaching, professional certifications, over 22,000 courses on LinkedIn Learning Solutions and much more
- *All benefits and perks are subject to certain eligibility requirements
Date Posted
12/19/2024
Views
0
Similar Jobs
Lead Software Engineer- Capital Connect - JPMorgan Chase
Views in the last 30 days - 0
The job posting is for a Lead Software Engineer position at JPMorgan Chase within the Digital Private Markets team The role involves shaping product i...
View DetailsSenior Manager, Fulfillment Engineering - Rent the Runway
Views in the last 30 days - 0
Rent the Runway RTR is a pioneering company in the fashion industry offering a circular fashion model through subscription rental or ownership Founded...
View DetailsApplication Engineer Intern - Schneider Electric
Views in the last 30 days - 0
Schneider Electric is offering an Application Engineering Intern position in the LyndhurstSecaucus NJ area The role involves handson experience in pro...
View DetailsKey Sitecore XM Cloud Engineer - EPAM Systems
Views in the last 30 days - 0
EPAM Kyrgyzstan is seeking an experienced Sitecore Engineer for a role involving support and maintenance of Sitecore and Sitecore XM Cloud The positio...
View DetailsStaff, Software Engineer - Search ML Ops - Walmart
Views in the last 30 days - 0
As a Staff Software Engineer in Walmarts Model Serving team youll be responsible for supporting and enhancing the Walmart MLOps platform This involves...
View DetailsField Engineering Tech - Leidos
Views in the last 30 days - 0
Leidos is hiring Field Engineering Technicians for hourly fulltime roles in Central New Jersey and Pittsburgh The role involves traveling to inspect u...
View Details