Principal Data Engineer
Company
Amadeus
Location
Other US Location
Type
Full Time
Job Description
Job Title
Principal Data Engineer
Job Description
Main Responsibilities:
- Design and develop cloud native applications using Big Data stack, handling end to end data flow and processing
- Thought-leader in data architectures, ETL/ELT frameworks, and highly scalable data model design
- Thought leader in defining the roadmap to tune performance of complex big data applications.
- Experience in full product lifecycle from feature feasibility study/ defining solution to production and maintenance, taking ownership of complete feature delivery with quality
- Mentor and advise the scrum teams to meet product expectations
- Work with distributed teams, Dev Leads, Architects/Experts, Managers, and counterparts in different locations, as well as with external teams.
About the ideal candidate
- 12+ years of industry experience with strong technical experience of which 10+ years in Big Data technologies, Cloud, and ETL/ELT frameworks etc.
- Deep expertise working with Spark - Scala, Python, on platforms like Databricks, and deep expertise in cloud platforms preferably Azur
- Must have knowledge of CI CD deployments
- Experience in Micro-service architecture is a must-have.
- Experience with logging management using Splunk/ELK including monitoring best practices
- Should have cracked problems on the scale, and performance in Spark using cloud based platforms
- Expertise in best practices, design patterns, and anti-patterns.
- Competency in professional engineering best practices and processes relating to software development lifecycle (scrum, architecture/design/coding standards, design/code reviews, unit testing, build processes, testing, operations, etc)
- Excellent collaboration as well as written and oral communication skills.
- Cloud/SaaS (particularly Azure) experience will be an added advantage but not mandatory
- Experience working with Openshift and Kubernetes, Helm, and Jenkins is added advantage
Keywords: Spark, Scala, Python, Big Data Engineer, Azure Databricks, Event Driven, Microservices, Java, API, Cloud, Azure, Event hub
Diversity & Inclusion
Amadeus aspires to be a leader in Diversity, Equity and Inclusion in the tech industry, enabling every employee to reach their full potential by fostering a culture of belonging and fair treatment, attracting the best talent from all backgrounds, and as a role model for an inclusive employee experience.
Amadeus is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to gender, race, ethnicity, sexual orientation, age, beliefs, disability or any other characteristics protected by law.
Date Posted
09/07/2024
Views
1
Similar Jobs
Senior Investigator I - Department of Health and Human Services - Food and Drug Administration
Views in the last 30 days - 0
View DetailsSenior Investigator I - Department of Health and Human Services - Food and Drug Administration
Views in the last 30 days - 0
View DetailsInvestigator I - Department of Health and Human Services - Food and Drug Administration
Views in the last 30 days - 0
View DetailsForestry Technicain - Department of Agriculture - Forest Service
Views in the last 30 days - 0
View DetailsMeteorological Technician - Department of Agriculture - Forest Service
Views in the last 30 days - 0
View DetailsForestry Technician (Recreation) - Department of Agriculture - Forest Service
Views in the last 30 days - 0
View Details