Data Engineer - Scala & Python

Make your mark at Comcast -- a Fortune 30 global media and technology company. From the connectivity and platforms we provide, to the content and experiences we create, we reach hundreds of millions of customers, viewers, and guests worldwide. Become part of our award-winning technology team that turns big ideas into cutting-edge products, platforms, and solutions that our customers love. We create space to innovate, and we recognize, reward, and invest in your ideas, while ensuring you can proudly bring your authentic self to the workplace. Join us. You'll do the best work of your career right here at Comcast. (In most cases, Comcast prefers to have employees on-site collaborating unless the team has been designated as virtual due to the nature of their work. If a position is listed with both office locations and virtual offerings, Comcast may be willing to consider candidates who live greater than 100 miles from the office for the remote option.)

Job Summary

Responsible for planning and designing new software and web applications. Analyzes, tests and assists with the integration of new applications. Documents all development activity. Assists with training non-technical personnel. Has in-depth experience, knowledge and skills in own discipline. Usually determines own work priorities. Acts as a resource for colleagues with less experience.

If you enjoy working on fun, highly visual applications, if you care about coding in Scala and Python, and most importantly, if you are passionate about technology and enjoy working with teams, we'd love to hear from you!

Job Description

• Hands-on building of ETL pipelines using our internal framework written in Java
• Hands-on solutioning of real time REST APIs or other solutions for streaming data from Graph
• Modify existing application code or interfaces or build new application components from detailed requirements.
• Analysis of requirements, support of the design, development of the code, testing, debugging, deployment, and maintenance of those programs and interfaces. Documentation of the work is essential
• Participation in most aspects of programming and application development, including file design, update, storage, and retrieval
• Enhance processes to resolve operational problems and add new functions taking into consideration schedule, resource constraints, process complexity, dependencies, assumptions and application structure.
• Ability to maintain the developed solution on an on-going basis is essential.
• Ability to follow the existing development methodology and coding standards, and ensure compliance with the internal and external regulatory requirements.
• Develop and implement databases, data collection systems, data analytics and other strategies that optimize statistical efficiency and quality.
• Acquire data from primary or secondary data sources and maintain databases/data systems.
• Work with management to prioritize business and information needs.
• Locate and define new process improvement opportunities.
• Document design and data flow for existing and new applications being built.
• Co-ordinate with multiple different teams QA, Operations and other development team within the organization.
• Testing methods, including unit and integration testing (JUnit, JMock).
• Ability to integrate with large teams, demonstrating strong verbal and written communication skills.
• Utilization of software configuration management tools.
• Code deployment and code versioning tools.

Qualifications:

• Bachelor's degree preferably with Computer Science background.
• At least 5+ years of experience implementing complex ETL pipelines preferably with Spark toolset.
• Demonstrated ability with Java particularly within the data space.
• Experience writing complex SQL and ETL processes.
• Excellent coding and design skills, particularly in Java/Scala and Python and or Java.
• Experience in UNIX (AIX) , UNIX Scripting.
• Experience in JAVA, J2EE, EJB, JavaBeans, JavaScript, servlets, JDBC, struts, Hibernate is a plus.
• Experience working with large data volumes, including processing, transforming and transporting large-scale data.
• Experience in AWS technologies such as EC2, Redshift, Cloud formation, EMR, AWS S3, AWS Analytics required.
• Big data related AWS technologies like HIVE, Presto, Hadoop required.

Core Responsibilities

• Collaborates with project partners. Conducts analysis to resolve integration needs.
• Designs new software and web applications, supports applications under development and customizes current applications. Assists with the software update process for existing applications and roll-outs of software releases.
• Participates in training representatives and operations staff on internally developed software applications.
• Researches, writes and edits documentation, including software designs, evaluation plans, test results, technical manuals and formal recommendations and reports.
• Monitors and evaluates competitive applications and products. Reviews literature, patents and current practices relevant to the solution of assigned projects.
• Provides technical leadership throughout the design process and guidance with regards to practices, procedures and techniques. Serves as a guide and mentor for junior-level Software Development Engineers.
• Works with Quality Assurance team to determine if applications fit specification and technical requirements.
• Knowledge of engineering methodologies, concepts, skills and their application in the area of specified engineering specialty.
• Ability to apply, process design and redesign skills. Presents and defends architectural, design and technical choices to internal audiences.
• Project management skills.

Employees at all levels are expected to:

• Understand our Operating Principles; make them the guidelines for how you do your job.
• Own the customer experience - think and act in ways that put our customers first, give them flawless digital options at every touchpoint, and make them promoters of our products and services.
• Know your stuff - be hardworking learners, users and advocates of our groundbreaking technology, products and services, especially our digital tools and experiences.
• Win as a team - make big things happen by working together and being open to new insights.
• Be an active part of the Net Promoter System - a way of working that brings more employee and customer feedback into the company - by joining huddles, making call backs and helping us elevate opportunities to do better for our customers.
• Get results and drive growth!
• Respect and promote inclusion & diversity.
• Do what's right for each other, our customers, investors and our communities.

Disclaimer:

• This information has been designed to indicate the general nature and level of work performed by employees in this role. It is not designed to contain or be interpreted as a comprehensive inventory of all duties, responsibilities and qualifications.

Comcast is an EOE/Veterans/Disabled/LGBT employer.

We believe that benefits should connect you to the support you need when it matters most, and should help you care for those who matter most. That's why we provide an array of options, expert guidance and always-on tools that are personalized to meet the needs of your reality-to help support you physically, financially and emotionally through the big milestones and in your everyday life.

Please visit the benefits summary on our careers site for more details.

Education

Bachelor's Degree

While possessing the stated degree is preferred, Comcast also may consider applicants who hold some combination of coursework and experience, or who have extensive related professional experience.

Certifications (if applicable)

Relative Work Experience

5-7 Years

Comcast is proud to be an equal opportunity workplace. We will consider all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender identity, national origin, disability, veteran status, genetic information, or any other basis protected by applicable law.