Data Engineer ETL - Python

About Us
Infosys is a global leader in next-generation digital services and consulting. We enable clients in more than 50 countries to navigate their digital transformation. With over four decades of experience managing global enterprises' systems and workings, we expertly steer our clients through their digital journey. We do it by enabling the enterprise with an AI-powered core that helps prioritize the execution of change. We also empower the business with agile digital at scale to deliver unprecedented performance and customer delight. Our always-on learning agenda drives their continuous improvement through building and transferring digital skills, expertise, and ideas from our innovation ecosystem.
EOE disability/veteran

The ideal candidate for the Data Engineer role should have:
Understanding of object-oriented programming.
Familiarity with ETL processes and standard methods.
Knowledge of package management and deployment strategies.

Role and Responsibilities
As a Data Engineer, your primary duties and expectations will be:
Day-to-day troubleshooting of forecasting systems, mainly working through data anomalies that cause inaccurate forecasts or prevent forecasts' generation.
Collaborate with the data science team to enhance existing forecasting systems for the trade floors.
Create dynamic object-oriented methods, full stack solutions, and integrations to existing code solutions.
Develop individual Python classes, methods, functions that support the data flow of existing and new projects.
Work on code additions to seamlessly support projects for data flows, including logging and support, with little to no supervision.
Experience in modifying packages, testing, and repository instances to support CI/CD.
Qualifications
Advanced knowledge of Python, including:
Object-Oriented Programming
CI/CD
Experience with GitHub
Familiarity with Python libraries like Pandas, Numpy, Python SQL Connectors, Flask, Django, and Python Decorators.
Experience with parsing APIs and markup languages including XML and JSON.
Proficiency with Multi-threading and Multi-processing in Python.
Significant experience with SQL, including:
Understanding of Database Normalization & Creation
Proficiency with PostGres and MySQL.
Experience with any relational database flavor.
Knowledge of Query Optimization.
Nice to have
Experience with distributed systems.
Knowledge of Apache Spark and Snowflake.
Familiarity with cloud technologies, particularly AWS, Athena, and Docker.