Data Engineer
Company
Fractal
Location
New York City, NY
Type
Full Time
Job Description
It's fun to work in a company where people truly BELIEVE in what they are doing!
We're committed to bringing passion and customer focus to the business.
Fractal is a strategic AI partner to Fortune 500 companies with a vision to power every human decision in the enterprise. Fractal is building a world where individual choices, freedom, and diversity are the greatest assets; an ecosystem where human imagination is at the heart of every decision. Where no possibility is written off, only challenged to get better. We believe that a true Fractalite is the one who empowers imagination with intelligence. Fractal has been featured as a Great Place to Work by The Economic Times in partnership with the Great Place to Workยฎ Institute and recognized as a 'Cool Vendor' and a 'Vendor to Watch' by Gartner.
We are looking for a Data Engineer with a collaborative, "can-do" attitude who is committed & strives with determination and motivation to make their team successful. A Data Engineer who has experience implementing technical solutions as part of a greater data transformation strategy. This role is responsible for hands on sourcing, manipulation, and delivery of data from enterprise business systems to data lake and data warehouse. This role will help drive next phase in the digital journey by transforming data to achieve actionable business outcomes. The Data Engineer will create, troubleshoot and support ETL pipelines and the cloud infrastructure involved in the process, will be able to support the visualization teams.
Here's What You'll Do
- Collaborate with business stakeholders and other technical team members to acquire and migrate data sources that are most relevant to business needs and goals.
- Demonstrate technical and domain knowledge of relational and non-relational databases, Data Warehouses, Data lakes among other structured and unstructured storage options.
- Determine solutions that are best suited to develop a pipeline for a particular data source.
- Develop data flow pipelines to extract, transform, and load data from various data sources in various forms, including custom ETL pipelines that enable model and product development.
- Write custom scripts to extract data from unstructured/semi-structured sources.
- Provide clear documentation for delivered solutions and processes, integrating documentation with the appropriate corporate stakeholders.
- Identify and implement internal process improvements for data management (automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability).
- Stay current with and adopt new tools and applications to ensure high quality and efficient solutions.
- Build cross-platform data strategy to aggregate multiple sources and process development datasets.
Qualifications
- Bachelor's degree in Computer Engineering, Computer Science or related discipline, Master's Degree preferred.
- 3+ years of ETL design, development, and performance tuning using ETL tools such as SSIS/ADF in a multi-dimensional Data Warehousing environment.
- 3+ years of experience with setting up and operating data pipelines using Python or SQL
- 3+ years of advanced SQL Programming: PL/SQL, T-SQL
- 3+ years of strong and extensive hands-on experience in Azure, preferably data heavy / analytics applications leveraging relational and NoSQL databases, Data Warehouse and Big Data
- 3+ years of experience with Azure Data Factory, Azure Synapse Analytics, Azure Analysis Services, Azure Databricks, Blob Storage, Databricks/Spark, Azure SQL DW/Synapse, and Azure functions.
- 2+ years of experience in defining and enabling data quality standards for auditing, and monitoring.
- Strong analytical abilities and a strong intellectual curiosity
- In-depth knowledge of relational database design, data warehousing and dimensional data modeling concepts
- Understanding of REST and good API design.
- Strong collaboration, teamwork skills, excellent written and verbal communications skills.
- Self-starter and motivated with ability to work in a fast-paced development environment.
- Agile experience highly desirable.
- Proficiency in the development environment, including IDE, database server, GIT, Continuous Integration, unit-testing tool, and defect management tools.
- Working experience with Python, Spark, Pyspark.
- Strong Leadership capabilities.
Preferred Skills:
- Knowledge of Dev-Ops processes (CI/CD) and infrastructure as code.
- Knowledge of Master Data Management (MDM) and Data Quality tools.
- Experience developing REST APIs.
- Kafka
Technologies we use: Databricks, Azure SQL DW/Synapse, Azure Tabular, Azure Data Factory, Azure Functions, Azure Containers, Docker, DevOps, Python, PySpark, Scripting (Powershell, Bash), Git, Terraform, Power BI, Snowflake
Pay
The wage range for this role takes into account the wide range of factors that are considered in making compensation decisions including but not limited to skill sets; experience and training; licensure and certifications; and other business and organizational needs. The disclosed range estimate has not been adjusted for the applicable geographic differential associated with the location at which the position may be filled. At Fractal, it is not typical for an individual to be hired at or near the top of the range for their role
and compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range is: $96,000 - $145,000. In addition, for the current performance period, you may be eligible for a discretionary bonus.
Benefits:
As a full-time employee of the company or as an hourly employee working more than 30 hours per week, you will be eligible to participate in the health, dental, vision, life insurance, and disability plans in accordance with the plan documents, which may be amended from time to time. You will be eligible for benefits on the first day of employment with the Company. In addition, you are eligible to participate in the Company 401(k) Plan after 30 days of employment, in accordance with the applicable plan terms. The Company provides for 11 paid holidays and 12 weeks of Parental Leave. We also follow a "free time" PTO policy, allowing you the flexibility to take time needed for either sick time or vacation.
Fractal provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.
If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!
Not the right fit? Let us know you're interested in a future opportunity by clicking Introduce Yourself in the top-right corner of the page or create an account to set up email alerts as new job postings become available that meet your interest!
Date Posted
02/27/2024
Views
0
Similar Jobs
Per Diem Psychiatrist Opportunities - Hackensack Meridian Health
Views in the last 30 days - 0
View DetailsNurse Practitioner - Neonatology/NICU - Hackensack Meridian Health
Views in the last 30 days - 0
View DetailsDirector, Assistant Chief Academic Officer - Hackensack Meridian Health
Views in the last 30 days - 0
View Details