Sr Big Data Engineer Designer Lead

Let's be unstoppable together!

Circana (formerly IRI and NPD) is the leading advisor on the complexity of consumer behavior. Through unparalleled technology, advanced analytics, cross-industry data, and deep expertise, we provide clarity that helps almost 7,000 of the world's leading brands and retailers take action and unlock business growth. We understand more about the complete consumer, the complete store, and the complete wallet so our clients can go beyond the data to apply insights, ignite innovation, meet consumer demand, and outpace the competition.

At Circana, we are fueled by our passion for continuous learning and growth, we seek and share feedback freely, and we celebrate victories both big and small in an environment that is flexible and accommodating to our work and personal lives. We have a global commitment to diversity, equity, and inclusion as we believe in the undeniable strength that diversity brings to our business, employees, clients, and communities (with us you can always bring your full self to work). Join our inclusive, committed team to be a challenger, own outcomes, and stay curious together. Learn more at www.circana.com.

What will you be doing?

As a Sr Big Data Engineer Designer, you will be responsible for leading the development of client-specific implementations that will run in the client's cloud environment leveraging the industry's leading BI/Analytics solutions, Circana Liquid Data (LD). This is an end-to-end business intelligence solution that involves highly complex data transformations flowing into the LD Whitebox-powered data layer, and the LD Unify reporting application.

You will interface with the client to understand requirements and translate the requirements into technical design. You will then manage and co-develop complex, fully automated data ingestion processes that meet the client's needs. You will also be responsible to debugging and resolving all the data issues that arises during the course of the project.

Job Responsibilities

• Design the data loading pipeline which satisfies the business requirements and also extremely performant and fault tolerant
• Work with Product management team and client data ingestion teams to thoroughly understand all the datasets and ensure that it meets the business requirements
• Attend daily scrum calls with clients and provide feedback on the progress of all the data ingestion work
• Lead the offshore and onshore teams and explain the business requirements and design and ensure all data ingestion tasks are delivered on time
• Help the team in tuning the performance of the data ingestion jobs to ensure all jobs complete within the stipulated SLA time
• Co-develop all the complex data ingestion jobs and understand all the internal framework utilities and also build reusable code

Requirements

• Bachelor's of Science Degree in Computer Science, Data Analytics, or equivalent
• 10+ years Business intelligence industry experience
• 5+ years of Big Data (Hadoop ecosystem) experience
• 2+ years experience leading client-facing projects
• Extensive experience in Linux or Unix OS Big Data scripting languages (Python, Spark, bash)
• Extensive experience aligning data from disparate sources with varying granularity
• 2+ years Azure cloud experience. Databricks experience a plus
• 1+ years Amazon S3 experience
• Experience working with third-party job schedulers (Control-M, Airflow a plus)
• Eagerness to learn and adapt to evolving Hadoop tooling advancements
• Strong track record in kick-starting, executing, and advancing client-focused projects
• Experience leading offshore development teams
• Strong communication and leadership skills required
• 25% Travel required after COVID restrictions are lifted

Circana Behaviors

As well as the technical skills, experience and attributes that are required for the role, our shared behaviors sit at the core of our organization. Therefore, we always look for people who can continuously champion these behaviors throughout the business within their day-to-day role:

• Stay Curious: Being hungry to learn and grow, always asking the big questions
• Seek Clarity: Embracing complexity to create clarity and inspire action
• Own the Outcome: Being accountable for decisions and taking ownership of our choices
• Center on the Client: Relentlessly adding value for our customers
• Be a Challenger: Never complacent, always striving for continuous improvement
• Champion Inclusivity: Fostering trust in relationships engaging with empathy, respect and integrity
• Commit to each other: Contributing to making Circana a great place to work for everyone

Location

This position can be located in the following area(s): Remote or Chicago, IL

The below range reflects the range of possible compensation for this role at the time of this posting. We may ultimately pay more or less than the posted range. This range may be modified in the future. An employee's position within the salary range will be based on several factors including, but not limited to, relevant education, qualifications, certifications, experience, skills, seniority, geographic location, performance, shift, travel requirements, sales or revenue-based metrics, any collective bargaining agreements, and business or organizational needs. The salary range for this role is $160k to $190k.

This job is also eligible for [bonus/incentive/commissions/equity] pay.

We offer a comprehensive package of benefits including [paid time off, medical/dental/vision insurance and 401(k)] to eligible employees.

You can apply for this role through [methods to apply (e.g., Careers website link and/or Intranet site for internal candidates)].

#LI-MG1

Equal Opportunity Employer/Protected Veterans/Individuals with Disabilities

The contractor will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. However, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by the employer, or (c) consistent with the contractor's legal duty to furnish information. 41 CFR 60-1.35(c)