Data Engineer
Company
Accrete AI
Location
New York City, NY
Type
Full Time
Job Description
- The U.S. Government agencies we work with have contracts that require all personnel working on their corresponding contracts to have U.S. citizenship – do you meet this requirement?
Accrete is looking for a Data Engineer that will be responsible for supporting production data pipelines, developing the foundation for the Accrete data lake, and implementing best practices from data engineering at Accrete. This will support new and existing applications running on Linux and Windows operating systems in private and public cloud infrastructures. The Data Engineering team at Accrete designs, develops, and maintains data pipelines, batch data analytics, and data stores of various kinds, including analytics and stores in support of artificial intelligence workloads for Accrete AI systems and applications.
Accrete is an AI prime defense contractor with the U.S. government that creates AI software, enabling its customers to make better decisions, faster. Accrete is on a mission to create AI so powerful it amplifies human reasoning and enables enterprises to grow in previously unimaginable ways. Prior to launching Accrete in 2017, Prashant Bhuyan, Accrete’s Founder and CEO, spent over a decade in high-frequency trading where he and a core team experimented with and developed AI technology that ultimately became the early underpinnings of Accrete.
Accrete’s solutions enable the Department of Defense to predict covert behavior from foreign adversaries seeking to influence the supply chain; the U.S. Air Force to identify vulnerabilities in microprocessor firmware; major music labels to identify superstars before competitors; auto dealers to automatically generate marketing content from vehicle feature lists; employee benefits brokers to identify the shortest path to the hottest leads; and more.
To learn more about Accrete, please visit our website: Accrete.ai
Responsibilities:
- Design, develop, and support specific scalable pipelines for the movement of data between systems.
- Provide technical guidance in software design and development activities.
- Supervising and overseeing aspects of data engineering on multiple work streams.
- Recommend new technologies to ensure quality and productivity.
- Work closely with other teams, tech leads, architects, and Product Management to bring new data-backed products to market.
Requirements:
- 2-3+ years of expertise with a data-oriented language, such as Python, C, Rust, Java, Go.
- 2-3+ years experience in cloud computing, with AWS, Azure or GCP
- 2-3+ years experience designing and building scalable, reliable data pipelines using the following technologies: Hadoop, Hive, Spark, Kafka, Airflow, or similar services
- Experiencing designing for and implementing in cloud-native systems
- Expertise in matching APIs, data access patterns, and data storage formats
- Functional knowledge of event processing systems such as Apache Kafka or similar
- Functional knowledge of the following databases or equivalent: Postgres, MongoDB, Neo4J, Redis
- High collaborative, values mentoring, teaching, pair-programming, and teaching software development best practices to other engineers
- Excellent problem-solving and critical-thinking skills
- Ability to build and maintain effective, trusting partnerships with product managers, architects, and technical leads for individual products and applications
- Excellent communication and leadership skills
The base salary range for this role is $135,000 to 140,000.
Benefits:
We offer a competitive salary, benefits package, and opportunities for growth and advancement within the company. If you are an innovative and results-driven leader, we encourage you to apply for this exciting opportunity.
Accrete is an equal opportunity/affirmative action employer. All qualified applicants will receive consideration for employment without regard to sex, gender identity, sexual orientation, race, color, religion, national origin, disability, protected Veteran status, age, or any other characteristic protected by law.
Date Posted
04/24/2024
Views
0
Similar Jobs
Supervisory Medical Records Technician (Coder) - Department of Veterans Affairs - Veterans Health Administration
Views in the last 30 days - 0
View DetailsHealthcare Engineer - Department of Veterans Affairs - Veterans Health Administration
Views in the last 30 days - 0
View DetailsDental Assistant - Department of Veterans Affairs - Veterans Health Administration
Views in the last 30 days - 0
View DetailsMEDICAL RECORDS TECHNICIAN (CDIS- Outpatient/Inpatient) - Department of Veterans Affairs - Veterans Health Administration
Views in the last 30 days - 0
View DetailsMed Sup Asst - Department of Veterans Affairs - Veterans Health Administration
Views in the last 30 days - 0
View Details