Principal Data Engineer

At Hypergiant, we are redefining what’s possible. Our team is made up of a diverse group of individuals who are implementing solutions to build a better world. 

Hypergiant is a Texas based software company that creates powerful data visualization products for the space, defense, and critical infrastructure sectors. Our data-agnostic AI platform rapidly assimilates needed information and creates streamlined, efficient workflows that clearly define the journey from data to decision with our optimized UI/UX framework. We also partner with well-known consumer facing tech companies to bring the best and brightest talent to their workforce.

We are looking for a Principal Data Engineer to work alongside and across our balanced agile delivery teams on highly complex DoD projects, specifically the development of a data service for command and control (C2) software. Hypergiant with its partners is building an innovative cloud-based command and control system that seamlessly integrates existing capabilities and provides automation that improves efficiency and effectiveness of mission planning and execution. A perfect candidate is able to write high-quality code, integrate with partner capability providers, ensure code and product quality, provide technical leadership, and foster innovative thinking. This position will work alongside our development team and other capability providers on highly complex DoD projects.

Roles & Responsibilities

· Develop and continuously improve a data service that underpins cloud-based applications

· Support data and database modeling efforts

· Contribute to the development and maintenance of reusable component libraries and shared codebase

· Participate in the entire software development lifecycle, including requirement gathering, design, development, testing, and deployment, using an agile, iterative process

· Collaborate with developers, designers, testers, project managers, product owners, and project sponsors to integrate the data service to end user applications

· Communicate tasking estimation and progress regularly to a development lead and product owner through appropriate tools

· Ensure seamless integration between database and messaging systems and the frontend / UI they support

· Ensure data quality, reliability, and performance through code reviews and effective testing strategies

· Write high-quality code, applying best practices, coding standards, and design patterns

· Team with other developers, fostering a culture of continuous learning and professional growth

Minimum Qualifications

· 15+ years of professional software development or data engineering experience (12+ with a STEM B.S. or 10+ with a relevant Master's degree)

· Strong proficiency in Python and familiarity with Java and Bash scripting

· Hands-on experience implementing database technologies, messaging systems, and stream computing software (e.g., PostgreSQL, PostGIS, MongoDB, DuckDB, KsqlDB, RabbitMQ)

· Experience with data fabric development using publish-subscribe models (e.g., Apache NiFi, Apache Pulsar, Apache Kafka and Kafka-based data service architecture)

· Proficiency with containerization technologies (e.g., Docker, Docker-Compose, RKE2, Kubernetes, and Microk8s)

· Experience with version control systems (e.g., Git), CI/CD tools (e.g., Jenkins), and collaborative development workflows

· Strong knowledge of data modeling and database optimization techniques

· Familiarity with data serialization languages (e.g., JSON, GeoJSON, YAML, XML)

· Excellent problem-solving and analytical skills that have been applied to high visibility, important data engineering projects

· Strong communication skills and ability to lead the work of other engineers in a collaborative environment

· Demonstrated experience in coordinating team activities, setting priorities, and managing tasks to ensure balanced workloads and effective team performance

· Experience managing and mentoring development teams in an Agile environment

· Ability to make effective architecture decisions and document them clearly

· Must be a US Citizen and eligible to obtain and maintain a US Security Clearance

Preferred Qualifications

· Cloud platforms (e.g., AWS, Azure, GCP) and deployment strategies experience (Ansible, Terraform, WebGL)

· Geospatial information system (GIS) experience (e.g., Geoserver)

· Data science and AI/ML applications experience

· Experience managing robust build & test tools and implementing workflow automations / scripts

· Penchant for learning new technologies, balanced with strong pragmatic thinking

· Design-minded attention to detail in data service implementation

· Leadership of a fully remote team

· Portfolio of past projects with code samples

· Ability to travel as needed

· Active Security Clearance