Database Engineer
Company
IBM
Location
US Washington
Type
Full Time
Job Description
At IBM work is more than a job – it’s a calling: To build. To design. To code. To consult. To think along with clients and sell. To make markets. To invent. To collaborate. Not just to do something better but to attempt things you’ve never thought possible. Are you ready to lead in this new era of technology and solve some of the world’s most challenging problems? If so lets talk.
Your Role and Responsibilities
Octo an IBM company is an industry-leading award-winning provider of technical solutions for the federal government. At Octo we specialize in providing agile software engineering user experience design cloud services and digital strategy services that address government’s most pressing missions. Octo delivers intelligent solutions and rapid results yielding lower costs and measurable outcomes.
Our team is what makes Octo great. At Octo you’ll work beside some of the smartest and most accomplished staff you’ll find in your career. Octo offers fantastic benefits and an amazing workplace culture where you will feel valued while you perform mission critical work for our government. Voted one of the region’s best places to work multiple times Octo is an employer of choice!
You…
Are you an experienced Senior Database Engineer? Are you looking for a significant career growth opportunity? You will be joining the team that is building a DIA Enterprise Data Platform (EDP) that will facilitate the transition and retirement of duplicative and legacy data services and provide an automated modernized enterprise data hub within a secure environment. EDP will enable DIA to expose its data to a wider audience through a zero-trust based data centric architecture.
Us…
Octo offers modern approaches to solve your toughest challenges. We believe the status quo can be improved and we’ve made it our job to use emerging technology to help our customers achieve their objectives with the most modern systems and software possible. That’s why our digital solution innovators develop transformative scalable solutions to make sure your agency is always a step ahead.
Program Mission…
Be a part of building a DIA Enterprise Data Platform (EDP) that will facilitate the transition and retirement of duplicative and legacy data services and provide an automated modernized enterprise data hub within a secure environment. EDP will enable DIA to expose its data to a wider audience through a zero-trust based data centric architecture. Based on a robust data governance policy approach EDP will free data from siloes and allow more users to gain valuable insights from DIA data assets. RAS will maintain and improve the EDP to ensure DIA has high data availability accessibility veracity integration and discoverability while enabling data analytics visualization security governance and management across the enterprise.
Responsibilities…
In this role you will:
· Data Onboarding Architecture: Data Engineers design and create the overall data onboarding architecture for DDH. They work closely with stakeholders to understand their data requirements and translate them into scalable data models and structures.
· Data Analysis: Inspect data with the goal of discovering useful information needed to create data schemas.
· Data Pipeline Development: Data Engineers build data pipelines to extract transform and load (ETL) data from various sources into data warehouses. They develop efficient and reliable ETL processes to ensure data quality integrity and timeliness.
· Data Integration: Data Engineers integrate disparate data sources and systems both internal and external to enable seamless data flow across different platforms. They may work with APIs databases cloud services and third-party tools to establish data connections and ensure smooth data integration.
· Data Transformation and Processing: Data Engineers transform raw data into a format suitable for analysis or consumption. This involves cleaning filtering aggregating and structuring the data using tools like SQL Python.
· Data Quality and Governance: Ensuring data quality and integrity is a crucial responsibility of Data Engineers. They implement data quality checks data validation rules and data governance practices to maintain accurate and consistent data throughout the data lifecycle.
· Scalability and Performance: Data Engineers optimize data pipelines and infrastructure for scalability and performance.
· Data Security: Data Engineers play a role in securing data assets by validating security policies are implemented for the data.
· Monitoring and Troubleshooting: Data Engineers monitor data pipelines and systems to identify and resolve issues proactively.
· Collaboration: Data Engineers collaborate with internal DDH teams and cross-functional teams (CDO MARs).
· Customer Engagement: Engage in regular meetings and communication channels with Data Stewards and Data Steward Representatives to gather information needed to appropriately understand and secure their data in preparation for data onboarding.
· Provide “white glove” service to Data Stewards for data onboarding questionnaire assistance.
· Training and User Support: Provide training to Data Stewards and end users on DDH UI.
· Documentation: Author or update documentation such as the Data Onboarding Execution Plan data onboarding Standard Operating Procedure and any associated DDH documentation (CONOPS CDD).
Years of Experience : Bachelor’s Degree + 10 years or Master’s Degree + 12 years experience or 16 years of experience.
Education : Bachelor’s degree or greater (desired)
Location : Reston VA or Riverdale MD
Clearance : TS/SCI w/ CI Poly
Required Technical and Professional Expertise
- TS/SCI clearance with a CI Poly
- Data Modeling and Database Design: Proficiency in designing efficient and scalable data models understanding relational and non-relational databases and knowledge of SQL
- ETL and Data Integration: Experience with Extract Transform Load (ETL) processes data integration techniques and tools like Apache NiFi.
- Programming and Scripting: Strong programming skills in languages such as Python.
- Data Warehousing: Understanding of data warehousing concepts and experience with data warehouse technologies.
- Data Pipeline and Workflow Tools: Proficiency in tools for building and managing data pipelines and workflows.
- Data Streaming: Knowledge of real-time data streaming technologies such as Apache Kafka for processing and analyzing streaming data.
- Data Quality and Governance: Understanding of data quality frameworks data validation techniques and experience implementing data governance practices.
- Cloud Platforms: Familiarity with cloud platforms like Amazon Web Services (AWS and their relevant data services.
- Data Security: Knowledge of data security best practices data encryption techniques and understanding of privacy regulations.
- Data Visualization: Ability to work with data visualization tools like Tableau Power BI or QlikView to create meaningful visualizations and reports.
- Problem Solving and Troubleshooting: Strong analytical and problem-solving skills to identify and resolve issues in data pipelines databases or data infrastructure.
- Collaboration and Communication: Effective communication skills to collaborate with cross-functional teams understand requirements and present technical solutions to non-technical individuals.
- Continuous Learning: A mindset of continuous learning and keeping up-to-date with evolving technologies tools and industry trends in the field of data engineering.
- Strong critical thinking skills with Inquiring mind / inquisitive nature
- Microsoft Office proficiency
- Clearance : TS/SCI w/ CI Poly
Preferred Technical and Professional Expertise
.
Date Posted
10/26/2023
Views
12
Similar Jobs
RN SPU Endoscopy 4-10's New Contract Differentials Capitol Hill Seattle - Kaiser Permanente
Views in the last 30 days - 0
View DetailsInterdisciplinary Architect/General Engineer/Community Planner - Legislative Branch - Architect of the Capitol
Views in the last 30 days - 0
View DetailsWood Crafter - Legislative Branch - Architect of the Capitol
Views in the last 30 days - 0
View DetailsHealthcare Engineer-Project Engineer - Department of Veterans Affairs - Veterans Health Administration
Views in the last 30 days - 0
View DetailsCYP Assistant JPCDC - Department of the Navy - Commander, Navy Installations
Views in the last 30 days - 0
View DetailsNew Parent Support Home Visitor - Department of the Navy - Commander, Navy Installations
Views in the last 30 days - 0
View Details