Position Summary
The Senior Data Integration Engineer provides senior-level data engineering and integration support for the HAF/A2 – A2FF ISR Readiness Data Engineering and Dashboard Modernization Support task order. The role designs, develops, sustains, and improves secure data integrations and ETL/ELT pipelines that connect ISR readiness data from DRRS, DEERS, Envision, ASERT, and other Air Force, DoD, and Intelligence Community data sources.
The Senior Data Integration Engineer is responsible for transforming heterogeneous readiness data into documented, reliable, reusable, and auditable data products that support predictive analytics, readiness assessments, ISR Enterprise Dashboard capabilities, senior leader reporting, and other Government decision-support requirements.
The position works closely with the ISR Readiness Program and Data Integration Lead, Data Scientists / AI-ML Analysts, Data Governance / Quality Analysts, Data Visualization / BI Developers, ISR Readiness SMEs, and Government stakeholders to ensure data pipelines, mappings, transformations, quality controls, and interfaces remain aligned with mission and technical requirements.
This position is contingent upon contract award, with an anticipated salary range of $185k – $205k based on candidate qualifications and final contract requirements.
Work Environment
- Work Location: National Capital Region (NCR)
- Security Clearance: TS/SCI
- Work may occur within Government facilities and classified computing environments.
- Position may require support across NIPR, SIPR, and JWICS environments based on Government requirements.
- Authorized CONUS or OCONUS travel may be required based on task-order needs.
Compensation
Karthik Consulting is committed to providing competitive compensation based on the responsibilities of the role, required qualifications, security clearance level, relevant experience, certifications, customer requirements, geographic location, and overall business needs. The salary range listed for this position represents a good-faith estimate of the current compensation range for this role.
At Karthik Consulting, it is not typical for an individual to be hired at or near the top of the salary range. Final compensation decisions are based on the facts and circumstances of each candidate’s experience, qualifications, certifications, clearance level, contract requirements, and overall alignment with the role.
Employees may be eligible for company benefits and additional compensation programs, subject to company policy, contract requirements, and individual eligibility.
Program Context
Program Description
The A2FF ISR Readiness Data Engineering and Dashboard Modernization Support task order supports HAF/A2 – A2FF Readiness Branch in developing, sustaining, and modernizing ISR readiness analytics and dashboard capabilities.
The program integrates information across Air Force, DoD, and Intelligence Community data sources to improve ISR readiness visibility and senior leader decision support. Required capabilities include updated data pipelines, predictive analytics, AI/LLM documentation, dashboards, cross-domain deployment, governance artifacts, stakeholder coordination, and technical reporting.
Program Scope
The data engineering portion of the program includes:
- Integration of readiness data from DRRS, DEERS, Envision, ASERT, and other approved data sources.
- Development, sustainment, and modernization of ETL/ELT pipelines.
- Data mapping and transformation logic.
- Documented and auditable analytic processing workflows.
- Data validation and automated quality checks.
- Data lineage and data dictionary support.
- Business-rule implementation.
- Pipeline versioning and engineering documentation.
- Dashboard and predictive analytics data support.
- Multi-classification deployment supporting NIPR, SIPR, and JWICS.
- Automation and incremental process improvement.
- Technical documentation and repository management.
Key Responsibilities
DATA INTEGRATION AND PIPELINE ENGINEERING
- Design, develop, test, sustain, and optimize ETL/ELT pipelines supporting ISR readiness data and analytics.
- Develop and maintain integrations between DRRS, DEERS, Envision, ASERT, and other Government-designated readiness systems.
- Translate source-system structures and mission requirements into documented data mappings, transformations, schemas, and processing workflows.
- Develop reliable ingestion, transformation, validation, and publication processes supporting downstream analytics, dashboards, and readiness assessments.
- Implement reusable data-integration patterns that improve consistency, maintainability, and reliability across readiness data sources.
- Troubleshoot pipeline failures, integration defects, transformation errors, schema changes, and source-data issues affecting readiness products.
- Maintain data pipelines in Government-approved repositories with appropriate version control and documentation.
- Support scheduled and ad hoc pipeline updates required to incorporate Government feedback, new data sources, or changing readiness requirements.
DATA MODELING, MAPPING, AND TRANSFORMATION
- Analyze source-system structures, fields, relationships, formats, and business rules to determine appropriate integration methods.
- Develop and maintain source-to-target mappings supporting ISR readiness data products.
- Define and implement transformation logic required to standardize, cleanse, normalize, combine, and prepare readiness data for downstream use.
- Document transformation rules, processing logic, dependencies, assumptions, and known data constraints.
- Maintain consistency across integrated datasets by applying documented naming conventions, definitions, reference data, and approved business rules.
- Support development of semantic or analytical data structures required by predictive analytics, visualization, and readiness reporting teams.
- Evaluate impacts of source-system or schema changes and coordinate updates to affected pipelines and downstream products.
DATA QUALITY, VALIDATION, AND TRACEABILITY
- Develop and implement automated data-quality and validation checks across ingestion, transformation, and publication workflows.
- Identify missing, incomplete, inconsistent, duplicate, stale, anomalous, or incorrectly transformed readiness data.
- Coordinate with Data Governance / Quality Analysts and mission SMEs to evaluate data-quality findings and develop appropriate remediation actions.
- Maintain traceability from source systems through transformations to downstream readiness products.
- Document identified data limitations and ensure affected technical teams understand potential impacts on dashboards, predictive analytics, and readiness assessments.
- Support development of data-quality assessment reports and remediation recommendations.
- Design workflows to support repeatable and auditable readiness assessments.
DATA GOVERNANCE AND ENGINEERING DOCUMENTATION
- Develop and maintain engineering documentation for pipelines, integrations, transformations, interfaces, data models, and processing workflows.
- Support development and maintenance of data dictionaries, data lineage documentation, quality rules, and business-rule artifacts.
- Maintain version history and change documentation for engineering updates.
- Ensure pipeline logic, dependencies, configuration requirements, and technical assumptions are documented sufficiently to support Government review and long-term sustainment.
- Coordinate with governance personnel to ensure technical implementation remains aligned with approved data definitions and rules.
- Support configuration management and documentation requirements within Government-approved repositories.
- Ensure technical documentation remains synchronized with deployed pipeline and integration changes.
ANALYTICS AND DASHBOARD DATA ENABLEMENT
- Develop and maintain trusted data feeds supporting predictive analytics, trend analysis, forecasting, degradation assessment, and readiness reporting.
- Coordinate with Data Scientists / AI-ML Analysts to provide documented datasets and transformations supporting model development and refreshed analytic runs.
- Coordinate with Data Visualization / BI Developers to provide validated and appropriately structured datasets for ISR Enterprise Dashboard capabilities.
- Troubleshoot discrepancies between source data, pipeline outputs, analytical products, and dashboard displays.
- Support development of integrated data products that combine quantitative readiness information with Government-approved contextual data.
- Ensure downstream users understand data definitions, refresh cycles, transformation logic, limitations, and quality considerations.
- Support Government-directed changes to data products resulting from stakeholder feedback or readiness-reporting requirements.
CROSS-DOMAIN DATA INTEGRATION SUPPORT
- Support development and maintenance of data products and deployment packages capable of operating across approved NIPR, SIPR, and JWICS environments.
- Coordinate with cybersecurity, platform, and infrastructure personnel to address data-integration dependencies associated with multiple classification environments.
- Ensure data-processing workflows and technical artifacts are compatible with applicable Government-approved architectures, repositories, and security controls.
- Support portability and repeatability of approved analytics and dashboard data products across classification environments.
- Document environment-specific dependencies, configurations, limitations, and integration requirements.
- Follow applicable DD Form 254, Security Classification Guide, CUI, classified-information, and Government system-handling requirements.
AUTOMATION AND PROCESS IMPROVEMENT
- Identify opportunities to automate manual data ingestion, transformation, validation, reconciliation, and reporting activities.
- Develop or support automated methods, algorithms, and data-quality checks that improve reliability and reduce manual workload.
- Analyze pipeline performance and recommend improvements to throughput, maintainability, data freshness, and operational reliability.
- Support quarterly recommendations for improvements to readiness data collection, integration, and reporting processes.
- Evaluate Government-approved technologies and engineering approaches that may improve data integration and automation.
- Document test results and technical evidence demonstrating accuracy and reliability of updated methods or automated controls.
- Implement improvements incrementally to minimize disruption to operational readiness products.
TECHNICAL INTEGRATION AND CROSS-FUNCTIONAL COORDINATION
- Coordinate with ISR Readiness SMEs to understand readiness data definitions, reporting requirements, operational context, and data dependencies.
- Coordinate with Data Scientists, BI Developers, governance personnel, technical leads, and Government stakeholders to resolve cross-functional integration issues.
- Support technical reviews, working groups, and stakeholder engagements involving readiness data and integration requirements.
- Communicate technical risks, data dependencies, integration constraints, and remediation recommendations clearly to technical and non-technical audiences.
- Assess downstream impacts before implementing significant pipeline or data-structure changes.
- Provide engineering inputs to technical briefings, status reports, process-improvement recommendations, and decision-support products.
- Maintain close coordination with the ISR Readiness Program and Data Integration Lead regarding technical status, dependencies, risks, and deliverables.
ROLE-SPECIFIC DELIVERABLE OWNERSHIP
- Own role-level inputs for updated ETL/ELT pipelines and associated engineering documentation.
- Own source-to-target mappings, transformation logic, pipeline documentation, and applicable integration records.
- Maintain engineering artifacts within Government-approved repositories.
- Support data governance artifacts, data-quality assessments, dashboard releases, predictive analytic inputs, process-improvement recommendations, and Monthly Status Report inputs.
- Review engineering products for functional completeness, data traceability, documentation quality, requirement alignment, and technical accuracy.
- Maintain configuration and version-control discipline for code, pipeline logic, technical documentation, and related engineering artifacts.
- Identify technical risks, dependencies, defects, and potential schedule impacts early and coordinate resolution.
- Operate in accordance with classified-environment requirements, Government-approved tools and repositories, applicable security controls, and non-personal services boundaries.
- Maintain focus on engineering and technical recommendations; final Government data policy, methodology, and mission decisions remain Government responsibilities.
Qualifications
Education
Bachelor’s degree preferred in:
- Computer Science
- Data Engineering
- Information Technology
- Information Systems
- Software Engineering
- Systems Engineering
- Computer Engineering
- Data Science
- Cybersecurity
- Mathematics
- Operations Research
- Other STEM-related field
Equivalent senior-level DoD, IC, Air Force, data engineering, software engineering, systems integration, or enterprise data experience may substitute where appropriate.
Professional Certifications
Preferred certifications may include:
- Security+ CE or equivalent DoD 8140/8570 certification where required
- Microsoft Azure Data Engineer or comparable Azure data certification
- AWS data engineering or cloud certification
- Databricks data engineering certification
- Cloud architecture or cloud engineering certification
- Data management or governance certification
- SAFe, Scrum, Agile, or DevSecOps certification
- DataOps certification or comparable data lifecycle credential
- Relevant database, data integration, or analytics platform certification
Minimum Qualifications
- Active TS/SCI clearance.
- 8+ years of professional experience in data engineering, data integration, ETL/ELT development, software engineering, systems integration, data architecture, or related technical disciplines.
- Experience developing and maintaining enterprise data pipelines and integration workflows.
- Experience integrating data from multiple heterogeneous enterprise or mission systems.
- Demonstrated experience with ETL/ELT concepts, source-to-target mappings, transformation logic, data validation, schema management, and pipeline troubleshooting.
- Experience working with structured and semi-structured data.
- Experience with SQL and at least one commonly used programming or scripting language for data processing and automation.
- Experience implementing automated data-quality checks and troubleshooting data integrity issues.
- Experience using version control and maintaining engineering documentation within managed repositories.
- Experience supporting downstream analytics, business intelligence, dashboard, or machine-learning use cases.
- Experience collaborating with data scientists, analysts, BI developers, governance personnel, mission SMEs, and Government stakeholders.
- Experience operating within DoD, Intelligence Community, Air Force, or similarly controlled enterprise environments.
- Strong written and verbal communication skills with the ability to document complex data-integration processes and explain technical issues to both technical and non-technical stakeholders.
Preferred Qualifications
- Experience supporting HAF/A2, A2FF, AF A2/6, Air Force Intelligence Community, MAJCOM, Combatant Command, Joint Staff, OSD, ODNI, or comparable DoD/IC organizations.
- Experience with ISR readiness or other operational readiness data.
- Familiarity with DRRS, DEERS, Envision, ASERT, or similar Air Force / DoD readiness and enterprise data systems.
- Experience developing data products supporting MET/METL, GFMB, senior leader readiness reporting, or mission assessments.
- Experience supporting data engineering across NIPR, SIPR, and JWICS environments.
- Experience with cloud-based data architectures and Government-approved data platforms.
- Experience with Python, SQL, APIs, data orchestration tools, notebooks, relational databases, and modern data-processing frameworks.
- Experience implementing data lineage, metadata, data dictionaries, business rules, and governance controls.
- Experience supporting predictive analytics, AI/ML, LLM, or advanced analytics workloads.
- Experience implementing DataOps, DevSecOps, CI/CD, automated testing, or infrastructure automation practices for data solutions.
- Experience optimizing enterprise pipelines for performance, resiliency, scalability, and maintainability.
- Ability to operate effectively in classified, mission-focused environments where data quality, traceability, security, documentation, and operational reliability are critical.
Core Competencies
- ACCOUNTABILITY & OWNERSHIP
Owns readiness data integrations, ETL/ELT pipelines, source-to-target mappings, transformation logic, engineering documentation, technical issue resolution, and associated integration support actions. - COMMUNICATION & COLLABORATION
Coordinates across Government stakeholders, readiness SMEs, data scientists, BI developers, governance personnel, cybersecurity teams, and KC leadership to maintain reliable and mission-aligned data capabilities. - ANALYTICAL THINKING
Evaluates source structures, transformation requirements, data dependencies, quality issues, schema changes, pipeline behavior, and downstream impacts to develop reliable and maintainable integration solutions. - QUALITY & COMPLIANCE
Maintains data traceability, engineering documentation, automated validation, version-control discipline, security compliance, Government-approved repository alignment, and careful handling of classified and sensitive information. - ADAPTABILITY & INITIATIVE
Responds effectively to changing source systems, schemas, mission requirements, Government feedback, data-quality issues, emerging integration risks, and evolving readiness reporting needs. - TECHNICAL INTEGRATION & ENGINEERING DISCIPLINE
Designs and sustains repeatable, auditable, secure, and interoperable data workflows while managing dependencies across source systems, analytics, dashboards, governance, and classification environments. - CUSTOMER & MISSION FOCUS
Connects reliable data engineering and integration to A2FF readiness analytics, ISR Enterprise Dashboard capabilities, predictive analytics, senior leader reporting, and Government decision support.