RM1043.9-2-HMRC - LOT 4 - DATA ENGINEERING CAPABILITY

Description

Summary of the work: HMRC requires a supplier to provide Data Engineering capability under the Technical Delivery Service (TDS), supporting remediation, re-engineering and modernisation of legacy data processes and delivery of modern data platforms, pipelines and reporting solutions. The supplier will support prioritised technology resilience, risk reduction and transformation initiatives across HMRC’s technology estate, including legacy ETL processes and technologies including COBOL, JCL and REXX. Pricing model: Fixed price Provide further information: Background TDS succeeds HMRC’s Technical Health and Technology Resilience Programmes, delivering prioritised technical change to reduce risk and improve resilience, security and technical health across the technology estate. High-Level Outcomes Legacy ETL remediation and modernisation; data pipeline development and optimisation; data integration, migration and transformation; development of modern data platforms, warehouses and data lakes; reporting and visualisation solutions; replacement of legacy reporting; data quality, security, governance and compliance improvements; mobilisation, transition and knowledge transfer. Security Requirements All personnel delivering Lot 4 must hold SC clearance. Indicative Capability Requirements Legacy ETL technologies (including COBOL, JCL and REXX), data pipelines, integration, migration, modelling, data platforms, data quality, reporting, cloud engineering, governance, DevOps, automation, knowledge transfer and continuous improvement. Confirm if you require a contracted out service or supply of resource: Contracted out service: the off-payroll rules do not apply Organisation the work is for: This contract is being procured by HMRC Commercial, on behalf of HMRC CDIO Chief Product Office. Latest start date: 2027-01-30 Expected contract length: 3-00-00 Expected contract structure: Initial term: three (3) years, being thirty-six (36) months. Optional extension(s): Two optional extension periods of 12 months each Estimated contract value (excl VAT): 7080000 Budget details: The estimated value of Lot 3 is seven million and eighty thousand pounds (£7,080,000), inclusive of all extension options. The contract does not guarantee any committed spend. Individual Statements of Work (SoWs) will be agreed between the Buyer and Supplier, setting out the deliverables to be completed within the relevant SoW period. Each SoW will be agreed on a fixed-price basis, with milestone payments made following the Buyer’s acceptance of the completed deliverables. Why the work is being done: HMRC is seeking a Delivery Partner to support the Technical Delivery Service (TDS), which has been established to deliver prioritised technical change that reduces risk, modernises the HMRC technology estate and supports improved resilience, security and technical health across critical business services. TDS is the successor to the Technical Health Programme (THP) and Technology Resilience Programme (TRP) and forms part of HMRC's longer-term technology transformation objectives. The service supports delivery of technical change initiatives arising from HMRC's wider technology portfolio and strategic investment programmes. Lot 4 represents the specialist Data Engineering capability and is intended to provide the expertise required to remediate, re-engineer and modernise legacy ETL processes, and to deliver modern data pipelines, platforms, reporting and visualisation solutions. The successful supplier will play a key role in helping HMRC reduce technology and data-related risk, replace legacy bespoke reporting, improve data quality and accessibility, and support the delivery of secure, resilient and modernised data services across HMRC’s technology estate. Problem to be solved: Lot 4 represents the specialist Data Engineering capability and is intended to provide the expertise required to remediate, re-engineer and modernise legacy ETL processes, and to deliver modern data pipelines, platforms, reporting and visualisation solutions. The successful supplier will play a key role in helping HMRC reduce technology and data-related risk, replace legacy bespoke reporting, improve data quality and accessibility, and support the delivery of secure, resilient and modernised data services across HMRC’s technology estate. Who the users are and what they need to do: As a TDS Programme Manager, I need timely information on data engineering delivery, dependencies and risks so that data modernisation activities can be delivered effectively and managed proactively. As a Senior Responsible Owner, I need clear reporting and assurance on data engineering outcomes, technology risk reduction and service improvements so that I can make informed delivery and investment decisions. As an HMRC Service Owner, I need specialist data engineering support so that legacy ETL processes, data platforms and reporting solutions can be successfully modernised and transitioned. As a TDS stakeholder, I need visibility of data migration, integration and modernisation progress, including risks, issues and dependencies, so that cross-programme impacts can be understood and managed. As an HMRC delivery team, I need modern data pipelines, reporting and visualisation capabilities so that data can be accessed, analysed and utilised more effectively. As a governance forum member, I need reliable information and assurance regarding data engineering activities, security, compliance and delivery progress so that decisions can be made with confidence. As an HMRC user, I need legacy reporting solutions to be replaced with modern, accessible and reliable data visualisation tools so that I can make better use of data and insights. As a TDS delivery lead, I need effective knowledge transfer and transition support so that modernised data services can be adopted, maintained and supported successfully. Preliminary market engagement: N/A Work done so far: The Authority has completed significant scoping and requirements development activity, including: • establishment of the TDS operating model; • identification and prioritisation of technical change initiatives; • development of lot-specific capability requirements; • development of indicative Statements of Work and delivery outcomes; • stakeholder engagement across HMRC technology and delivery teams; and • development of procurement and governance documentation. These activities have informed the requirements described within this procurement. Existing team: The successful supplier will work alongside HMRC personnel, programme leadership teams, technical specialists, service owners and governance stakeholders. The supplier will operate within a multi-supplier environment and will be expected to work collaboratively with incumbent suppliers, other TDS delivery partners and third-party suppliers where required. The Authority expects strong stakeholder management, communication and collaboration capabilities, together with the ability to operate effectively across organisational and supplier boundaries. Incumbent supplier: Yes Provide further information: Key capability areas under this Lot may include legacy ETL remediation and modernisation; data pipeline design, development and optimisation; data integration, migration, transformation and reconciliation; data modelling and metadata management; data warehouse, data lake and analytical platform engineering; data quality management and assurance; modern reporting, visualisation and data-product development; cloud-based data platform engineering; data security, governance and compliance controls; automation through DevOps and CI/CD practices; mobilisation, transition and knowledge transfer; and continuous improvement. Suppliers should note that this procurement is being conducted using a lotting structure. Lot 4 represents the specialist Data Engineering capability and accounts for 5% of anticipated total contract value. Suppliers may bid for one, multiple or all Lots in accordance with the procurement documentation; however, a Supplier may be awarded a maximum of one Lot. Linked projects: The Technical Delivery Service builds upon the outcomes and lessons learned from HMRC's previous Technical Health Programme (THP) and Technology Resilience Programme (TRP). TDS supports delivery of a broad portfolio of technical change initiatives focused on technology modernisation, risk reduction, resilience improvement, technical debt remediation, migration and wider technology transformation objectives. Work commissioned under this Lot may support linked programmes and initiatives across HMRC's technology portfolio where governance, assurance, planning and delivery coordination capabilities are required. Working arrangements: The successful supplier will operate as a delivery partner supporting HMRC's Technical Delivery Service (TDS) within a complex multi-supplier environment. The supplier will work collaboratively with HMRC delivery teams, service owners, programme stakeholders, incumbent suppliers and third-party suppliers. Activities are expected to include business analysis, governance, planning, assurance, reporting, stakeholder engagement and coordination of technical change initiatives. Delivery is expected to utilise a hybrid working model. Activities may be undertaken remotely where appropriate, however attendance at HMRC offices and stakeholder meetings may be required to support effective delivery, governance activities, mobilisation, workshops, planning sessions and knowledge-transfer activities. All travel and subsistence costs should be included within supplier rates unless otherwise agreed in an individual Statement of Work. The supplier will be expected to work within HMRC governance processes and utilise HMRC-approved tooling where required, including Microsoft 365, Jira, Clarity, Microsoft Project and ServiceNow. Security clearance: Baseline Personnel Security Standard (BPSS) Security clearance: Security Check (SC) Additional information on security clearance: All personnel associated with the delivery of Lot 4 capabilities must hold Security Check (SC) clearance before commencing delivery. The Supplier must maintain a sufficient pipeline of appropriately SC-cleared personnel throughout the Contract term to meet mobilisation and delivery requirements Special terms and conditions: The successful supplier will be required to operate within HMRC's security, governance and assurance frameworks and comply with all applicable HMRC policies, standards and procedures. Delivery will be commissioned through Statements of Work issued throughout the contract term. The supplier will be required to: • operate effectively within a complex multi-supplier delivery environment; • support governance, reporting and assurance activities; • maintain appropriate knowledge-transfer arrangements; • support mobilisation, transition and supplier handover activities where required; • utilise HMRC-approved delivery and collaboration tooling where applicable; • provide appropriately qualified and experienced personnel; and • comply with HMRC security and vetting requirements. Additional contract schedules, security requirements and Statement of Work terms will be provided to shortlisted suppliers during Stage 2 of the procurement process