Data Engineerring and Extraction Specialists

Description

Work done so far There is an existing environment/framework and part of the process which we are looking to build on. Which phase the project is in Beta Existing team Some internal developer resource Address where the work will be done Spring Gardens, Units 1-6 Citadel Place, Tinworth Street, London SE11 5EF Working arrangements Hybrid working resources required to attend Spring Gardens on a regular basis (2 days per week) to collaborate and sync with internal development teams. No expenses can be charged for attendance at the stated location address. Other travel expenses will be charged at cost and within the NCA Travel and Subsistence Policy Provide more information about your security requirements: Security Check (SC) Provide more information about your security requirements (optional): SC with NCA enhanced checks. The NCA will fund the cost of obtaining the NCA SC Enhanced checks Latest start date 2023-09-04 Enter the expected contract length: 8 months Extension period: 4 months Special terms and conditions 1. Official Secrets Act 1911 to 1989, S182 of the Finance Act 1989 1.1 The Contractor shall comply with, and shall ensure that its Staff comply with: 1.1.1 the provisions of the Official Secrets Acts 1911 to 1989; and 1.1.2 the provisions of Section 182 of the Finance Act 1989. 1.2 In the event that the Contractor or its Staff fail to comply with this clause, the Authority reserves the right to take any or all of the following actions: 1.2.1 terminate the Contract by giving notice in writing to the Contractor; 1.2.2 to initiate criminal proceedings Special terms and conditions 2. Contractor’s Staff 2.1 The Contractor must have policies and processes in place covering pre and post-employment checks for all staff including compliance with Employment Legislation relating to identity checks and establishing ‘right to work’ in the UK. 2.2 At the Authority’s written request, the Contractor shall provide a list of the names and addresses of all persons who may be employed on the Contract specifying the capacities in which they are concerned with the Contract and giving such other particulars as the Authority may reasonably request. 2.3 The Contractor shall comply with the Authority’s Staff Vetting Requirements as detailed in the specification in respect of all persons employed or engaged in the provision of the Services. 2.4 The Authority may, by written notice to the Contractor, refuse to admit onto, or withdraw permission to remain on any of the Authority’s sites: 2.4.1 any member of the Contractor’s Staff; or 2.4.2 any person employed or engaged by any member of the Contractor’s staff, whose admission or continued presence would, in the reasonable opinion of the Authority, be undesirable. 2.5 The Authority shall not disclose its reasons for considering an individual unsuitable. Any such unsuitability is not an indication that the individual is unsuitable to work on other Contracts for the Contractor. 2.6 The decision of the Authority as to the suitability of any person employed upon this service shall be final and conclusive. Special terms and conditions 3. Publicity and Branding 3.1 The Contractor shall not (and shall procure that no Sub-contractor shall) make any advertisement, public statement or press announcement in relation to this Contract or the provision of the Goods or Services without the Authority’s prior written consent. 3.2 The Contractor shall not use any of the Authority’s Intellectual Property Rights, including (but not limited to) the Authority's names, branding, domain names, logos or trade marks on any of its products or services or in any promotional, marketing or similar material or advertising without the Authority’s prior written consent. 3.3 The Contractor hereby agrees and acknowledges that the unauthorised use of the Authority’s names, branding, domain names, logos and/or trade marks may be breach of Crown copyright and that legal action may be taken against it in the event of any unauthorised use of such material. This applies to all Authority-owned brands including (but not limited to) the Authority's corporate identity, Child Exploitation and Online Protection (CEOP) command brands and/or campaign brands. All requests for external use of a NCA brand must be approved in writing by the Authority branding team and the Contractor shall in each case seek to obtain such approval in advance by submitting an approval request to branding@nca.gov.uk. 3.4 Nothing in this Contract constitutes an endorsement by the Authority of the Contractor's goods or services, and the Contractor shall not conduct itself in a way that implies any endorsement or authorisation by the Authority. Special terms and conditions 4. Freedom of Information 4.1 For the purpose of the FOIA, the Authority is not a 'public authority'(as listed in Schedule 1 of the Act), and is not under any duty to disclose information. The Authority is also not listed as a ‘Scottish Public Authority’ in the Freedom of Information (Scotland) Act 2002. In addition any information from, or relating to the Authority has an absolute exemption from disclosure by other public authorities by virtue of Section 23 of the Act (as amended by the Crime and Courts Act 2013). Any request for information must be referred to the Authority’s FOI single point of contact, by email to PICUEnquiries@nca.gov.uk or by telephoning 0870 268 8677. 4.2 Additionally, the Authority will not provide a public authority with any Information in respect of a Request for Information they receive. However, Information received from, (either directly or indirectly), or “relating to” the Authority that is already held by the public authorities or their sub-contractors, has additional protection from release to the public by virtue of section 23 of the FOIA. The Authority’s Information may also be covered by the FOIA Section 24 exemption, this is applicable to Information the non-disclosure of which is necessary to safeguard national security. 4.3 It is important that the Contractor understands the different legislation covering the Authority under Section 23 of the FOIA, so as not to inadvertently breach the FOIA. 4.4 The Contractor shall acknowledge the Authority’s position in respect of the FOIA and agree to assist and co-operate in order to enable the Authority to best protect its Information. The Contractor shall also ensure that any sub-contract the Contractor enters into also contains a condition in similar terms. 4.5 Failure to comply with this policy may result in an unauthorised disclosure of the Authority’s information and a potential breach of the Official Secrets Act. 4.6 The provisions of this Clause shall survive termination or expiry of the Contract. Special terms and conditions 5. Security Measures Please see attached Document Special terms and conditions 6. Security Requirements and Information Security 6.1 The Contractor must meet all the Authority’s relevant security policies as notified by the Authority, from time-to-time. 6.2 All Staff employed on the Contract, including the Contractor’s and Sub-contractor’s staff, must hold the appropriate level of security clearance, as stated by the Authority. 6.3 The Contractor must comply with Her Majesty’s Government Security Policy Framework and the Government’s Security Classification and any amendments or revised editions to this document which may be issued from time-to-time. 6.4 The Contractor shall bring to the attention of the Authority any business development outside of the Authority’s areas of responsibility which is likely to give rise to a security risk. 6.5 The Contractor shall have in place appropriate security systems and policies at all sites within its organisation, and at any relevant Sub-contractors, in relation to the handling and storage of any Authority related documentation and/or assets. 6.6 The Contractor shall ensure, and provide written evidence, that an Information Security Policy is in place. The policy shall also cover Confidential Information and Authority Data risk. The policy must be communicated to any individuals with access to systems where any Confidential Information and/or Authority Data are processed. 6.7 The Contractor shall ensure that all access to, and use of, any Authority Data or Confidential Information involving Authority business (including, but not limited to, Personal Data, financial records such as invoices and any other data, as well as the tracking of the assets) shall be controlled and that only authorised personnel shall have access. Robust controls and capabilities for access, auditing and monitoring shall be in place to ensure: 6.7.1 the prevention of attempts to gain access, and 6.7.2 identification of actual unauthorised access. 6.8 The Contractor shall allocate responsibilities for Information Security wherever Authority business or information or assets are involved and the Contractor shall take all reasonable steps necessary to protect Information Security. 6.9 Where the Contractor uses computer systems to process any Authority Data (including financial records such as invoices and any other data as well as the tracking of the assets), the Contractor must ensure the confidentiality, integrity and availability of any of Authority Data. 6.10 Where the Contractor is involved with the transferring of any Authority related data, such transfer must be controlled, and conform with protection measures appropriate to the impact level and or risk assessment. 6.11 The Contractor shall ensure that Authority Data is held within the United Kingdom and is not capable of being accessed from outside of the United Kingdom. Are you prepared to show your budget details?: Yes Indicative maximum: 800000 Confirm if you require a contracted out service or supply of resource Contracted out service: the off-payroll rules do not apply Summary of work GDS require a team with good knowledge PHP and Ruby to develop, run and support the GovWifi from public beta to a live service. Where the supplied staff will work London Where the supplied staff will work No specific location (for example they can work remotely) Who the organisation using the products or services is National Crime Agency Why the work is being done As a law enforcement agency, we collect data from a range of sources and we need to decrease the amount of time taken to ingest this. We have built several tools within AWS which seek to extract this data from a variety of formats and make it available to analyse for users. The volume of data is increasing and it is currently a manual process to extract data from its original format. The business problem you need to solve We currently have an existing framework for data extraction which we want to expand and utilise to automate as much of the data extraction phase as possible to speed up our data ingestion process by having an agile team of data engineers to work alongside internal developers and data scientists to bring value to users at pace. The NCCU does not currently have much dedicated data extraction resource as such our delivery to users is slowed. This requirement will address this. First user type: Users Enter more details about this user type: National Cyber Crime Unit and wider policing colleagues