SecOps Data Engineer
- Civil Service
- Full Time
- Salford
- 39,500
Job Description
Job summary
The Home Office works to build a safe, fair and prosperous UK. We achieve this through our work on counter-terrorism, policing, crime, drugs policy, immigration and passports.
Home Office Digital, Data and Technology designs, builds and develops services for the rest of the department and for government. Every year our systems support up to 3 million visa applications, checks on 100 million border crossings, up to 8 million passport applications and deliver 140 million police checks on people, vehicles and property.
SecOps Data Engineers deliver on the data analytics vision for the organisation driven by the requirement to analyse, detect & respond to security threats against the organisation. You will focus on the design and implementation of numerous data flows to connect operational systems, data for analytics and BI systems.
Job description
As a SecOps Data Engineer, you will identify and deliver new data sources and develop Extract, Transform, Load (ETL) processes. You will also collaborate with the Data Acquisition, Analytics and Infrastructure teams to deliver the data strategy through the design and implementation of technology systems.
You will support Home Office Cyber Security (HOCS) in analysing problems and data analysis issues, looking for underlying causes and assisting in developing solutions. You will also be responsible for delivering data solutions in accordance with agreed organisational standards that ensure services are resilient, scalable and future-proof.
You will work closely with Cyber Security Operations Centre (CSOC) Operations & the wider HOCS department, who will set the scope of your data engineering work through their pro-active research & understanding, in addition to retrospective implementations from known risks, incidents, intelligence originating from commercial, cross-government & international sources.
Key responsibilities:
- Assisting in the development of new data models and ETL processes, working collaboratively in the CSOC to build data streaming systems
- Designing, building and testing data products based on feeds from multiple systems using a range of different storage technologies and/or access methods
- Applying the concepts and principles of data modelling to produce, maintain and update relevant data models for specific business needs, including reverse engineering data models from a live system
- Assisting in designing, writing, iterating and optimising code from prototype to production-ready
- Undertaking data profiling and source system analysis and presenting clear insights to colleagues to support the end use of the data
- Assisting in the successful delivery of completed data loads for CSOC Engineering, Cyber Detection & Response, Threat Operations & Service Management functions, putting in place remedies and troubleshooting when required and assisting in the development of new data load programmes
Working pattern:
Due to the business requirements of this role, it is only available on a full-time basis. However, job-share and compressed hours are available
Travel:
Occasional travel to other home office sites may be required. All expenses will be reimbursed in accordance with home office policy.
Person specification
Essential Skills
- Experience in IT programming.
- Experience using tools such as industry standard ETL tools, network databases and scheduling and orchestration tools using languages such as SPL, KQL & Python within technologies delivered from Splunk, AWS & Azure.
- Ability to communicate effectively with a wide range of stakeholders translating technical concepts into non-technical language
- Experience in managing the development and delivery of technical products
- Understanding Cloud Data technologies, solutions and future Cloud Data Strategies such as AWS or Azure.
- Ability to applying data development / engineering techniques both in theory and practice or demonstrate a strong aptitude to learn
The essential skills listed above are reflective of the Home Office Government Digital and Data Profession Career Framework (based on the industry standard SFIA framework- Use the levels of responsibility to understand what would be expected for each technical skill listed). Please see below for the relevant skills for your role:
Strategy and Architecture
- Strategy and Planning
- Innovation (INOV) Level 2
- Advice and Guidance
- Methods and Tools (METL) Level 2
Development and Implementation
- Data and Analytics
- Data Management (DATM) Level 2
- Data Modelling and Design (DTAN) Level 3
- Database Design (DBDS) Level 2
- Data Engineering (DENG) Level 3
Desirable Skills
Ideally, you will also have the following skills or some experience in:
- Working with Big Data tools and data stores utilising SQL, KQL, SPL, Python.
- Using modern / open source programming languages and tools including to deliver data development / engineering products