The Data Management and System Development Team at Northeast London ICB are looking to recruit two data engineers.
You will be working with Customers, Project Managers and Analysts to ingest and prepare date for analysis.
Using modern cloud hosted data engineering technologies, such as Azure Synapse, Azure Data Factory, Snowflake, DBT and developed applications you will be key to loading, publishing, and securing data on to our analysis platform .
Main duties of the job
To work as a whole system in determining and improving the outcomes for the citizen and reduce inequalities by bringing data together into a single repository. This means working more closely with our partners to deliver an integrated system.
We will be suing the data to predict the cause and effect of patient conditions and predict well in advance when a patient will have a potentially life threatening condition and the potential causes and direct risk factors, we have an opportunity to reduce the risk factors and reduce the impact of the potential cause and save the associated hospital activity whilst giving a much better patient outcome.
We want to use data to support the integrated clinical care and therefore the data will need to be accurate, timely and varied to enable the most information brought together to make decisions.
You will manage the data ingestion lifecycle working with the stakeholders, clinicians and other developers to build the data rules so the data will be presented in a useful and easy to use format for users.
The role will require the use of cloud technologies and working with anything from small spreadsheets to data sets with billions of rows. This is an exciting opportunity with a team that is continually looking to be involved in the latest technologies to look at ways to help prevent illness in patients. You will be part of team that can have an integral part of system to save patient lives.
Working for our organisation
NHS North East London Integrated Care Board (ICB) was formed on 1 July 2022.
We are an exciting new organisation putting the needs of communities at the heart of our commissioning arrangements.
We are working with local people and partners across health, social care and the voluntary sector in innovative ways to improve health and wellbeing for all our communities. Our key priority in the next year will be to develop closer integrated and collaborative ways of working with all our partners to implement our Out of Hospital Strategy.
We can only do this with great staff who are encouraged and supported, which is why we invest in them, listen to them, make sure we are representative of our populations and that we foster their health and wellbeing.
Please note that all vacancies will be subject to a 6 months' probation period in line with the Probation Policy.
Detailed job description and main responsibilities
The post holder will
Undertake the following duties and responsibilities:
Engage with all stakeholders to identify requirements where appropriate and working directly with the team technical lead to agree the requirements, deliverables and timescales
Build and manage all the data ingestion processes
Work with the senior data engineers on the information lifecycle to produce useful data for customers
Communicate and engage with stakeholders to understand what the business wants and the benefits of the data needed
Help with Eliciting these requirements to help build a picture for the developers to create a solution with the right datasets
Liaise with data quality and standards lead to build rules in the data processing which are likely to be highly complex
Help the developers to obtain quantitative and qualitative data on the healthcare dataset to analyse, determine and promote data driven decisions
Ingest data from a myriad of sources in varying of formats. Some of these may be highly complex
Define standard import template
Work closely with the Project Manager to help deliver weekly and monthly project reports and highlight key risks and issues suggesting any remedial or proactive actions
Link with the team lead to report issues and raise risks, giving daily or weekly update
You will be expected to test that the output meets the requirements before handing over to the testers
You should be able to work in an agile environment following an agile approach
Work across the whole CCG to prioritise and accommodate new items and work with the team lead to estimate and agree timescale
Ensure projects are compliant with IG, GDPR and DPA regulations, guidance and training by liaising with the relevant SMEs
Experience of working as a Data integration enginee
Knowledge and experience SQL
Knowledge and experience with cloud technologies
Please see the attached Job Description for full duties and responsibilities.
Education & Qualifications
Degree or relevant experience in Computers Science, Data Analysis or Data Engineering
Further training or significant experience in Data Management, Data Engineering
Knowledge & Experience
Experience of Microsoft data engineering stack e.g., SSIS, SQL, ADF, Synapse, Azure DevOps Pipelines.
Experience in cloud data platforms e.g. Snowflake.
Experience using Git and Azure DevOps
Experience of designing and building solutions to ingesting data
Knowledge of AWS or Azure technologies
Experience in working in the command line / powershell
Knowledge of NHS Datasets and terminology
Aware of NHS Information Governance and patient confidentially rules
Skills & Abilities
Proven record of being able to deliver to tight deadlines.
Self-starter, able to work effectively within a team or individually.
Strong business engagement, communication and stakeholder management skills
The aptitude and desire to quickly pickup new technologies with little assistance.
We reserve the right to close any vacancies when we have received sufficient applications to shortlist.
Applicants who can clearly demonstrate how they meet our role profile requirements will be shortlisted for interview. To enquire about your application or inform us of any changes in your circumstances please ensure you quote your application reference number.
Please ensure you check your email account regularly as this is how we will communicate with you. Invitations for interview are sent by email only, so it is important that you monitor your emails once you have submitted an application online. If you have not heard from us within a month of the closing date you should presume that you have not been shortlisted.
We are committed to safeguarding and promoting the welfare of children, young people and vulnerable adults. As part of our safe recruitment practice pre-employment checks will be undertaken before any appointment is confirmed. As part of the selection process, you may be required to undergo a Criminal Records Bureau check, all cases of criminal record history are dealt with on a case-by-case basis.
Applications are welcome from job seekers who require Skilled Worker sponsorship and will be considered alongside all other applications. However, non-EEA candidates may not be appointed to this post if a suitably qualified, experienced and skilled EU/EEA candidate is available to take up the post or if we are unable to satisfy the Resident Labour Market Test.