Tech Lead / Lead Data Engineer - Outside IR35 - SC + NPPV3 Cleared

Newington, Greater London
1 month ago
Applications closed

Related Jobs

View all jobs

Head of IT

Group IT Infrastructure Manager

Recruitment

Security Governance & Compliance Analyst - NIST, ISO

Data Compliance Lead

Information Governance Manager & Data Protection Officer (DPO)

Tech Lead / Lead Data Engineer (AWS Data Platform)
Rate: £500 - £550 p/d outside IR35
Length: 1st April to end of November (initially)
Location: London (hybrid – typically 1 day per week on-site, remaining remote)
Security Clearance: SC Clearance essential + NPPV3

Overview
We’re looking for a hands-on Tech Lead to lead a small team delivering secure, scalable data solutions within a highly regulated environment. You’ll take technical ownership across an AWS-based data platform using S3, Glue, and Redshift, working closely with delivery leadership, architecture stakeholders, and product teams to deliver incremental value.

This role suits someone who can balance technical leadership, hands-on engineering, and stakeholder-facing communication, while maintaining strong standards around security, quality, and operational resilience.

Key Responsibilities
Lead and mentor a small engineering team across data engineering, analytics engineering, and DevOps.
Own the technical design of data ingestion, transformation, storage, and access patterns.
Drive engineering standards including code quality, testing, CI/CD, Infrastructure as Code, and security-by-design.
Translate high-level requirements into solution increments, technical designs, and well-scoped delivery tickets.
Deliver and optimise data modelling approaches (e.g., star/snowflake schemas) and performance tuning practices.
Build reliable and cost-effective ETL/ELT pipelines, including orchestration and event-driven patterns where appropriate.
Partner with security stakeholders to ensure compliance, including IAM least privilege, encryption, auditability, and secure access controls.
Implement and maintain CI/CD pipelines for data workflows and platform components.
Ensure strong monitoring and operational discipline using cloud-native tooling and engineering best practice.
Communicate technical decisions, trade-offs, risks, and delivery progress to senior stakeholders.
Promote a culture of learning, quality, and continuous improvement.Required Skills & Experience
Proven experience as a Tech Lead / Lead Data Engineer delivering AWS-based data platforms.
Strong hands-on AWS experience, including:

Amazon S3 (data lake patterns, partitioning, lifecycle policies, cost optimisation)
AWS Glue (Jobs, Crawlers, PySpark, Glue Data Catalog, orchestration)
Amazon Redshift (performance tuning, sort/dist keys, Spectrum, WLM)
Strong development skills across:

Python (including PySpark)
SQL (DDL/DML, analytical queries, data performance considerations)
Experience with Infrastructure as Code (Terraform or CloudFormation).
CI/CD experience using tools such as GitHub Actions, Azure DevOps, CodePipeline, CodeBuild, etc.
Strong understanding of security & governance in regulated environments:

IAM, KMS encryption, Secrets Manager/SSM, audit logging
Delivery capability across Agile (Scrum/Kanban) environments with strong backlog refinement discipline.
Confident stakeholder management with the ability to explain technical choices and gain consensus

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

How Many Cyber Security Tools Do You Need to Know to Get a Cyber Security Job?

If you are trying to build or move forward in a cyber security career, it can feel like the list of tools you are expected to know never ends. One job advert asks for SIEM platforms, another mentions penetration testing tools, another lists cloud security, threat intelligence platforms, endpoint detection, scripting languages and compliance frameworks. Scroll LinkedIn and it gets worse. Everyone seems to “know” dozens of tools, certifications and platforms. Here is the reality most cyber security hiring managers agree on: they are not hiring you because you know every tool. They are hiring you because you understand risk, can think like an attacker and a defender, follow process, communicate clearly and make good decisions under pressure. Tools matter — but only when they support those outcomes. So how many cyber security tools do you actually need to know to get a job? For most job seekers, the answer is far fewer than you think. This article explains what employers really expect, which tools are essential, which are role-specific and how to focus your learning so you look credible, not overwhelmed.

What Hiring Managers Look for First in Cyber Security Job Applications (UK Guide)

If you want to stand out in the highly competitive world of cyber security job applications, you need to understand what hiring managers look for before they even finish reading a CV. Cyber security hiring managers scan applications quickly and with specific priorities in mind. They assess not just your technical ability, but your judgement, professionalism, clarity, risk awareness and evidence of impact. This guide explains what hiring managers look for first in cyber security applications across roles like Security Analyst, Security Engineer, Penetration Tester, Incident Responder, Security Architect, Governance Risk and Compliance specialists and Cloud Security positions. Use this as a practical, step-by-step checklist to sharpen your CV, LinkedIn profile, cover letter and portfolio before you apply on www.cybersecurityjobs.tech .

The Skills Gap in Cyber Security Jobs: What Universities Aren’t Teaching

Cyber security has become one of the most critical disciplines in the modern economy. From protecting financial systems and healthcare data to securing national infrastructure, cloud platforms and supply chains, cyber security professionals now sit at the frontline of digital trust. Demand for cyber security talent in the UK has surged. Job vacancies remain high, salaries continue to rise, and organisations across every sector report difficulty hiring skilled professionals. Yet despite this demand, many graduates struggle to break into cyber security roles and employers consistently report that candidates are not job-ready. The problem is not intelligence, ambition or academic effort. It is a persistent and widening skills gap between university education and real-world cyber security work. This article explores that gap in depth: what universities teach well, what they routinely miss, why the gap exists, what employers actually want, and how jobseekers can bridge the divide to build sustainable careers in cyber security.