Tech Lead / Lead Data Engineer - Outside IR35 - SC + NPPV3 Cleared

Newington, Greater London
3 weeks ago
Create job alert

Tech Lead / Lead Data Engineer (AWS Data Platform)
Rate: £500 - £550 p/d outside IR35
Length: 1st April to end of November (initially)
Location: London (hybrid – typically 1 day per week on-site, remaining remote)
Security Clearance: SC Clearance essential + NPPV3

Overview
We’re looking for a hands-on Tech Lead to lead a small team delivering secure, scalable data solutions within a highly regulated environment. You’ll take technical ownership across an AWS-based data platform using S3, Glue, and Redshift, working closely with delivery leadership, architecture stakeholders, and product teams to deliver incremental value.

This role suits someone who can balance technical leadership, hands-on engineering, and stakeholder-facing communication, while maintaining strong standards around security, quality, and operational resilience.

Key Responsibilities
Lead and mentor a small engineering team across data engineering, analytics engineering, and DevOps.
Own the technical design of data ingestion, transformation, storage, and access patterns.
Drive engineering standards including code quality, testing, CI/CD, Infrastructure as Code, and security-by-design.
Translate high-level requirements into solution increments, technical designs, and well-scoped delivery tickets.
Deliver and optimise data modelling approaches (e.g., star/snowflake schemas) and performance tuning practices.
Build reliable and cost-effective ETL/ELT pipelines, including orchestration and event-driven patterns where appropriate.
Partner with security stakeholders to ensure compliance, including IAM least privilege, encryption, auditability, and secure access controls.
Implement and maintain CI/CD pipelines for data workflows and platform components.
Ensure strong monitoring and operational discipline using cloud-native tooling and engineering best practice.
Communicate technical decisions, trade-offs, risks, and delivery progress to senior stakeholders.
Promote a culture of learning, quality, and continuous improvement.Required Skills & Experience
Proven experience as a Tech Lead / Lead Data Engineer delivering AWS-based data platforms.
Strong hands-on AWS experience, including:

Amazon S3 (data lake patterns, partitioning, lifecycle policies, cost optimisation)
AWS Glue (Jobs, Crawlers, PySpark, Glue Data Catalog, orchestration)
Amazon Redshift (performance tuning, sort/dist keys, Spectrum, WLM)
Strong development skills across:

Python (including PySpark)
SQL (DDL/DML, analytical queries, data performance considerations)
Experience with Infrastructure as Code (Terraform or CloudFormation).
CI/CD experience using tools such as GitHub Actions, Azure DevOps, CodePipeline, CodeBuild, etc.
Strong understanding of security & governance in regulated environments:

IAM, KMS encryption, Secrets Manager/SSM, audit logging
Delivery capability across Agile (Scrum/Kanban) environments with strong backlog refinement discipline.
Confident stakeholder management with the ability to explain technical choices and gain consensus

Related Jobs

View all jobs

CAS Architect

Techncial Delivery Lead

Lead Automation Test Architect

Cyber Security Deliver Assurance Lead

Automation Test Engineer CGEMJP00325931

Senior IT Delivery Engineer

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

What Hiring Managers Look for First in Cyber Security Job Applications (UK Guide)

If you want to stand out in the highly competitive world of cyber security job applications, you need to understand what hiring managers look for before they even finish reading a CV. Cyber security hiring managers scan applications quickly and with specific priorities in mind. They assess not just your technical ability, but your judgement, professionalism, clarity, risk awareness and evidence of impact. This guide explains what hiring managers look for first in cyber security applications across roles like Security Analyst, Security Engineer, Penetration Tester, Incident Responder, Security Architect, Governance Risk and Compliance specialists and Cloud Security positions. Use this as a practical, step-by-step checklist to sharpen your CV, LinkedIn profile, cover letter and portfolio before you apply on www.cybersecurityjobs.tech .

The Skills Gap in Cyber Security Jobs: What Universities Aren’t Teaching

Cyber security has become one of the most critical disciplines in the modern economy. From protecting financial systems and healthcare data to securing national infrastructure, cloud platforms and supply chains, cyber security professionals now sit at the frontline of digital trust. Demand for cyber security talent in the UK has surged. Job vacancies remain high, salaries continue to rise, and organisations across every sector report difficulty hiring skilled professionals. Yet despite this demand, many graduates struggle to break into cyber security roles and employers consistently report that candidates are not job-ready. The problem is not intelligence, ambition or academic effort. It is a persistent and widening skills gap between university education and real-world cyber security work. This article explores that gap in depth: what universities teach well, what they routinely miss, why the gap exists, what employers actually want, and how jobseekers can bridge the divide to build sustainable careers in cyber security.

Cyber Security Jobs for Career Switchers in Their 30s, 40s & 50s (UK Reality Check)

If you’re thinking about switching into cyber security in your 30s, 40s or 50s, you’re in good company. Across the UK, organisations of all sizes are hiring people from diverse backgrounds to protect systems, data & customers. But with hype around “hackers” & quick-win courses, it’s hard to separate reality from fiction. This guide gives you a UK reality check: which roles genuinely exist, what employers actually want, how training really works, what to expect on salary & progression & whether age matters. Whether you come from finance, project management, operations, law, HR or customer service, there is a credible route into cyber security if you approach it strategically.