Be at the heart of actionFly remote-controlled drones into enemy territory to gather vital information.

Apply Now

AWS Data Engineer

N Consulting Ltd
Greater London
2 days ago
Create job alert

Role :AWS Data Engineer

Location: London, UK (Hybrid)

Duration:12 Months FTC

 

We are building the next-generation data platform at FTSE Russell — and we want you to shape it with us. Your role will involve:

• Designing and developing scalable, testable data pipelines using Python and Apache Spark

• Orchestrating data workflows with AWS tools like Glue, EMR Serverless, Lambda, and S3

• Applying modern software engineering practices: version control, CI/CD, modular design, and automated testing

• Contributing to the development of a lakehouse architecture using Apache Iceberg

• Collaborating with business teams to translate requirements into data-driven solutions

• Building observability into data flows and implementing basic quality checks

• Participating in code reviews, pair programming, and architecture discussions

• Continuously learning about the financial indices domain and sharing insights with the team

WHAT YOU'LL BRING:

  • Writes clean, maintainable Python code (ideally with type hints, linters, and tests like pytest)
  • Understands data engineering basics: batch processing, schema evolution, and building ETL pipelines
  • Has experience with or is eager to learn Apache Spark for large-scale data processing
  • Is familiar with the AWS data stack (e.g. S3, Glue, Lambda, EMR)
  • Enjoys learning the business context and working closely with stakeholders • Works well in Agile teams and values collaboration over solo heroics

Nice-to-haves:

  • It’s great (but not required) if you also bring:
  • Experience with Apache Iceberg or similar table formats
  • Familiarity with CI/CD tools like GitLab CI, Jenkins, or GitHub Actions
  • Exposure to data quality frameworks like Great Expectations or Deequ
  • Curiosity about financial markets, index data, or investment analytics

 

Seniority Level

Mid-Senior level

Industry

  • IT Services and IT Consulting

Employment Type

Contract

Job Functions

  • Information Technology

Skills

 

  • Apache
  • Engineering
  • Code Review
  • Modular Construction
  • Continuous Integration and Continuous Delivery (CI/CD)
  • Python (Programming Language)
  • Software Development
  • Amazon Web S

Related Jobs

View all jobs

Senior Consultant, AI Engineer, AI&Data, UKI

Senior Data Engineer

Data Center Technician, Operations, IT, & Support Engineering

Data Engineer

Senior Data Platform Engineer - Hemel Hempstead

Senior Software Engineer

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Cyber Security Recruitment Trends 2025 (UK): What Job Seekers Must Know About Today’s Hiring Process

Summary: UK cyber security hiring has shifted from title‑led CV screens to capability‑driven assessments that emphasise incident readiness, cloud & identity security, detection engineering, governance/risk/compliance (GRC), measurable MTTR/coverage gains & secure‑by‑default engineering. This guide explains what’s changed, what to expect in interviews, & how to prepare—especially for SOC analysts, detection engineers, blue/purple teamers, penetration testers, cloud security engineers, DFIR, AppSec, GRC & security architecture. Who this is for: SOC & detection engineers, security operations leads, DFIR analysts, penetration testers/red teamers, purple teamers, AppSec/DevSecOps engineers, security architects, cloud security engineers, identity/IAM engineers, vulnerability managers, GRC/compliance specialists, product security & security programme managers targeting roles in the UK.

Why Cyber Security Careers in the UK Are Becoming More Multidisciplinary

Cyber security used to be viewed primarily as a technical discipline: firewalls, encryption, intrusion detection, penetration testing. In the UK today, it’s far broader. Organisations now face complex legal frameworks, ethical dilemmas, human-behaviour risks, communication challenges & usability hurdles. This shift means cyber security careers are becoming more multidisciplinary. From protecting NHS patient records to defending financial services, securing supply chains & safeguarding national infrastructure, cyber security now touches every sector. Employers increasingly want professionals who understand law, ethics, psychology, linguistics & design alongside traditional technical skills. In this article, we’ll explore why UK cyber security careers are expanding in this way, how these five disciplines shape the profession, and what job-seekers & employers need to know to thrive in this new landscape.

Cyber Security Team Structures Explained: Who Does What in a Modern Cyber Security Department

Cyber security has become a top priority for UK organisations of all sizes. From small businesses to financial institutions, healthcare providers, and government bodies, the risk of cyber attack is now a constant concern. Threats are more sophisticated, regulations more demanding, and customers more aware of data privacy than ever before. But defending against cyber threats isn’t simply about having the right tools — it’s about having the right team. A modern cyber security department relies on clearly defined roles and responsibilities to ensure that defences are proactive, incidents are managed swiftly, and compliance is maintained. This article explains the structure of a modern cyber security team, the roles you’ll typically find within it, how they collaborate, and what skills, qualifications, and salaries are expected in the UK job market.