Senior Data Engineer

London
4 weeks ago
Applications closed

Related Jobs

View all jobs

Cyber Security Engineer

Senior Cloud Security Engineer

Senior IT Infrastructure Engineer

Senior DevSecOps Engineer

Senior Security Engineer

Senior Security Engineer

Position: Senior Data Engineer

Salary: £55,000 - £65,00

Location: Hybrid - Bristol, Manchester, or London
Security Requirement: SC Clearance to start and be willing / able to obtain DV Clearance

We are seeking Data Engineers, with a keen interest / experience in AI /ML and strong proficiency in Python Scripting. To join our Consultancy client working on meaningful projects in the Defence and Security sector.

Required Experience:

End-to-End Data Development: Strong experience with data pipelines, ETL processes, and workflow orchestration, demonstrating best practices across tech stacks.
Strong Python Skills
Diverse Data Handling: Familiarity with batch, streaming, real-time, and unstructured data sources.
Architectural Design & Systems Thinking: Ability to design and build scalable, high-performance data solutions.
Data Modelling & Warehouse Design: Proficiency in data modelling, warehouse design, and database optimization, with examples of logical and physical models.
Distributed Data Systems: Experience in deploying, managing, and tuning distributed systems for optimal reliability and performance.
Coding & Development Practices: Demonstrated coding expertise with modular, reusable, and efficient code in various languages.
Development Lifecycle: Understanding of SDLC, CI/CD pipelines, and version control.
Data Governance & Security: Knowledge of data security, governance, metadata management, and master data principles.Key Responsibilities:

As a Senior Data Engineer, you'll bridge the gap between client needs and technical solutions, creating data pipelines that ingest, transform, and enrich large data volumes. You'll have client-facing responsibilities, delivering high-quality data solutions in multi-disciplinary teams across industries.

In this consulting role, your responsibilities will vary depending on client engagement focus and your skillset, but will often include:

Data Engineering & AI Integration: Apply data engineering tools, integration frameworks, and query engines to create high-quality, standardised data for AI applications and reporting.
Data Pipeline Development: Design and implement robust data pipelines and stores in collaboration with other engineers and developers.
Innovative Problem Solving: Bring fresh approaches to challenging data engineering problems.
Architecture for Scale: Design scalable, complex data architectures that provide cross-team value.
Data Modelling & Governance: Establish standards in logical and physical data modelling and data governance.
Distributed Computing: Employ parallel processing, streaming, and batch workflows to manage large data volumes effectively.
ETL & Workflow Automation: Build ETL processes and automated workflows for efficient data movement.
System Optimization: Tune data systems for performance, scalability, and monitoring.
Data Security: Apply best practices for information security, including encryption and data anonymity for sensitive data assets.
Data Governance & Quality: Manage metadata, data lineage, and data quality standards.If you're passionate about using data engineering and AI to solve complex problems in the Defence and Security sector, we'd love to hear from you!

People Source Consulting Ltd is acting as an Employment Agency in relation to this vacancy. People Source specialise in technology recruitment across niche markets including Information Technology, Digital TV, Digital Marketing, Project and Programme Management, SAP, Digital and Consumer Electronics, Air Traffic Management, Management Consultancy, Business Intelligence, Manufacturing, Telecoms, Public Sector, Healthcare, Finance and Oil & Gas

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Jobs

Portfolio Projects That Get You Hired for Cyber Security Jobs (With Real GitHub Examples)

With rising cyber threats and increasingly sophisticated attacks, cyber security has become a critical priority for organisations worldwide. From penetration testers (pentesters) and SOC analysts to cloud security engineers and threat intelligence specialists, the demand for skilled cyber security professionals continues to surge. But how do you stand out in a growing field? Alongside your CV, an impressive cyber security portfolio can be the distinguishing factor that convinces employers you’re the right fit. In this comprehensive guide, you’ll discover: Why a cyber security portfolio is essential for job seekers in this domain. How to align portfolio projects with different cyber security career paths. Real GitHub examples that demonstrate best practices in security-focused projects. Actionable project ideas you can start today, from penetration testing labs to blue-team detection pipelines. Best practices for organising your repos and presenting your work so hiring managers can instantly see your impact. When you’re ready to pursue your next opportunity, remember to upload your CV on CyberSecurityJobs.tech. Our specialised platform connects talented security professionals with employers who need your expertise—exactly what your portfolio will showcase.

Jobs Careers

Cyber Security Job Interview Warm‑Up: 30 Real Coding & System‑Design Questions

The need for skilled cyber security professionals has never been greater. As organisations rapidly digitise their operations and store increasing amounts of sensitive data online, cyber threats loom large—ranging from sophisticated ransomware attacks to insider threats and state‑sponsored espionage. Against this backdrop, cyber security jobs remain some of the most in‑demand and mission‑critical roles on the market. If you’re preparing for a cyber security interview, expect to be tested on a broad spectrum of topics—from secure coding and incident response to network security architecture and compliance standards. In many cases, companies also include problem‑solving exercises and system design scenarios to gauge how well you can apply theoretical knowledge to real‑world threats. To help you ace these assessments, we’ve compiled 30 real coding & system‑design questions you might encounter. Each reflects a key area of cyber security—whether it’s encryption and key management, threat modelling, or designing a zero‑trust network. Along the way, we’ll offer insights and best practices so you can stand out from the crowd. If you’re on the lookout for exciting cyber security roles in the UK, head to www.cybersecurityjobs.tech. There, you’ll discover a range of positions—covering everything from penetration testing and threat intelligence to compliance management and security operations. Let’s dive into the essentials of interview readiness.

Jobs

Negotiating Your Cybersecurity Job Offer: Equity, Bonuses & Perks Explained

How to Secure Compensation That Reflects Your Value in the UK’s High-Stakes Cybersecurity Sector Introduction As cyber threats grow more sophisticated and frequent, cybersecurity professionals have never been more in demand. From thwarting ransomware attacks to architecting secure cloud infrastructures, mid‑senior cybersecurity experts play a critical role in safeguarding a company’s data and reputation. Thanks to this growing reliance on cybersecurity, employers in the UK are going above and beyond simple salary offers to attract the top echelon of talent. Although base salary remains a key component of any job offer, the broader package—encompassing equity, bonuses, and perks—can often surpass what you’d gain from a small bump in monthly pay. For cybersecurity specialists working in areas such as threat intelligence, incident response, penetration testing, or compliance, the complexity and risk mitigation you bring to the table is massive. Knowing how to negotiate the entire package ensures you are duly rewarded for keeping an organisation’s data, assets, and operations safe. In this guide, we’ll delve into every aspect of negotiating a cybersecurity job offer. Whether you’re pivoting to a mid‑senior role or cementing your expertise at an established security consultancy, understanding the full range of compensation elements will help you secure an offer that acknowledges the criticality of what you do. Let’s explore equity options, performance bonuses, and the perks that matter most, so you can come out of your next job negotiation confident that you’re getting more than just a salary.

🍪 We use cookies to enhance your browsing experience on our website. By continuing to use this site, you consent to the use of cookies as described in our Cookie Policy. You can review our Cookie Policy for more information.