Lead Data Engineer

Overview

This role requires eligibility for SC clearance, so please verify eligibility criteria on the official government website before applying. At Scott Logic, we collaborate with some of the largest UK companies and government bodies by delivering tailored technology solutions and expert guidance.

Our clients rely on us to maximize their data's potential. As a Data Engineer, you will develop data platforms and pipelines that underpin varied data and analytics capabilities such as data science and artificial intelligence. Responsibilities include constructing data lakes and warehouses, extracting operational data, and consolidating fragmented datasets into unified models that deliver business insights or support ML model training.

The role is hands-on and client-focused, available at senior or lead levels depending on expertise. You may lead teams, set technical directions, advise clients, or tackle complex engineering matters. Additionally, occasional onsite presence in London is expected.

Key Responsibilities and Skills

• Develop and manage data storage solutions, data pipelines for ingestion and transformation, and analytical querying/reporting systems.
• Utilize technologies such as Python, Spark, SQL, PySpark, and Power BI.
• Apply a background in software engineering including front-end skills with JavaScript.
• Approach challenges pragmatically to devise effective resolutions.
• Design maintainable, well-structured systems.
• Communicate clearly and collaborate effectively within teams and with clients.
• Demonstrate eagerness to learn, explore new technologies, and enhance skills.

Preferred Experience

• Familiarity with cloud platforms like AWS, Azure, or Google Cloud Platform.
• Exposure to Agile development environments.
• Experience with vendor products such as Snowflake or Databricks.
• Knowledge of continuous integration and continuous deployment (CI/CD) tools.

Benefits and Work Environment

• Start with 25 days of paid annual leave, increasing to 30 days with years of service.
• Comprehensive family leave policies supportive of work-life balance.
• Access to employer pension plans, private healthcare services, and group life insurance.
• Additional perks including discounted gym memberships and cycle-to-work programs.
• Constructive performance assessment and feedback processes.
• Flexible remote working options balanced with in-office social and professional engagement activities.

Company Culture and Values

Scott Logic embraces shared values emphasizing respect for others and environmental responsibility. As a certified B Corp, the company is committed to fostering an inclusive, equitable, and sustainable economy and workplace. Diversity is fundamental to our innovation approach, and we welcome contributions from individuals of all backgrounds and circumstances.