Data Engineer- UK

About the company

The company is the global leader in Microsoft 365 (M365) tenant resilience, serving over 23 million users worldwide. We empower the world’s leading organizations to master the complexity of Microsoft M365.  Through robust security and precise governance, we help ensure that our client’s environments stay cyber-resilient and productive, no matter how complex they are.

Our unified, cloud-native platform delivers powerful automation, rapid value, and end-to-end visibility across the entire M365 ecosystem. Backed by world-class support and a collaborative, innovative culture, the company is a place where your ideas matter, and your work truly impacts global enterprises.

Job Summary

This role sits in Operations. You'll report to the Data Analyst Manager helping establish our data practice, including documented pipelines, governed metric definitions, and an established way for other departments to ask for data without it becoming ad hoc, bespoke work every time. In addition, the company is improving how we understand product telemetry, platform product usage, licence utilisation and adoption trends.  You will work across business functions and take ownership of the company's customer usage and adoption analytics and turn them into a production-grade, reliable system, then help scope and build the next set of metrics and signals on top of them. You'll work primarily in Databricks (Unity Catalog, Spark Declarative Pipelines), using SQL and Python day to day, and you'll be expected to use AI-assisted development (Cursor, Claude, or equivalent) as a normal part of how you work.

Job Responsibilities

• Take operational ownership of the usage and adoption pipelines and their alerting

• Reconcile figures derived from our product-usage tool

• Separate development and production environments and mature CI/CD so deployment is repeatable and rollback is reliable.

• Build and maintain Bronze-to-Gold pipelines in Databricks, Unity Catalog metric views, and the permissions/row-level-security model behind them.

• Extend automated data quality checks across the underlying gold-layer tables and validate outputs against existing Power BI reports.

• Co-own the scoping of the next set of usage and adoption signals with Product and Post-Sales: prioritising upsell signals and the ROI narrative and confirming what needs new instrumentation.

• Handle the realities of business system data: schema drift, inconsistent field naming, soft deletes, incremental loads

• Lead and be responsible for the consolidation of additional data sources — including support tickets, audit logs, CRM, and other customer-facing systems — while defining the feasibility, effort, cost, and implementation approach required to support a future unified data platform.

• Establish documented pipelines, an access model for raw and transformed data, and a working intake process for cross-department data requests.

• Act as a credible point of contact for the company's Databricks estate

• Bring automation and AI-assisted tooling into the day-to-day work — for example automated monitoring and anomaly detection on metric movements — as the platform matures.

Job Requirements

• 3 to 5 years' professional experience building and operating production data pipelines (ETL/ELT) in a commercial setting.

• Hands-on Databricks proficiency: Unity Catalog, Spark Declarative Pipelines and metric views, including the permissions / row-level-security model behind them.

• Strong SQL and Python applied to data engineering work — building, testing and supporting pipeline code through to production.

• Experience with data transformation/orchestration tooling such as Spark Declarative Pipelines, dbt, or an equivalent.

• Solid grounding in data modelling (dimensional/star-schema approaches) for analytics consumption.

• Git-based version control and CI/CD practices applied to data pipelines, not just application code.

• Experience ingesting data from a range of source systems — CRM (Salesforce, HubSpot), product usage and telemetry (the company's own platform, UserPilot, or equivalents such as Pendo, Amplitude or Mixpanel), and other business systems.

• Comfortable operating with limited hand-holding: implementing, documenting and running to an agreed direction rather than waiting for detailed instruction.

• Clear written and verbal communication: you'll be the named contact for commercial teams asking questions about the numbers.

Preferred skills

• Power BI or an equivalent BI tool, including validating a migrated report against a legacy one.

• Prior experience implementing data governance, a metric catalogue, or an access model from a low base of maturity.

• Background in B2B SaaS.

• Experience using AI coding assistants (GitHub Copilot, Cursor, Claude) as part of a production engineering workflow.

The company Values

Ownership Mindset :   Take ownership. Drive outcomes.

One Team : One team, one goal, embracing diversity - to achieve more together.

Velocity: Decide fast. Deliver fast. Repeat.

Continuous Improvement : Curiosity drives us. We challenge the status quo.

Customer First: Listen deeply. Solve boldly.

Resilience: Steady under pressure.

The company is an organisation which values the strength that diversity brings to the workplace. As an employer, we seek to promote equal opportunity through affirmative action. All qualified applicants will therefore receive consideration for employment and will not be discriminated against based on gender/sex, race/ethnicity, disability, age or any other protected group status (such as protected veteran status) or characteristic that is protected by local legislation.

Privacy Notice: By submitting your application, you acknowledge that the company will process your personal data for recruitment purposes in accordance with our Privacy Policy