Databricks Architect

CV-Library logo CV-Library London Posted 16 Nov 2026 Closing: 01 Jan 0001
Contract Hybrid

Role Description & Overview

Position: Databricks Architect

Location: London / Manchester, UK (Hybrid-3 days a week from office)

4 months contract position

The Role

You will build, secure, automate, and run enterprise Databricks Lakehouse platforms for banking and financial services clients. The role covers workspace provisioning, infrastructure-as-code, CI/CD, security hardening, and platform operations across multiple environments and regions.

Your responsibilities:

  • Build, configure, and maintain enterprise Databricks Lakehouse platforms across Dev, Test, UAT, and Production environments.
  • Provision and manage Databricks workspaces, compute resources, cluster configurations, and platform-level settings.
  • Automate infrastructure provisioning and configuration using Terraform / Infrastructure as Code (IaC).
  • Develop and maintain CI/CD pipelines for Databricks platform configurations, notebooks, jobs, and application deployments.
  • Configure and administer Unity Catalog, including catalogs, schemas, permissions, and access controls.
  • Implement RBAC, service principals, secrets management, and least-privilege access for secure platform operations.
  • Integrate Databricks with cloud services such as AWS or Azure, including storage, networking, identity, and security services.
  • Configure and maintain cluster policies, job clusters, compute configurations, and environment standards.
  • Monitor platform health, workloads, jobs, and compute resources and troubleshoot production issues.
  • Implement logging, monitoring, alerting, and operational processes to improve platform reliability.
  • Optimize Databricks workloads and compute configurations for performance and cost efficiency.
  • Automate repetitive platform administration, deployment, and operational activities.
  • Support multi-environment and multi-region deployments, ensuring consistent platform configurations.
  • Work with Data Engineering, Cloud, DevOps, Security, Governance, and Application teams on platform integration.
  • Maintain technical documentation, deployment standards, operational procedures, and platform configurations.
  • Support security hardening and governance
requirements appropriate for banking and financial-services environments.

Your Profile

Essential skills/knowledge/experience:

Databricks & Lakehouse

Strong hands-on experience with:

o Databricks Notebooks

o PySpark DataFrame API

o SQL transformations

o Delta Lake

o Databricks Jobs, Job Flows, Workflows

o Declarative Pipelines (dpx files, pipeline definitions)

Experience with Unity Catalog

Databricks Autoloader and Structured Streaming

Terraform or IaC experience for Databricks configuration (Optional)

Experience building both batch and incremental pipelines.

AWS Stack

Strong familiarity with:

o S3, IAM, KMS

o Glue / Lambda

Experience migrating workloads from AWS native tools to Databricks.

General Data Engineering

  • Distributed data processing and performance tuning.
  • Strong knowledge of Lakehouse medallion architecture
  • Data modeling for Lakehouse: bronze → silver → gold patterns.
  • Experience with Git, CI/CD.

Desirable skills/knowledge/experience:

  • Architect level
Ready to apply for this finance role?

Click below to view the official posting for Databricks Architect and submit your application directly on the employer or partner site.

FREE DAILY ALERTS 1-click unsubscribe
Not the right fit? Never miss similar roles

Get newly listed Databricks Architect vacancies in London delivered to your inbox.

Key Details
  • Date Posted: 16 Nov 2026
  • Location: London
  • Employment: Contract
  • Workplace: Hybrid
  • Specialism: Accounting/Financial/Insurance
INSTANT ALERTS
Email Me Similar Jobs

Get daily finance & accounting vacancies in London.

SPONSORED PARTNER Sage

Trusted cloud accounting, tax compliance & payroll software for UK finance professionals and practices.

Explore Sage
100% FREE CV BUILDER
Need an updated CV for this role?

Build an ATS-optimised finance CV in minutes with professional templates.

Build Free CV Now
Employer Profile
CV
CV-Library
Verified Practice / Corporate

Verified accountancy practice or enterprise finance team operating across the UK economy.

More Jobs at CV-Library
Similar Finance Roles
Senior Finance Manager
Numan • london
EMEA Financial Controller
CV-Library • City of London, London
Treasury Accounting Lead
Cencora • london