We are recruiting for a Senior Data Engineer (Team Lead) for an exciting project with one of the world's largest professional-services firms.

Technologies you will work with:

• Our infrastructure runs on MS Azure cloud and we use Terraform as IaC.
  
  We test with Terratest (Go)


• We use Azure Data Factory for pipelines and orchestration and Databricks for processing and transforming data

Your role:

• You will build the core functional data components as part of the product and automate the way how they are tested and deployed


• Understand the needs of your various customers from different units and translate them to modular solutions which are usable by the vast majority


• Brainstorm and design solutions to optimize our data platform solution architecture


• Share knowledge in our data engineering community, pair program and collaborate on code together with other data engineers


• Enable business teams to run successful data and AI projects

Your profile:

• Proven work experience as a team leader or supervisor


• You have 5+ years of relevant software, data and/or platform engineering experience, building platforms which are modular, testable, scalable and easily consumable


• Have 3+ years hands-on experience on one or more cloud services (Azure/GCP/AWS) like: ADF, Data-lake, Delta-lake, Databricks, Key Vaults, BigQuery, Cloud Dataflow, Dataproc, Datapipeline, Kinesis, etc.


• Experience with Data as Code; version control, small and regular commits, unit tests, CI/CD, packaging, branching, containerization, etc.


• Demonstrated programming and debugging experience with Python/PySpark, SQL, Go


• Preferably experience with open source projects run with a “build once, deploy often” mindset & Experience or interest in Domain Driven Design


• Good communication skills, fluent English

If interested, please get in touch via contact details provided or click “Apply” to forward an up to date copy of your CV.

Cavendish (Recruitment) Professionals Ltd are proud to be an equal opportunity employer and we believe that inclusivity begins with the candidate experience.

All qualified applicants will receive consideration for employment regardless of, gender, race, age, sexual orientation, religion, or belief.