Data Engineer

Job Description

You will play a critical role as part of a small specialist to design, build and enhance data pipelines using Microsoft Fabric.

With strong collaboration and analytical skills, you will work with the business to provide data solutions to meet business needs.

• Strong proficiency in T-SQL and experience developing complex queries and procedures.


• Expertise in Spark and PySpark for scalable data processing.


• Solid understanding of OLTP and OLAP architectures and data modelling principles.


• Experience with Microsoft Azure, including Fabric, Azure Data Factory, Data Lake, Data Warehouse, and Blob Storage.


• Sound knowledge of ETL/ELT best practices.


• Strong analytical and problem-solving skills with a focus on data accuracy and reliability.


• Excellent collaboration and communication skills, with the ability to translate business requirements into technical solutions.


• Comfortable working in dynamic environments and committed to continuous improvement.

• Translate complex transactional data into optimised analytical models (facts and dimensions) to support reporting and insights.


• Design, build, and enhance data pipelines within Microsoft Fabric to improve performance, scalability, and data quality.


• Engineer new integrations from internal and external data sources using best-practice ETL/ELT methodologies.


• Monitor and optimise SQL-based workflows to ensure accuracy and efficiency in daily data processing.


• Lead efforts to migrate legacy reporting datasets to modern platforms, ensuring minimal disruption.


• Collaborate with analytics teams to develop custom data models and engineered datasets tailored to business requirements.


• Partner with data science colleagues to create summary and aggregated datasets for advanced analytics and predictive modelling.


• Respond efficiently to ad hoc data requests, ensuring outputs are timely, accurate, and aligned to stakeholder needs.

Benefits:

• A highly competitive salary


• Wider Benefits package

Privacy
At Core-Asset, we are committed to protecting and respecting your privacy.

Our Privacy Statement explains when and why we collect personal information about people who engage with our services, the lawful bases we rely on, how we use and share that information, how we keep it secure, and your rights, including how to make a complaint.

You can read it at https://core-asset.co.uk/about/privacy-statement/, and any questions can be sent to our Data Protection Lead, Julie Fraser, at julie@core-asset.co.uk.

We review our Privacy Statement regularly, publish any changes on our website, and will tell you directly about any significant changes.

Terms & Conditions
Our Terms & Conditions explain who we are, the services we provide to candidates and clients, and our respective obligations.

You can review them https://core-asset.co.uk/about/terms-conditions/.

We may update them from time to time, and the current version is always available on our website.

Confidentiality
This email and any attachments are intended solely for the addressee(s) and may be confidential and/or legally privileged.

If you have received it in error, please tell the sender immediately and delete it, and do not disclose, distribute, copy or print it.

Email can be delayed, fail to arrive or be altered without authorisation, and Core-Asset does not accept responsibility for changes made to this email after it was sent.

This email has been prepared using information believed to be reliable, but Core-Asset gives no warranty as to its accuracy or completeness.

We scan emails for viruses but cannot accept responsibility for any damage caused by a virus, or by a third party altering this email, after it was sent.

Monitoring
Emails and instant messages (including attachments) sent to or from Core-Asset may be retained and monitored for security, compliance and record-keeping purposes, in line with our policies and the law, and may be disclosed to law enforcement or regulators where we are required to do so.

Core-Asset Consulting Limited.

Registered in Scotland, company number SC282072.

Registered office: 37 Melville Street, Edinburgh, EH3 7JF.