Senior Data Engineer
Our client is embarking on a significant transformation project aimed at replatforming their financial system.
This ambitious initiative includes two parallel efforts: one focusing on all financial data and the other on non-financial data.
We are in the early stages of consolidating data from various sources into a single Delta Lake data warehouse, and we are looking for a Senior Data Engineer to lead this critical endeavor.
Responsibilities:
- Lead the integration and ingestion of data from diverse sources into the Delta Lake platform, ensuring data consistency and availability.
- Collaborate with various teams to identify all data sources, including SFTP/flat files, and APIs.
- Design and implement systematic processes for data ingestion and integration.
- Conduct extensive data analysis to support the consolidation of organizational data into a single data warehouse.
- Utilize Databricks for data ingestion and reporting, transitioning data from multiple data warehouses to a unified Delta Lake platform.
- Work closely with the development team to understand project scope, gather full requirements, and plan subsequent phases.
- Participate in daily standups, sprint planning, backlog refinement, and retrospectives within a scaled scrum framework.
- Exhibit flexibility and adaptability in navigating unknowns and evolving project requirements.
Requirements:
- Bachelor's or Master's degree in Computer Science, Data Science, or a related field.
- Solid understanding of the software development life cycle.
- Proven experience with Python, Spark, and SQL for data engineering and analysis.
- Strong data analysis skills, with the ability to interpret and manipulate large datasets.
- Experience with Databricks for data ingestion and transformation.
- Familiarity with Delta Lake and data warehousing concepts.
- Excellent problem-solving skills and the ability to see the big picture and understand the broader context of assigned tasks.
- Strong teamwork and collaboration skills, with a demonstrated ability to work effectively in a team-oriented environment.
- Knowledge of reporting tools like Power BI.
- Knowledge of Data Science concepts is a plus.
- Strong communication, interpersonal, and presentation skills
If you are interested, please contact our consultant for a confidential discussion using the contact details provided or click apply to send an updated copy of your CV.
Cavendish (Recruitment) Professionals Ltd are proud to be an equal opportunity employer and we believe that inclusivity begins with the candidate experience.
All qualified applicants will receive consideration for employment regardless of, gender, race, age, sexual orientation, religion, or belief.
- Start: ASAP
- Location: Prague, Czech Republic
- Type: Contract
- Industry: IT
- Recruiter: Cavendish Professionals
- Contact: klaudia Dudek
- Tel: 0203 008 5212
- Fax: 0203 008 5211
- Email: to view click here
- Posted: 2024-07-08 15:59:15 -
- View all Jobs from Cavendish Professionals
More Jobs from Cavendish Professionals
- Senior SAP EWM Consuntant (m/f/d) - 100% Remote
- Inhouse Senior SAP BI Consultant (m/f/d)
- Inhouse Senior SAP MDG Consultant (m/f/d)
- Senior SAP TM Consuntant (m/f/d) - 100% Remote
- Inhouse SAP EWM Berater*in (m/w/d)
- Inhouse SAP MM Consultant (m/w/d)
- (Senior) SAP SD Inhouse Consultant (m/w/d)
- Lead SAP EWM Consuntant (m/f/d) - 100% Remote
- SAP Analytics Cloud - Inhouse Consultant (m/w/d)
- Lead SAP GTS Consuntant (m/f/d) - 100% Remote
- Lead SAP MM / Procurement Consuntant (m/f/d) - 100% Remote
- Inhouse SAP PI/PO Consultant (m/w/d)
- Senior SAP Domain Architect (m/w/d)
- Office Admin
- Quantity Surveyor - Utilities
- Construction Manager - Pre Cast Concrete
- Head of Construction
- Site Manager
- Project Manager
- Project Manager