Our client is looking for an experienced Senior Data Engineer

Responsibilities:

• Design, build, and optimize data pipelines for model training and inference systems.


• Collaborate with data scientists and machine learning engineers to ensure efficient data preparation and feature engineering.


• Architect and implement scalable systems for model inference, data retrieval, and acquisition to support high-performance AI applications..


• Optimize performance and reliability to handle large-scale data processing.


• Develop robust logging and monitoring solutions for AI systems.


• Ensure traceability, debugging, and performance monitoring across the AI platform.

Requirements:

• Bachelor's or Master's degree in Computer Science, Data Science, or a related field.


• Advanced Python knowledge for data processing and scripting.


• Hands-on experience with one or more cloud computing platforms (Azure, AWS, GCP).


• Hands-on experience with big data technologies and distributed computing frameworks.


• Proficiency in RDBMS/NoSQL data stores and appropriate use cases.


• Experience with Data as Code; version control, small and regular commits, unit tests, CI/CD, packaging, familiarity with containerization tools such as Docker and Kubernetes.


• Understanding of AI/ML principles and practices, including model training, inference, and deployment.


• Skilled in building strong training datasets for ML.