Data Engineer – Brussels – Hybrid Working
12 month contract – opportunity to extend
We are seeking a skilled Data Engineer to join our team in charge of implementing our Databricks platform.
Responsibilities:
• Design, develop and maintain scalable data pipelines on the Databricks platform
• Proven expertise in Databricks and in with AWS services such as S3, Redshift, Lambda
• Manage data ingestion processes from various sources into the Databricks environment.
• Implement and optimize ETL (Extract, Transform, Load) processes to ensure efficient data transformation and integration.
• Ensure data quality, integrity, and security across all data pipelines.
• Monitor and troubleshoot data pipeline performance, implementing necessary maintenance and updates.
• Document data pipeline processes, technical specifications and best practices.
• Realize knowledge transfer towards the Data engineer team which will take over the responsibility to run the platform in the future Required Skills
• Strong skills in SQL (and other relevant programming languages like Python) and in Datawarehouse / Lakehouse projects
Qualifications:
• Bachelor’s degree in Computer Science, Engineering, Mathematics, or a related field.
• Minimum 3 years of experience in SQL and Data warehousing
• Minimum 2 years of experience with Databricks Languages
• Fluent in either Dutch or French
For more information please contact Adam Morgan at adam@siblingrecruitment.com