Senior Bilingual Data Engineer to support the transformation and loading of data using Azure Databri

Senior Bilingual Data Engineer to support the transformation and loading of data using Azure Databricks

Initial 1 year contract with possibility of renewal. Hybrid 3 days a week in Montreal, QC. 7.5 hour work days, Monday to Friday.

Responsibilities: Use of Azure Data Factory for the ingestion in the data lake Use of Databricks for transformation and loading of the data in the different layers Use of Spark/python for the development of the loading libraries Participate in the development of the new ingestion pattern using databricks streaming and Kafka Develop best practices on the data quality validation Collaborate with the team to keep the coherence of the platform and make sure knowledge tranfers are done

Must Have Skills: 5 years as a

data engineer

working on the development of analytical platforms with programming languages such as spark/python Excellent communication skils in English &

French 4+ years on

databricks Experience on

Azure data lake

and

Azure data factory 3+ on Azure DevOps pipelines

Disclaimer: AI may be used in evaluating candidates. This posting is for an existing vacancy.

Apply