Cloud architecture - Databricks Migration & Data Modeling Expert
Description
This role focuses on leading the migration of SSIS-based ETL workflows to a modern, cloud-native data processing and analytics platform using Databricks. It involves assessing existing systems, designing scalable architectures leveraging Databricks Lakehouse, Delta Lake, and Spark, and optimizing ETL processes for performance and scalability. Key responsibilities include building and managing data pipelines with Python, SQL, and Spark, integrating with cloud platforms (Azure, AWS, GCP), and ensuring best practices for security, governance, and compliance. The role also requires collaboration with stakeholders to understand business requirements and guiding engineering teams through migration and troubleshooting.
What We're Looking For
Assess existing SSIS packages and define migration roadmap to Databricks workflows.,Design cloud-native architecture leveraging Databricks Lakehouse, Delta Lake, and Spark.,Optimize ETL processes during migration for scalability and performance.,Build and manage data pipelines in Databricks using Python, SQL, and Spark.,Integrate Databricks with cloud platforms (Azure/AWS/GCP) and enterprise systems.,Ensure best practices for security, governance, and compliance.,Work with stakeholders to understand business requirements and technical constraints.,Guide engineering teams through migration execution and troubleshooting.,Provide training and documentation for post-migration operations.
Ideal Candidate
Strong experience in SSIS and ETL process design.,Hands-on expertise in Databricks, Spark, Delta Lake, and Lakehouse architecture.,Proficiency in Python, SQL, and optionally Scala.,Deep understanding of cloud platforms (Azure preferred; AWS/GCP acceptable).,Familiarity with data governance, security, and CI/CD pipelines (Good to have).,Experience with Infrastructure as Code (Terraform, CloudFormation) and automation tools (Good to have).
Hard Skills
Soft Skills
Benefits
Also Available At
About the Company
CGI Inc.
CGI Inc. is one of the world's largest IT and business consulting firms, providing a comprehensive range of services including strategic consulting, systems integration, managed IT, and business process services. Founded in 1976 and headquartered in Montreal, the company operates across more than 40 countries, helping clients across various industries accelerate their digital transformation and achieve measurable business outcomes.
We respect your privacy
BerryMap uses cookies to provide essential features, analyze usage, and improve your experience. You can customize your preferences below.