Edmonton, AB, CA
16 hours ago
Databricks Engineering Consultant
Position Description:

CGI is the world's 5th largest independent IT and business consulting services firm, operating across 40 countries and delivering more than 100 IP-based solutions to clients in Financial Services, Government, Healthcare, Manufacturing, Utilities, Oil & Gas, and more. We are recognized globally for our on-time, on-budget delivery and our role as a trusted advisor to leading organizations.
As organizations accelerate their data and analytics modernization, CGI is expanding its Data & AI consulting practice. We are seeking a Databricks Engineering Consultant with strong expertise in Databricks platform administration, Spark performance optimization, and secure, reliable operations.
Join our team and help operate and scale enterprise-grade analytics platforms that deliver reliable, high-performance data solutions.

Your future duties and responsibilities:

As a Databricks Engineering Consultant, you will be responsible for the configuration, management, and operational excellence of Databricks environments. This includes managing workspaces, clusters, compute pools, libraries, and security configurations, as well as optimizing Apache Spark performance to ensure efficient and cost-effective data processing.
You will work closely with Data Architects, Cloud Architects, and Security teams to ensure Databricks platforms are secure, performant, scalable, and compliant with enterprise operational standards.
 
Key Responsibilities
Databricks Platform Administration

. Configure and manage Databricks workspaces, including environments for development, testing, and production.
. Provision, configure, and optimize clusters and compute pools to balance performance, reliability, and cost.
. Manage Databricks runtime versions, cluster policies, and job configurations.
. Administer libraries and dependencies, ensuring consistent and reliable runtime environments.

Spark Performance & Optimization

. Monitor and tune Apache Spark workloads, including memory management, partitioning, caching, and execution plans.
. Identify and remediate performance bottlenecks in batch and streaming workloads.
. Collaborate with data engineering teams to optimize Spark code and pipeline execution.
. Implement best practices for cost optimization and resource utilization.

Security, Governance & Operational Controls

. Enforce workspace security policies, including access controls, permissions, and cluster policies.
. Support integration with enterprise identity providers and role-based access models.
. Implement operational standards for logging, monitoring, and alerting.
. Ensure Databricks environments comply with enterprise security, privacy, and operational governance requirements.

Cloud & Platform Integration

. Integrate Databricks with cloud-native services such as Azure Data Lake Storage, Azure Key Vault, and networking components.
. Support secure connectivity patterns and secret management.
. Collaborate with Cloud Architects on infrastructure design and optimization.

Delivery & Collaboration

. Partner with Data Architects and Data Engineers to support reliable deployment and execution of data pipelines.
. Participate in platform design discussions, providing operational and performance perspectives.
. Contribute to documentation, runbooks, and operational standards.
. Provide guidance and mentorship on Databricks operational best practices

 
 

Required qualifications to be successful in this role:

Must-Have Technical Experience

. 5–10+ years of experience in data engineering, platform engineering, or cloud data operations, including: Databricks workspace and cluster administration Apache Spark performance tuning Compute pools, jobs, and scheduling Library and dependency management
. Strong experience with Cloud platforms (Azure preferred).
. Hands-on experience with monitoring, troubleshooting, and operational support of data platforms.
. Solid understanding of security, access controls, and operational governance.

Industry Experience

. Experience supporting data platforms in enterprise or regulated environments, such as Energy, Utilities, Financial Services, or Government, is an asset.

Consulting & Collaboration Skills

. Ability to work effectively in client-facing environments.
. Strong communication skills to collaborate with architects, engineers, and stakeholders.
. Experience working in Agile delivery teams.

Additional Assets

. Experience with Delta Lake and Databricks Jobs.
. Familiarity with CI/CD and DataOps practices.
. Experience with monitoring and observability tools.
. Knowledge of cost management and optimization in cloud environments.

Education & Certifications

. Bachelor's degree in Computer Science, Engineering, Data Science, or a related field.
. Databricks certifications (e.g., Databricks Data Engineer, Databricks Platform Administrator) are a strong asset.
. Cloud certifications (Azure) are an asset.

"CGI is providing a reasonable estimate of the pay range for this role. The determination of this range includes various factors including but not limited to skill set level, geographic market, experience and training, and licenses and certifications. Compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range is $85,000 - $150,000."

Why CGI?
At CGI, you will play a critical role in ensuring the reliability and performance of enterprise analytics platforms for some of Canada's most complex organizations. You will work in a collaborative, ownership-driven culture while building deep expertise in modern data platforms.
Learn more at www.cgi.com.

#LI-AP1
 

Use of the term ‘engineering’ in this job posting refers to the technical sense related to Information Technology (IT) and does not imply that the individual practices engineering or possesses the requisite license as prescribed by the applicable provincial or territorial engineering regulator. We are seeking individuals with expertise in IT engineering-related functions, but licensure from an engineering regulator is not a prerequisite for this position. Engineering is a regulated profession in Canada which is restricted in terms of use of titles and designation.

Skills: Apache SparkData AnalysisGITGITSQL What you can expect from us:

Together, as owners, let’s turn meaningful insights into action.

Life at CGI is rooted in ownership, teamwork, respect and belonging. Here, you’ll reach your full potential because…

You are invited to be an owner from day 1 as we work together to bring our Dream to life. That’s why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our company’s strategy and direction.

Your work creates value. You’ll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise.

You’ll shape your career by joining a company built to grow and last. You’ll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.

At CGI, we value the strength that diversity brings and are committed to fostering a workplace where everyone belongs. We collaborate with our clients to build more inclusive communities and empower all CGI partners to thrive. As an equal-opportunity employer, being able to perform your best during the recruitment process is important to us. If you require an accommodation, please inform your recruiter.

To learn more about accessibility at CGI, contact us via email. Please note that this email is strictly for accessibility requests and cannot be used for application status inquiries.

Come join our team—one of the largest IT and business consulting services firms in the world.

Confirmar seu email: Enviar Email