Founded in 1976, CGI is among the world's largest independent IT and business consulting services firms. With 94,000 consultants and professionals globally, CGI delivers an end-to-end portfolio of capabilities, from strategic IT and business consulting to systems integration, managed IT and business process services, and intellectual property solutions. CGI works with clients through a local relationship model complemented by a global delivery network that helps clients digitally transform their organizations and accelerate results. CGI Fiscal 2024 reported revenue is CA$14.68 billion, and CGI shares are listed on the TSX (GIB.A) and the NYSE (GIB). Learn more at cgi.com.
Job Title: Spark & Scala & Odoo
Position: SE / SSE / Lead Analyst / Associate Consultant
Experience: 5-10yrs
Work Type: Hybrid
Employment Type: Full Time
Qualification: Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
Technologies:
. Sound knowledge in Spark, Scala
. Python programming language
. Frontend: HTML/CSS/XML/Java script
. Integration/Rest APIs
. Docker, Kubernetes
. CI/CD with GitLab
. Databases: RDBMS (Postgres DB)
Tools Used : Jira, GitLab, Confluence
Responsibilities:
Data Pipeline Development: Design, implement, and optimize robust and scalable data processing pipelines using Apache Spark. Transform, clean, and enrich raw data from diverse sources into valuable insights.
Data Optimization: Identify opportunities to enhance data processing efficiency and performance. Implement optimizations such as partitioning, caching, and compression to reduce processing time and resource utilization.
Scala Programming: Leverage your strong Scala programming skills to write efficient, maintainable, and scalable code for data processing tasks and pipeline orchestration.
Kubernetes Expertise: Utilize Kubernetes for container orchestration, deploying Spark applications, and managing microservices. Scale resources, monitor cluster health, and troubleshoot issues as needed.
Cloud Knowledge: Architect, develop, and maintain data solutions on the cloud platform. Design services for high availability, security, and scalability while optimizing costs.
DevOps Integration: Implement DevOps practices to automate deployment, monitoring, and scaling of data applications. Collaborate with the DevOps team to establish efficient CI/CD pipelines.
Performance Tuning: Analyse and address performance bottlenecks in data processing pipelines. Optimize code and configurations to achieve optimal resource utilization and job execution times.
Data Quality and Governance: Ensure data quality, consistency, and accuracy throughout the data processing lifecycle. Collaborate with data governance teams to adhere to data quality standards.
Design and development of new features for xxxxx backend application
. Create/Deploy/Manage a Cloud Native Multi-tenant platform and business Applications built on Odoo platform and Spark/Scala
. Requirement Analysis and confirm the understanding with Solution team
. Architect & Design User Interface using Spark and Odoo platform OTB capabilities, JavaScript, Web API and apply latest front-end best practices
. Developing application using Spark, python code
. Integrate existing Nokia or 3rd party owned software platforms and systems using Rest APIs or other protocols.
. Develop high quality code (clean, reusable, maintainable) with maximum level of testing automation by leveraging suitable testing frameworks and technologies
. Conducting unit, system, performance and security tests.
. Ensuring high performance/availability of applications and providing support.
. Implementation of security and data protection. Fix the security findings within SLA
. Integration of data storage solutions {{may include databases, key-value stores, blob stores, etc.}}
. Containerize deployment solution
. Create and maintain CI/CD pipeline as per the Nokia blueprint
. Troubleshoot and resolve technical problems in timely and accurate manner to improve application performance and functionality.
. Design Documentation, User Documentation and L4 support
. Responsible for end-end maintenance of DevOps cycle of the project (code Platform, test, build, deploy and manage) using Gitlab.
Together, as owners, let’s turn meaningful insights into action.
Life at CGI is rooted in ownership, teamwork, respect and belonging. Here, you’ll reach your full potential because…
You are invited to be an owner from day 1 as we work together to bring our Dream to life. That’s why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our company’s strategy and direction.
Your work creates value. You’ll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise.
You’ll shape your career by joining a company built to grow and last. You’ll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.
Come join our team—one of the largest IT and business consulting services firms in the world.