Company Profile:
We’re Hiring at CGI for our GCC - Right Here in Hyderabad!
Join us at the intersection of technology, finance, and innovation. You will be working to support one of the top-tier financial institutions in the U.S. You’ll help shape digital solutions for a global enterprise from the ground up.
Job Title: Lead Analyst - Data Engineer
Experience: 8 to 10 Years
Employment Type: Full Time-Permanent
Job Location: Hyderabad, India
Job ID: J0226-0468
Job Description:
• CGI is seeking a Lead Data Engineer with deep expertise in Big Data ecosystems to design, build, and lead large-scale data platforms.
• The role requires hands-on leadership in Hadoop-based architectures, distributed data processing using Spark, and advanced SQL-driven analytics.
• Lead the design and development of high-performance Big Data solutions using Hadoop and Spark.
• Architect and optimize batch and near–real-time data pipelines handling large data volumes.
• Drive data ingestion, processing, and transformation using PySpark and Spark SQL.
• Manage and optimize HDFS, Hive, and distributed storage systems.
• Ensure data reliability through data quality checks, validation frameworks, and reconciliation controls.
• Tune Spark jobs for performance, scalability, and fault tolerance.
• Collaborate with Architects, Analysts, and downstream consumers to deliver analytics-ready datasets.
• Provide technical leadership, conduct code reviews, and mentor junior engineers.
• Support production issues, root-cause analysis, and performance optimization in SLA-driven environments.
• Establish best practices for coding standards, documentation, and release management.
• Big Data Frameworks: Hadoop (HDFS, YARN), Apache Spark
• Programming: PySpark, Python, Advanced SQL
• Data Processing: Spark Core, Spark SQL, DataFrames, RDDs
• Data Storage: Hive, HBase, Parquet, ORC
• ETL / Workflow: Airflow / Oozie / Azkaban
• Databases: RDBMS (Oracle, SQL Server), NoSQL
• Linux & Scripting: Shell scripting, Linux fundamentals
• Version Control & DevOps: Git, CI/CD pipelines
Together, as owners, let’s turn meaningful insights into action.
Life at CGI is rooted in ownership, teamwork, respect and belonging. Here, you’ll reach your full potential because…
You are invited to be an owner from day 1 as we work together to bring our Dream to life. That’s why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our company’s strategy and direction.
Your work creates value. You’ll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise.
You’ll shape your career by joining a company built to grow and last. You’ll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.
Come join our team—one of the largest IT and business consulting services firms in the world.