Role Description: This role requires 6-7 years of experience and the ability to work closely with project leads and clients. As a Senior Big Data Engineer, you'll join our team to design and develop scalable data processing systems. You'll gather requirements, create end-to-end solutions, and oversee projects from conception to production. Key responsibilities include mentoring team members and translating complex business needs into robust technical solutions using cutting-edge technologies. Technical Skills: • Must have Strong expertise in Python, PySpark, Spark architecture and performance tuning. • Must have proficiency in writing optimized SQL with performance tuning aspects. • Must have strong expertise in AWS data engineering services (Glue, Lambda, API Gateway, S3). • Ability to translate complex business requirements into technical solutions. • Good to have working knowledge of Unix. • Good to have Hands-on experience with CloudFormation Experience with CI/CD pipeline. Soft Skills: • Strong problem-solving skills. Excellent communication abilities. • Comfortable working in a fast-paced environment. • Collaboration skills with cross-functional teams. • Ability to deliver high-quality results within project timelines.