Hyderabad, Telangana, India
8 hours ago
Senior Lead Software Engineer - Databricks Platform Engineer

Be an integral part of an agile team that's constantly pushing the envelope to enhance, build, and deliver top-notch technology products.

As a Senior Lead Software Engineer at JPMorgan Chase within the Consumer & Community Banking Risk Team, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. Drive significant business impact through your capabilities and contributions, and apply deep technical expertise and problem-solving methodologies to tackle a diverse array of challenges that span multiple technologies and applications.

Job responsibilities

Plan and deliver SAS-to-PySpark migrations on Databricks (cutover, validation, rollback).Build and maintain automated conversion utilities and CI/CD pipelines.Own data conversion and migration (schema mapping, quality checks, reconciliation, lineage).Run office hours for user communities, coach engineers, and drive best practices and standards.Optimize Databricks infrastructure (clusters, policies, performance, and cost).

 

Required qualifications, capabilities, and skills

Formal training or certification on software engineering concepts and 5+ years applied experience. In addition, 2 + years of experience leading technologists to manage and solve complex technical items within your domain of expertiseHands On experience  in data/analytics engineering; 5+ years leading large-scale Pyspark/Databricks programs.Proven SAS-to-PySpark migration delivery into production with measurable outcomes.Track record in data migration, quality assurance, and operational readiness Preferred qualifications, capabilities, and skillsDeep PySpark expertise (performance tuning, ETL functionality).Databricks platform proficiency (Unity Catalog, SQL Warehouses, job/cluster policies, MLflow basics).Automation and CI/CD (build/deploy pipelines, release management).Cloud fundamentals (AWS S3, IAM, networking, monitoring)  
Confirmar seu email: Enviar Email