Bangalore
41 days ago
Lead I - Software Engineering - Java Spark Developer
Job Title: Java Spark Developer

Location: Bangalore
Job Type: Full-time
Experience Level: 5 to 7 Years

Job Summary:

We are seeking an experienced Java Spark Developer to design, develop, and maintain scalable big data applications. The ideal candidate will have strong expertise in Core Java, Apache Spark, and data processing frameworks, with a solid background in working with relational databases and orchestration tools.

Primary Responsibilities:

Design, develop, and maintain Java-based big data applications using Apache Spark.

Work with data frames and Spark-SQL to process and analyze large datasets.

Integrate and manage relational databases such as MySQL, PostgreSQL, Oracle, or Db2.

Utilize orchestration frameworks to automate and manage data workflows.

Collaborate with data engineers to design and implement end-to-end data processing pipelines.

Write clean, maintainable, and efficient code following best practices.

Conduct code reviews and provide constructive feedback to team members.

Troubleshoot and resolve performance issues and software defects.

Stay updated with industry trends and emerging technologies in big data and Java development.

Skills Required:

Strong proficiency in Core Java.

5 to 7 years of hands-on experience with Apache Spark, including Spark-SQL and data frames.

Experience working with relational databases (e.g., Db2, PostgreSQL, MySQL).

Knowledge of orchestration frameworks (e.g., Airflow, Oozie, or similar).

Solid understanding of big data processing and analytics.

Excellent problem-solving skills and attention to detail.

Strong communication and collaboration abilities.

Skills Desired (Nice to Have):

Familiarity with distributed file systems (e.g., HDFS, S3).

Experience with CI/CD tools such as Jenkins or GitLab CI.

Understanding of data warehousing concepts.

Exposure to Agile/Scrum methodologies.

Additional Information:

Reporting To: [Insert Manager/Lead Name or Position]

Work Environment: [On-site/Remote/Hybrid]

Compensation: [Insert Salary/Rate, if applicable]

Confirmar seu email: Enviar Email