Role Proficiency:
This role requires proficiency in data pipeline development including coding and testing data pipelines for ingesting wrangling transforming and joining data from various sources. Must be adept at using ETL tools such as Informatica Glue Databricks and DataProc with coding skills in Python PySpark and SQL. Works independently and demonstrates proficiency in at least one domain related to data with a solid understanding of SCD concepts and data warehousing principles.
The backend engineer will play a key role in designing and implementing APIs, integrating with data pipelines, and ensuring high performance and reliability of server-side components.
Key Responsibilities:
• Design, develop, and maintain scalable backend services and APIs.
• Collaborate with data engineers to integrate backend systems with data pipelines and storage solutions.
• Implement authentication, authorization, and data security best practices.
• Optimize application performance and ensure high availability.
• Participate in Agile ceremonies and contribute to sprint planning, reviews, and retrospectives. • Work closely with the Business Analyst to understand functional requirements and translate them into technical solutions.
• Write clean, maintainable, and well-documented code.
• Troubleshoot and debug production issues as needed.
Required Skills & Qualifications: Technical Skills:
• Strong proficiency in backend programming languages such as Python, Java, or Node.js.
• Experience with backend frameworks like Django, Spring Boot, or Express.js. • Solid understanding of RESTful API and GraphQL design principles.
• Hands-on experience with SQL and NoSQL databases (e.g., PostgreSQL, MySQL, MongoDB).
• Familiarity with data integration tools and ETL pipelines.
• Experience with cloud platforms (AWS, Azure, or GCP).
• Knowledge of containerization (Docker) and orchestration (Kubernetes).
• Experience with CI/CD pipelines and version control systems (Git). Soft Skills:
• Strong problem-solving and analytical skills.
• Excellent communication and collaboration abilities. • Ability to work independently and in a team-oriented environment.
• Experience working in Agile/Scrum teams.