The Senior Data Engineer will design, build, and operate high-performance BI-centric solutions utilizing the comprehensive capabilities of the company's analytics platform. In this role, you will enable and support the intelligence strategy, support sustainable, effective, and efficient solutions, collaborate on data solutions, and support intellectual curiosity and continuous learning to meet individual and team development goals.

Applies advanced subject matter knowledge to solve complex business issues and is regarded as a subject matter expert. Frequently contributes to the development of new ideas and methods. Works on complex problems where analysis of situations or data requires an in-depth evaluation of multiple factors. Leads and/or provides expertise to functional project teams and may participate in cross-functional initiatives. Acts as an expert providing direction and guidance to process improvements and establishing policies. Frequently represents the organization to external customers/clients. Exercises significant independent judgment within broadly defined policies and practices to determine best method for accomplishing work and achieving objectives. May provide mentoring and guidance to lower level employees.

Job Type : Hybrid/Flexible work culture

Responsibilities

Leads one or more project teams of other data engineers for all stages of design and development for complex, secure, and performant data solutions and models, including design, analysis, coding, testing, and integration of structured/unstructured data.Reviews and evaluates designs and project activities for compliance with architecture, security, and quality guidelines and standards; provides tangible feedback to improve product quality and mitigate failure risk.Drives innovation and integration of new technologies into projects and activities in the big data space.Create and maintain optimal data pipeline/ETL architecture.Collaborate with businesses, application and process owners, and product team members to define requirements and design solutions for the company’s big data and analytics solutions.Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Databricks and other technologies.Perform data modeling and prepare data in databases for use in various analytics tools, and configure and develop data pipelines to move and optimize data assets.Provide necessary technical support through all phases of the solution life cycle.Independently handle complex issues with minimal supervision, while escalating only the most complex issues to appropriate staff

Knowledge & Skills

Must Have

Databricks for data engineering, analytics, and machine learning workflowsPython and SQL programming and advanced ETL pipelinesLakeflow and Spark-based big data processing and orchestration on DatabricksGitHub, CI/CD, Databricks Asset Bundles, and modern software engineering practices applied to data engineeringStrong analytical and problem-solving skills

Nice to Have

BI and reporting tools (Tableau)Collaboration and Agile (Jira, Confluence, Scrum, Kanban)Experience with NoSQL and relational systemsA current Databricks Certified Data Engineer certificationTeam Leadership and Data Ops skills

Experience Highlights

Designing and deploying scalable data solutions on Databricks and cloud ecosystemsBuilding and optimizing distributed data pipelines for complex, high-volume environmentsImplementing BI solutions and enabling data-driven decision-makingCommunicating architecture and design proposals effectively to senior stakeholdersWorking at a complex, high-stakes, startup-like environment

Scope & Impact

Collaborates with peers, Data engineers, data scientists, and the project team.Typically interacts with high-level Individual Contributors, Managers, Directors, and Program Core Teams.Leads multiple projects requiring data engineering solutions development.Drives design innovation.

Prior Beneficial Experiences

Experience and skills with application programming interface development.Applied experience in reporting tools.Applied experience with cloud platforms.

Education & Experience

Bachelor's or Master's degree in Computer Science, Information Systems, Engineering, or equivalent.Typically 6-10 years’ experience.

#LI-POST