Senior Data Engineer - Remote in EU
We are looking for a strategic and experienced Senior Data Engineer to lead the design and implementation of our data analytics infrastructure. This role emphasizes big-picture thinking and architecture design, ensuring our data systems are robust, scalable, and aligned with organizational goals. If you're passionate about building data ecosystems and enjoy working with cutting-edge technologies, we'd love to hear from you.
What You’ll Be Working On
Architecture and Design
Design end-to-end data solutions to support analytics, machine learning, and real-time data processing.
Collaborate with stakeholders to define technical strategies to optimize performance and processes and align data solutions with business needs.
Data Pipeline Management
Build and maintain ETL/ELT pipelines using PySpark, Apache Iceberg, and Dagster (Python).
Optimize pipelines for performance, scalability, and cost-effectiveness.
Data Infrastructure
Manage and enhance AWS-based data infrastructure, including EMR, S3, Athena, and MSK (Kafka).
Develop data storage and query performance solutions, leveraging technologies like Parquet and Iceberg.
Strategic Oversight
Evaluate existing and new technologies to incorporate into our data platform.
Mentor team members and promote best practices in data engineering.
Collaboration and Problem Solving
Work closely with data analysts, and business teams to deliver data-driven solutions.
Troubleshoot complex data-related issues and ensure system reliability and data quality.
What You Bring to the Team
Technical Expertise:
Hands-on experience with AWS services such as EMR, S3, Athena, and MSK.
Proficiency in Python and PySpark for data engineering tasks.
Deep knowledge of data storage formats like Parquet and Iceberg.
Solid understanding of data streaming and real-time processing with Kafka.
Strategic Mindset:
Proven ability to design and implement scalable data architectures.
Strong problem-solving skills and experience with big-picture decision-making.
Experience:
5+ years of experience in data engineering or a related field.
Background in building and maintaining cloud-based data ecosystems.
Nice to Have:
Familiarity with Kubernetes and relevant AWS practices.
Experience with orchestration tools like Dagster.
Who You Are
Collaborative and able to communicate effectively with technical and non-technical stakeholders.
Forward-thinking, with a focus on innovation and future-proofing data systems.
Comfortable with both hands-on tasks and high-level strategy.
Countries we are hiring in: