Sr. Data Engineer - INTL LATAM
Insight Global
Job Description
Sr. Data Engineer - INTL LATAM
A medium sized software solutions company that specializes in retail intelligence is looking for a Sr. Data Engineer to join their team for a remote contract that should last around 9 months with the potential to be extended or brought on permanently. Their business model revolves around collecting data from other companies and brands and building price matching tools for their clients products and services. This role would be a joining a relatively small team to continue to build a new price matching data platform. This candidate would ideally have strong data background in the technologies below but also able to do some back-end development with Python.
Some essential duties of the role include:
Data integration and matching using pipelines to collect and correlate products cross different retailers.
Work with Architects and Engineers to implement microservices based architectures.
Algorithm optimization using data processing pipelines to improve efficiency and accuracy.
Collaborate within a team environment and mentor junior developers. This includes strong communication with other internal teams to finish the project.
Stong problem solving and analytical skills will be needed on a daily bases.
Here is a full list of technologies that may be used but the required skills and experience are listed in order of most importance for the position.
Languages: Python, SQL , NodeJS/NestJS/Typescript, React/Redux
Infrastructure: AWS, Docker, Kubernetes, Apache Spark, Apache Airflow, Terraform, GitHub Actions, ArgoCD
Databases: MongoDB, Postgres, MySQL, Trino, Iceberg, Redis, Memcached
Streaming and Queuing: Kafka, NATS, RabbitMQ, Keda
$25/hr+ based on experience
Exact compensation may vary based on several factors, including skills, experience, and education.
Benefit packages for this role will start on the 1st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable local law.
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.
Skills and Requirements
Data Lakehouse/Lakes
Apache Iceberg
Kubernetes
AWS, Linux and infrastructure as code.
Python/Node.js
RDMS/NoSQL/Big Data solutions (Postgres, MongoDB, Trino, etc.) GitHub
React
AI/ML background
Kafka, Pulsar, Kinesis/Firehose, etc.
Spark, Flink, and Airflow
C4 modeling
CQRS
Confirmar seu email: Enviar Email
Todos os Empregos de Insight Global