Airswift is looking for a Senior Data Engineer to work with one of our global clients in the energy sector.
Work model: 100% remote
Preferred location: Candidates based in Rio de Janeiro or São Paulo
Design, optimize, and debug data pipelines using Azure Databricks, PySpark, Python, and SQL
Work with Delta Lakes and Azure Synapse (both serverless and dedicated)
Develop dashboards and web applications using Power BI, Flask, Dash, and Plotly
Propose architectural improvements for better scalability and performance
Monitor Databricks cluster resources and perform performance tuning
Collaborate with data scientists and various stakeholders in fast-paced and ambiguous environments
Technical RequirementsAdvanced experience with Azure Databricks, Python, PySpark, and SQL
Hands-on experience with large-scale data projects
Proficiency in Pandas, NumPy, and/or Matplotlib
Familiarity with Git and/or Azure DevOps
Advanced English (both written and spoken)
Nice-to-Haves:
Experience with Power BI
Knowledge of Azure Functions and Power Apps
Experience with Flask, Dash, and Plotly
EducationBachelor’s degree in Engineering, Computer Science, or a related field
Behavioral ProfileAbility to handle rapidly changing priorities
Analytical mindset with a proactive and problem-solving approach
Strong communication and collaboration skills with cross-functional teams
Initiative and autonomy
#LI-MP2