Azure is Microsoft’s central cloud infrastructure hosting both our public cloud offerings as well as a vast number of Microsoft-internal cloud scale services. Cloud computing is a highly competitive and rapidly growing market, and it is Azure’s aim to be an industry leader in all relevant aspects and dimensions across its platform and services. Within Azure, the Azure Compute team is the core infrastructure team responsible for hosting VMs, containers, and other workloads. One of the fundamental core disciplines in cloud computing is capacity management. Capacity management needs to ensure that on the one hand, there is sufficient capacity across all regions, allocation domains, and hardware infrastructure to meet all customer demand; while on the other hand ensuring that capacity is provisioned efficiently thereby avoiding overspending and COGS/CAPEX impact. At the scale of Azure’s business, managing this trade-off across the entire Azure Compute fleet is an enormously complex and challenging task, where improvements can make the difference between customer allocation failures on the one hand, and gargantuan savings on the other. The Azure Compute Capacity and Efficiency (AC2E) team is the team in Azure Compute tasked with managing all aspects of capacity and efficiency management across the fleet. Our primary task is to provide a fully automated and highly optimized tracking and management system. This system – of which CMAS (Capacity Management Automation System) is a core piece – uses numerous state-of-the-art algorithms. We use artificial intelligence to automatically predict capacity risk and execute the correct mitigation actions directly into the Azure Compute platform. As a Data Engineer in the team, you will work closely with our software engineers, program managers, and data scientists across different teams within Azure Core. You will also collaborate with a variety of internal partner teams across Azure and Microsoft. You will build reliable, secured, highly scalable, performant data pipelines to enhance the Azure Compute allocation, deliver capacity management and efficiency improvements. The value of your work will be reflected in improvements to the Azure platform, Azure service capacity fulfillment rate, customer satisfaction, and various efficiency metrics, including COGS reduction. You will have opportunities for mentorship, accelerate your career growth, and work on truly high-business impact areas. Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond. **Responsibilities** + With guidance, you’ll implement basic code to extract raw data, validate its quality, and ensure the correct data is ingested within your area of work. You’ll also apply basic modification techniques to transform raw data into forms compatible with downstream data sources. + With guidance from others, you’ll contribute to the development of data tools that can transform, manage, and access data. You’ll also validate code to test the storage and availability of data platforms so that they’re more resilient. + You will contribute to performance monitoring protocols across a data pipeline, supporting existing visualizations and aggregations to ensure pipeline performance. You’ll assist others in implementing solutions that minimize points of failure and help test improvements across a product feature. + You will follow data modeling and handling procedures to maintain compliance with all applicable laws and policies across your assigned workstreams. You’ll also learn about permissions and approvals for data access within a data pipeline. + Data Infrastructure, Implement Continuous Integration/Continuous Delivery (CI/CD) Pipelines, Data Engineering, build metrics, insights generation, data analysis, platform recommendations and analytics with deep domain knowledge understanding. + Advocate for best practices in data engineering. **Qualifications** **Required/Minimum Qualifications:** + Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND experience in business analytics, data science, data modeling or data engineering work + OR equivalent experience. + Programming Language experience - Python, C# or C++ or equivalent **Other Requirements:** + Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings:  + Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter. **Additional or Preferred Qualifications:** + Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND of business analytics, data science, software development, data modeling or data engineering work experience + OR equivalent experience \#azurecorejobs Microsoft is an equal opportunity employer. Consistent with applicable law, all qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations (https://careers.microsoft.com/v2/global/en/accessibility.html) .