With hundreds of millions of users using Office365 services, huge amount of data are generated every day. Data is mission critical for Office365 services. It helps engineering teams to understand the quality of live services, generate insights of feature usage and user behavior, troubleshoot bugs and issues. It also offers better visibility to product and management teams on business impacts, empowers product and scientist teams to build intelligence features.
To support the continuously growth of business needs from Office365, Office Data Loader team builds the hyper-scale distributed data ingestion service. We directly manages the ingestion service on more than 300,000 Exchange Online machines, which upload more than 30,000 TB data to our hyper-scale distributed storage every day. We also support the ingestion service running on even more machines for other Office365 products.
As the fundamental data ingestion service, we play an incredibly important role to make sure data uploading meet the privacy and compliance requirements. Sensitive data needs to be transformed to prevent privacy leaks or ne. Moreover, privacy leak detection and resolution are also built by us as the safeguard. User data that empowers Machine Learning scenarios has even higher requirements on the design of our service. Privacy and compliance are always our top priority, because Microsoft runs on Trust!
Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.