USA
46 days ago
Senior Specialist, DataOps Engineer/Admin
Date: July 2025 TITLE:Senior Specialist, DataOps Engineer/Administrator RESPONSIBLE TO:Director, Data and Compliance DIVISION/DEPT:Digital and Technology Services SUPERVISES:N/A FLSA STATUS:Exempt SUMMARY: We are seeking a DataOps Engineer/Administrator to design, build, and manage data pipelines and operations across Microsoft Fabric, Azure SQL, and Azure Synapse environments. This hybrid role combines engineering automation with operational governance, ensuring our data pipelines are secure, scalable, observable, and compliant. You’ll work closely with data engineers, data stewards, and governance teams to support modern data platform initiatives, including ingestion pipelines, metadata cataloging, and performance monitoring. BASIC FUNCTION: The DataOps Engineer/Administrator supports the Director of Data and Compliance by managing the ingestion and operational lifecycle of enterprise datasets. This includes designing data pipelines, maintaining ingestion jobs from Azure SQL to Fabric Lakehouse, monitoring pipeline reliability, implementing governance policies, and tagging metadata in Microsoft Purview. This role supports business domains like Mission, HR, and Finance by ensuring that governed data assets are ingested, discoverable, and production-ready for analytics and reporting use cases. SPECIFIC DUTIES: • Build and maintain ingestion pipelines in Microsoft Fabric, Synapse, and Data Factory using Medallion architecture (Bronze → Silver → Gold). • Automate data extraction and transformation from Azure SQL using views, stored procedures, and incremental logic. • Monitor daily pipeline executions across Dev, QA, and Prod environments; resolve ingestion failures and performance bottlenecks. • Set up alerts and observability dashboards for ingestion health, SLA breaches, and cost monitoring. • Build automated checks and alerts for data anomalies, schema drift, and SLA violations using tools like Azure Monitor or custom scripts. • Implement and document data quality rules (e.g., null checks, referential integrity, schema validation). • Apply domain tags, metadata, and sensitivity labels using Microsoft Purview and OneLake Catalog standards. • Collaborate with data stewards to document datasets, ensure lineage, and improve discoverability. • Support CAB/ARB processes for ingestion pipeline changes, new domains, and security exceptions. • Assist in managing Azure SQL connectivity, including credentials, firewalls, and query optimization for ETL workloads. • Track audit logs and enforce encryption and access control requirements based on GII Data Security Policy. • Monitor and optimize Azure resource usage and pipeline performance to ensure cost-effective operations. • Implement backup, failover, and recovery strategies for critical data pipelines and assets. • Maintain pipeline run logs, ingestion documentation, and CI/CD configurations in Azure DevOps. • Provide technical support to analysts, engineers, and business users related to governed datasets. As a member of a small team, support in other duties as needed. RELATIONSHIPS: Internal: Daily contact with GII team members to coordinate projects and support activities Local Goodwills: Not applicable External: Periodic coordination with technology vendors, contractors, or external platform service SKILLS NEEDED: • Experience with Microsoft Fabric, Azure Synapse, and Azure Data Factory pipelines. • Deep proficiency in SQL, especially Azure SQL Managed Instance (views, indexes, stored procs). • Familiarity with Microsoft Purview, OneLake Catalog, and data classification/tagging strategies. • Advanced proficiency in T-SQL for developing and optimizing views, stored procedures, and ETL logic within Azure SQL environments. Skilled in implementing incremental data loads, query tuning, and supporting ingestion pipelines with robust SQL-based transformations. • Proficiency in scripting languages such as Python and PowerShell for automating data workflows, managing Azure resources, and supporting CI/CD pipelines. Experience using scripts to streamline ingestion processes, monitor pipeline health, and enforce governance policies. • Hands-on experience with CI/CD in Azure DevOps for data infrastructure deployment. • Understanding of Medallion architecture and data lake storage patterns. • Experience building robust, monitored data pipelines that support data quality and SLA tracking. • Strong troubleshooting skills across ingestion, compute, and storage layers. • Familiarity with security practices for data encryption, access controls, and PII governance. • Skills in analyzing and optimizing Azure resource usage and pipeline execution costs. • Excellent communication and documentation skills; ability to collaborate across roles. • Strong accountability and ownership mindset and a willingness to continuously learn new skills. • Ability to translate technical terms into business language. • Ability to pivot to changing priorities. • Proactively identify, communicate, and resolve both technical and business process issues. EDUCATION: Bachelor’s degree in Computer Science, Information Systems, Data Engineering, or equivalent hands-on experience. Microsoft certifications in Azure, Fabric, or Purview strongly preferred (or willingness to obtain within 6 months). EXPERIENCE: Minimum 3 years of experience in a DataOps, Data Engineering, or Platform Administration role. Must have demonstrable experience working with Microsoft Azure cloud platforms, SQL-based systems, and data pipeline tools. Experience with Fabric Lakehouse, Medallion architecture, and Microsoft Purview is highly desirable. DECISION MAKING: Responsible for implementing ingestion frameworks, responding to ingestion failures, and advising on secure and compliant data integration strategies. Participates in reviews for platform optimization and governance decisions. SUPERVISION: Moderate with latitude given to the position in carrying out work assignments. Work is checked for accuracy and completeness. PHYSICAL EFFORT: Sedentary with lifting 10 pounds maximum and occasionally lifting and/or carrying such articles or files. Walking and standing are required occasionally; long hours sitting at a desk and using a computer. EMOTIONAL EFFORT: Work environment usually hectic with periods of high stress. Must demonstrate a positive attitude in meeting daily challenges. OUR VALUES We believe everyone deserves an opportunity to thrive. Goodwill’s mission grounds us and happens through each one of us. This aspiration applies to each GII team member as much as to the people we serve. GII’s organizational values guide all that we do; how we do our work and make decisions, and how we interact with each other, Goodwill members and all stakeholders. Our mission happens through me (Passion) We have a fire for our mission. We bring our energy, creativity and passion to all that we do. By contributing the best of what is within each of us, we inspire the same in our peers, and multiply Goodwill’s impact. Drive to make a difference (Impact) We believe that our work must lead to a measurable difference in the lives of the people Goodwill serves. We are committed to performance excellence in all that we do. Our strategy focuses our work to achieve that impact, and we say no to things that do not align. You before me (Respect) We treat all people with dignity, kindness, appreciation and respect. We are curious without judgment, and we actively listen to ensure mutual understanding. We give everyone a caring and safe place to share their opinions, their talents, and their questions. We build trust through direct, clear and transparent communication. We are open and humble. Thriving begins at home (Well-being) We respect the contributions and the needs of our individual team members equally, and we understand that each one of us needs different things at different times to thrive both in and out of the workplace. We strive to make genuine and continuous investments in one another and ourselves. As such, we adopt healthy, holistic approaches to our work. We proactively care for one another and ourselves by speaking up for what we need and supporting one another in achieving it. Out of many, One Goodwill (Advancing Our Mission Together) We embrace all people and perspectives as we advance Goodwill’s mission to help people reach their full potential through the power of work. We acknowledge historical inequities still exist and are intentional in breaking barriers. We are committed to being part of the solutions, leaning into courageous conversations, and providing inclusive spaces and equal opportunities for real change in all of our endeavors. Our diversified reflection shall shine as one Goodwill. Be bold, learn and grow (Agility) We are open, creative, innovative, agile and willing to take risks. We operate with a sense of urgency, without rushing for the sake of speed. While we do our best to make good decisions, we embrace failure for the learning it affords and adapt quickly to move ahead. We are one unified team that succeeds and stumbles, and learns and grows together with humility and grace.
Confirmar seu email: Enviar Email
Todos os Empregos de Goodwill Industries International, Inc.