New York, NY, 10176, USA
13 days ago
Lead Data Warehouse Engineer - Scientific Computing & Data
**Job Description** The Scientific Computing & Data group at the Icahn School of Medicine at Mount Sinai (ISMMS) partners with scientists to accelerate scientific discovery. To achieve these aims, we support a cutting-edge high-performance computing (HPC) and research data ecosystem with MD/PhD-level support for researchers. Our research data ecosystem includes a “data commons” repository and two research clinical data warehouses: one for ISMMS’s research community, and a second for the Kidney Precision Medicine Project (KPMP), a multi-institutional research consortium (www.kpmp.org) funded by the National Institute of Diabetes and Digestive and Kidney Diseases (NIDDK). The **Lead Data Warehouse Engineer** is a senior technical specialist responsible for leading the development, maintenance, and ongoing operations of Scientific Computing & Data’s research data warehouses. In this position, the **Lead Data Warehouse Engineer** will collaborate with other members of the research data warehouse team and with research stakeholders of ISMMS and KPMP to expand functionality and integrate new data sources into the data warehouses. Both research data warehouses are built on the Microsoft SQL Server technology stack and use the OMOP Common Data Model, published by the Observational Health Data Sciences and Informatics (OHDSI) collaborative ( www.ohdsi.org ), for multi-institutional data sharing and interoperability. Data transformations are performed in-database using Transact-SQL stored procedures, with SSIS used only for job orchestration. **Qualifications** + Bachelors degree in a technical discipline; Masters degree preferred + 12-15 years preferred of related experience, including 7 years of experience with the design, development and maintenance of relational databases, data pipelines and dimensional/OLAP data warehouses. **Preferred:** + Expert knowledge of data warehousing principles and best practices: database design/3NF, dimensional modeling (e.g., types of fact tables, slowly changing dimensions), change data capture/bi-temporal versioning, incremental data loads, transparent data lineage, etc. + Expert-level development experience with Microsoft SSIS, Visual Studio, SQL Server Data Tools, and SQL Agent jobs is required. + Expert-level Microsoft SQL Server and Transact-SQL development skills are required: clustered columnstore indexes, stored procedures, user-defined functions, sequences, advanced T-SQL features, metadata- or parameter-driven dynamic SQL, Linked Servers, and other features. + Knowledge of data warehousing development best practices is required, including explicit source-to-target mappings; pattern-based and parameter-driven development; and rigorous version control using Git, BitBucket, Microsoft Team Foundation Server (TFS), or equivalent. + Experience with DevOps and Software Development Life Cycle (SDLC) best practices is required.Experience with Agile developments methods (Scrum, Kanban) and tools (e.g., Atlassian JIRA and Confluence) is a strong plus. + Strong consultative customer service and communication skills (verbal and written) to interact effectively with researchers, clinicians, hospital administrators, and other IT personnel. + Excellent critical thinking, problem-solving, multi-tasking, and collaboration skills. + Fast learner with the ability to work independently and productively in a fast-paced environment. + Prior experience working with healthcare data is strongly preferred, which may include electronic health records (EHR), medical and pharmacy billing & claims, and/or health care cost accounting systems. Experience with Epic Systems Corporation’s Clarity and Caboodle reporting databases is strongly preferred. + Prior experience with common data models used in biomedical research including OMOP, i2b2, and/or PCORnet. + Prior experience with Azure Synapse Analytics, Azure Data Factory, and other database and ETL/ELT technologies, such as Oracle PL/SQL and PostgreSQL PL/pgSQL is a plus. + Experience with database administration tasks in a Microsoft SQL Server environment is a plus: database configuration; performance tuning using indexes, partitioning, materialized views, and other methods for improving query performance; user provisioning and access permissions; backups and restorations. + Scripting experience (Powershell, Python, PERL, or similar) in Microsoft Windows and/or Linux is a plus. + Some experience with HL7 messages and web services interfaces (e.g., REST API) is a plus. + Prior experience building reports and dashboards with Microsoft SSRS, Microsoft Power BI, Tableau, or similar business intelligence tools is a plus. **Responsibilities** + Design databases and pipelines to meet customer needs while balancing trade-offs in functionality, performance, operating cost, and development time.Collaborate effectively with the product manager to identify and evaluate the pros and cons of technical options. + Design, build, test, maintain, and control ETL/ELT data transformations that integrate data into the data warehouses.Build data transformations in Transact-SQL stored procedures and orchestrate data pipelines using SSIS and SQL Agent jobs.Ensure extensibility and low-cost maintenance via metadata-driven design patterns where applicable. + Serve as a team leader fostering teamwork and effective collaboration with peers, product manager, scrum master, and other stakeholders.May act as a project leader, as required.Contribute to effective project management, including work breakdown, sequencing of dependencies, and release management. + Develop, refine, and promote the use of standards, conventions, design patterns, and operating procedures for database and data pipeline design, DevOps and SDLC best practices, data warehouse operations (i.e. data pipeline executions), and ongoing data warehouse maintenance (e.g., backups, statistics/indexes, patching). + Mentor junior engineers in data warehousing principles, data engineering skills, and ongoing data warehouse operations and maintenance. + Design, build, test, maintain, and control other processes for data management, including management and loading of flat files in a variety of formats (e.g., csv, tsv, pipe-delimited, XML, JSON). + Facilitate design sessions, code walkthroughs, and peer reviews to ensure quality, robustness, and low-cost maintainability of technical solutions.Write technical documentation for reference and knowledge transfer. + Performance tuning of database objects, stored procedures, data transformation jobs, and related scripts to optimize both end-user customer queries and data pipeline processing.Create database and data transformation designs that minimize CPU processing overhead and storage footprints to control costs. + Monitor the ongoing operations of databases and data pipelines to ensure expected functioning, performance, and uptime.Lead and/or coordinate the troubleshooting and remediation of all data pipeline failures in a timely manner. After-hours and weekend on-call support is sometimes required. + Collaborate effectively with database and system administrators on routine maintenance tasks, including backups, database performance tuning and statistics/index maintenance, software and operating system patches and upgrades. + Deliver world-class customer service in all interactions with customers, stakeholders, and other teams within ISMMS and Mount Sinai’s Digital & Technology Partners (DTP) organization. Maintain a customer-focused approach to provide solutions that are science/research-driven. + Maintain patient privacy and the integrity and security of healthcare data in all databases and systems, including compliance with all applicable laws, regulations, and Mount Sinai’s policies related to its Institutional Review Board (IRB), patient privacy, and IT cybersecurity.These laws include, but are not limited to, the “Common Rule” (45 CFR Part 46), HIPAA (45 CFR Part 164), 42 CFR Part 2, and New York’s Article 27-F. + Communicate and work effectively and collaboratively with fellow team members and with other IT professionals throughout Mount Sinai. + As a senior technical lead, independently investigate and stay abreast of new and emerging technologies that Scientific Computing & Data could leverage to provide new capabilities, to boost efficiencies or quality, and/or lower operating costs. + Identify possible or needed improvements in work procedures, technology solutions, regulatory compliance, and data privacy/security. + Periodically assist the DBAs with database administration tasks, including user provisioning and access permissions, backups, environment restorations, capacity planning and load monitoring, performance tuning, etc. + Performs related duties as assigned or requested. **About Us** **Strength through Unity and Inclusion** The Mount Sinai Health System is committed to fostering an environment where everyone can contribute to excellence. We share a common dedication to delivering outstanding patient care. When you join us, you become part of Mount Sinai’s unparalleled legacy of achievement, education, and innovation as we work together to transform healthcare. We encourage all team members to actively participate in creating a culture that ensures fair access to opportunities, promotes inclusive practices, and supports the success of every individual. At Mount Sinai, our leaders are committed to fostering a workplace where all employees feel valued, respected, and empowered to grow. We strive to create an environment where collaboration, fairness, and continuous learning drive positive change, improving the well-being of our staff, patients, and organization. Our leaders are expected to challenge outdated practices, promote a culture of respect, and work toward meaningful improvements that enhance patient care and workplace experiences. We are dedicated to building a supportive and welcoming environment where everyone has the opportunity to thrive and advance professionally. Explore this opportunity and be part of the next chapter in our history. **About the Mount Sinai Health System:** Mount Sinai Health System is one of the largest academic medical systems in the New York metro area, with more than 48,000 employees working across eight hospitals, more than 400 outpatient practices, more than 300 labs, a school of nursing, and a leading school of medicine and graduate education. Mount Sinai advances health for all people, everywhere, by taking on the most complex health care challenges of our time — discovering and applying new scientific learning and knowledge; developing safer, more effective treatments; educating the next generation of medical leaders and innovators; and supporting local communities by delivering high-quality care to all who need it. Through the integration of its hospitals, labs, and schools, Mount Sinai offers comprehensive health care solutions from birth through geriatrics, leveraging innovative approaches such as artificial intelligence and informatics while keeping patients’ medical and emotional needs at the center of all treatment. The Health System includes more than 9,000 primary and specialty care physicians; 13 joint-venture outpatient surgery centers throughout the five boroughs of New York City, Westchester, Long Island, and Florida; and more than 30 affiliated community health centers. We are consistently ranked by U.S. News & World Report's Best Hospitals, receiving high "Honor Roll" status, and are highly ranked: No. 1 in Geriatrics, top 5 in Cardiology/Heart Surgery, and top 20 in Diabetes/Endocrinology, Gastroenterology/GI Surgery, Neurology/Neurosurgery, Orthopedics, Pulmonology/Lung Surgery, Rehabilitation, and Urology. New York Eye and Ear Infirmary of Mount Sinai is ranked No. 12 in Ophthalmology. U.S. News & World Report’s “Best Children’s Hospitals” ranks Mount Sinai Kravis Children's Hospital among the country’s best in several pediatric specialties. The Icahn School of Medicine at Mount Sinai is ranked No. 11 nationwide in National Institutes of Health funding and in the 99th percentile in research dollars per investigator according to the Association of American Medical Colleges. Newsweek’s “The World’s Best Smart Hospitals” ranks The Mount Sinai Hospital as No. 1 in New York and in the top five globally, and Mount Sinai Morningside in the top 20 globally. **Equal Opportunity Employer** The Mount Sinai Health System is an equal opportunity employer, complying with all applicable federal civil rights laws. We do not discriminate, exclude, or treat individuals differently based on race, color, national origin, age, religion, disability, sex, sexual orientation, gender, veteran status, or any other characteristic protected by law. We are deeply committed to fostering an environment where all faculty, staff, students, trainees, patients, visitors, and the communities we serve feel respected and supported. Our goal is to create a healthcare and learning institution that actively works to remove barriers, address challenges, and promote fairness in all aspects of our organization. **Compensation Statement** Mount Sinai Health System (MSHS) provides a salary range to comply with the New York City Law on Salary Transparency in Job Advertisements. The salary range for the role is $145200 - $217875 Annually. Actual salaries depend on a variety of factors, including experience, education, and hospital need. The salary range or contractual rate listed does not include bonuses/incentive, differential pay or other forms of compensation or benefits.
Confirmar seu email: Enviar Email