RIO DE JANEIRO, BRA
19 hours ago
Quality Data Engineer (IDMC)
**Introduction** In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology. **Your role and responsibilities** This position is for talented and experienced Data Test Engineer with a strong background in Informatica Intelligent Data Management Cloud (IDMC). In this role, you will be responsible for ensuring the quality, reliability, volume, and accuracy of data across on-prem and cloud environments. You will validate data migration, transformation, and integration processes using Informatica IDMC, collaborating with cross-functional teams to ensure seamless data ingestion from multiple sources — including streaming technologies, cloud platforms, and various data stores — while maintaining the highest standards of data quality and consistency. **Required technical and professional expertise** We are looking for a talented Data Test Engineer with a strong background in Informatica Intelligent Data Management Cloud (IDMC). In this role, you will ensure the quality, reliability, volume, and accuracy of data across both on-premises and cloud environments. You will validate data migration, transformation, and integration processes using IDMC, collaborating with cross-functional teams to guarantee seamless data ingestion from multiple sources — including streaming technologies, cloud platforms, and diverse data stores — while maintaining the highest standards of data quality and consistency. Essential Job Functions * Design, develop, and execute test plans and test cases for data pipelines and workflows built with IDMC. * Perform data validation and transformation testing to verify completeness, consistency, and accuracy between source and target. * Develop and maintain automated data validation frameworks using Python, SQL, and IDMC’s built-in tools and APIs. * Implement data quality rules and support continuous integration through CI/CD pipelines. * Collaborate with development, operations, and infrastructure teams to identify and resolve data quality issues. * Document test plans, results, and findings in a structured and traceable manner. * Support testing activities related to data migration, profiling, analysis, and transformation. * Manage defect tracking and reporting, ensuring timely resolution and clear communication. * Contribute to process improvements and testing best practices within an Agile environment. * Apply IDMC coding skills, including creating end-to-end mappings with Filters, Routers, and Joiners. * Work with JSON structures, filters, and parsers to validate and transform data. * Apply basic Java knowledge to support custom code requirements. * Use Python to read and process data from various file formats, leveraging functions and libraries such as Pandas. Technical Requirements * Strong background in software product development and delivery. * Solid expertise in SQL for data validation and transformation. * Proven ability to design and execute data test plans, scenarios, and cases, with clear documentation of results. * Strong knowledge of Informatica IDMC or related data management tools. * Experience with Azure Cloud technologies such as ADF and PySpark. * Proficiency in Python and data libraries (e.g., Pandas). * Ability to interpret and create System & Architecture diagrams. * Strong collaboration skills and ability to work effectively in cross-functional teams. * Background in Agile methodologies and continuous improvement practices. **Preferred technical and professional experience** Position Summary: This position is for talented and experienced Data Test Engineer with a strong background in Informatica Intelligent Data Management Cloud (IDMC). In this role, you will be responsible for ensuring the quality, reliability, volume, and accuracy of data across on-prem and cloud environments. You will validate data migration, transformation, and integration processes using Informatica IDMC, collaborating with cross-functional teams to ensure seamless data ingestion from multiple sources — including streaming technologies, cloud platforms, and various data stores — while maintaining the highest standards of data quality and consistency. Essential Job Functions: · Design, develop, and execute test plans and test cases for data pipelines and workflows built using Informatica IDMC. · Perform data validation and transformation testing to verify completeness, consistency, and accuracy between source and target. · Develop and maintain automated data validation frameworks using Python, SQL, and IDMC’s built-in tools and APIs. · Implement data quality rules and support continuous integration through CI/CD pipelines. · Collaborate with development, operations, and infrastructure teams to identify and resolve data quality issues. · Document test plans, results, and findings in a structured and traceable manner. · Support testing activities related to data migration, profiling, analysis, and transformation. · Manage defect tracking and reporting, ensuring timely resolution and clear communication. · Contribute to process improvements and testing best practices within an Agile environment. · IDMC Coding experience. entails the following: Understanding creating mappings end to end on IDMC using Filters, Routers, Joiners JSon With JSON so parsing JSoN Filters, JSON structures, JSON Strings, Structure Parser. Some Java experience to write a basic code. · Python Code: Reading files Functions to read and process data from various file formats. (edited) Minimum Position Qualifications/Education Requirements: · A bachelor’s degree in computer science or related information technology field from an accredited institution or equivalent work experience · 6+ years of software product development and delivery experience. · 5+ years of SQL experience. · 3+ years of IDMC tool or related experience. · 3+ years’ experience overseeing the development of data test plans, test scenarios, test cases, execution of test case and documentation of test results · 2+ years of experience in some of the Azure Cloud tools: ADF, Pyspark · Experience with Python and libraries like Pandas. · Ability to interpret and draw System & Architecture diagrams. · Familiar with Latest Cloud Technologies.osition Summary: This position is for talented and experienced Data Test Engineer with a strong background in Informatica Intelligent Data Management Cloud (IDMC). In this role, you will be responsible for ensuring the quality, reliability, volume, and accuracy of data across on-prem and cloud environments. You will validate data migration, transformation, and integration processes using Informatica IDMC, collaborating with cross-functional teams to ensure seamless data ingestion from multiple sources — including streaming technologies, cloud platforms, and various data stores — while maintaining the highest standards of data quality and consistency. Essential Job Functions: · Design, develop, and execute test plans and test cases for data pipelines and workflows built using Informatica IDMC. · Perform data validation and transformation testing to verify completeness, consistency, and accuracy between source and target. · Develop and maintain automated data validation frameworks using Python, SQL, and IDMC’s built-in tools and APIs. · Implement data quality rules and support continuous integration through CI/CD pipelines. · Collaborate with development, operations, and infrastructure teams to identify and resolve data quality issues. · Document test plans, results, and findings in a structured and traceable manner. · Support testing activities related to data migration, profiling, analysis, and transformation. · Manage defect tracking and reporting, ensuring timely resolution and clear communication. · Contribute to process improvements and testing best practices within an Agile environment. · IDMC Coding experience. entails the following: Understanding creating mappings end to end on IDMC using Filters, Routers, Joiners JSon With JSON so parsing JSoN Filters, JSON structures, JSON Strings, Structure Parser. Some Java experience to write a basic code. · Python Code: Reading files Functions to read and process data from various file formats. (edited) Minimum Position Qualifications/Education Requirements: · A bachelor’s degree in computer science or related information technology field from an accredited institution or equivalent work experience · 6+ years of software product development and delivery experience. · 5+ years of SQL experience. · 3+ years of IDMC tool or related experience. · 3+ years’ experience overseeing the development of data test plans, test scenarios, test cases, execution of test case and documentation of test results · 2+ years of experience in some of the Azure Cloud tools: ADF, Pyspark · Experience with Python and libraries like Pandas. · Ability to interpret and draw System & Architecture diagrams. · Familiar with Latest Cloud Technologies. IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.
Confirmar seu email: Enviar Email