Bernards, NJ, USA
10 hours ago
Data Engineer
Job Description We are seeking a highly skilled and experienced Data Engineer to join our growing team. The successful candidate will be responsible for designing, developing, and maintaining our AWS-based data lake, ensuring data quality, accessibility, and security. This role requires a strong understanding of AWS data services, data warehousing concepts, and best practices for building scalable and efficient data pipelines. Responsibilities: Design, implement, and maintain scalable and robust data pipelines for our AWS data lake using services such as AWS Glue, AWS Lambda, Amazon S3, Amazon S3 Vectors, Amazon BedRock, Amazon DataBrew, Amazon Athena, and Amazon QuickSite. Develop and optimize ETL processes to ingest, transform, and load data from various sources into the data lake. Ensure data quality, integrity, and security within the data lake environment. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs. Design conceptual, logical, and physical representations of the data to support efficient storage, access, and analysis, ensuring it meets business requirements . Develop, monitor and troubleshoot data pipelines and data lake infrastructure to ensure optimal performance and reliability. Implement and maintain data governance policies and procedures. Stay up-to-date with the latest AWS data services and technologies to recommend and implement improvements. Document data lake architecture, data flows, and operational procedures. We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/. Skills and Requirements Bachelor's degree in Data Science, Engineering, or a related field. 5+ years of experience in data engineering and data modeling, with a strong focus on AWS data services. Proven experience designing and implementing data lakes on AWS. Expertise in AWS services such as AWS Glue, AWS Lambda, Amazon S3, Amazon, S3 Vectors, Amazon BedRock, Amazon DataBrew, Amazon Athena, Amazon QuickSite, Amazon MCP and AWS Lake Formation. Strong proficiency in programming languages such as Python or Java. Experience with SQL and NoSQL databases. Solid understanding of data warehousing concepts, ETL processes, and data modeling. Familiarity with data governance, security, and compliance best practices. Excellent problem-solving, analytical, and communication skills. Ability to work independently and collaboratively in a fast-paced environment. AWS Certified Data Analytics – Specialty or AWS Certified Solutions Architect – Associate/Professional. Experience with data visualization tools (e.g., Tableau, Power BI). Familiarity with version control systems (e.g., Git). Experience with big data technologies (e.g., Spark, Hadoop, Apache IceBurg) null We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion,sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military oruniformed service member status, or any other status or characteristic protected by applicable laws, regulations, andordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to HR@insightglobal.com.
Confirmar seu email: Enviar Email