Data Engineer

hace 1 semana

Cordoba, Argentina Techunting A tiempo completo

Description

**Duties**:

- Designing, implementing, and maintaining batch and streaming data pipelines between various SQL sources, including Aurora and SQL Server, and a target data lake in S3, as well as enterprise data stored in Redshift/Snowflake.
- Expertise in AWS cloud services, such as Kinesis, S3, Lake Formation, Glue, and Step Functions, to build scalable, reliable, and high-performance data pipelines that enable seamless data integration and empower data-driven insights.
- Data Pipeline Design: Design end-to-end data pipelines that efficiently extract, transform, and load data from SQL sources (Aurora, SQL Server) to the target data lake in S3 and the enterprise data in Redshift/Snowflake.
- Batch and Streaming Integration: Implement both batch and real-time streaming data integration solutions using AWS Kinesis and other relevant technologies.
- Data Transformation: Develop data transformation processes using AWS Glue or other ETL tools to harmonize, cleanse, and enrich data for analytical use.
- Data Governance: Ensure adherence to data governance and security standards across the data pipelines, guaranteeing data privacy and compliance. Performance Optimization: Continuously monitor and optimize the performance of the data pipelines, addressing bottlenecks and ensuring efficient data processing and delivery.
- Error Handling and Monitoring: Implement error handling mechanisms and robust data monitoring to identify and resolve data pipeline issues proactively.
- Data Cataloging and Lineage: Establish and maintain data cataloging and lineage information using AWS Glue Data Catalog to enable data discoverability and traceability.
- Documentation: Create comprehensive technical documentation, including design specifications, data flow diagrams, and operational guides.
- Collaboration: Collaborate with data analysts, data scientists, and other stakeholders to understand data requirements and deliver reliable data solutions.
- Data Governance: Ensure data governance principles are implemented throughout the data pipelines to maintain data quality and integrity.

**Requirements**:
**Education Qualification**:

- Bachelor's Degree from an accredited college or university with a major in Computer Science, Information Systems, Engineering, Business, or other related scientific or technical discipline.

**General Experience**:

- At least six (6) years of experience working on AWS cloud-based batch and streaming data pipelines.
- Strong proficiency in AWS cloud services, including Kinesis, S3, Lake Formation, Glue, and Step Functions.
- In-depth knowledge of SQL databases, such as Aurora and SQL Server, and data lakes in S3, as well as enterprise data in Redshift/Snowflake.
- Hands-on experience with ETL tools, data transformation, and data integration techniques.
- Familiarity with data governance, data privacy, and security best practices in AWS environments.
- Strong problem-solving skills and the ability to troubleshoot complex data pipeline issues.
- Excellent communication and teamwork skills to collaborate effectively with cross
- functional teams.
- AWS certifications, such as AWS Certified Data Analytics - Specialty or AWS Certified Big Data - Specialty, are advantageous.

6 years

  • Data Engineer

    hace 7 días

    Cordoba, Argentina RH Vision A tiempo completo

    Data Engineer Responsibilities: - Build systems and datasets using software engineering best practices, data management fundamentals, data storage principles, recent advances in distributed systems, and operational excellence best practices. - Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety...

  • Senior Data Engineer

    hace 15 horas

    Cordoba, Argentina Social Native A tiempo completo

    Described as the "Uber of Content", Social Native is a marketplace technology company that empowers marketers to create, source and optimize authentic visual content in the most efficient way possible. Leveraging the world's first AI-powered creative platform, brands such as Unilever, Adidas, L'Oréal, Crocs and Nestlé Waters partner with Social Native to...

  • Data Engineer

    hace 1 semana

    Cordoba, Argentina Vates A tiempo completo

    Descripción **Be part of the Top 10% IT talent with the best salary.** **We are looking for a Data Engineer (Ref. 1243) to join our team!** We are a team passionate for technology, innovation and research. At Vates we are excited to offer world-class custom software development services. We have 30 years of experience providing IT services and solutions...

  • Sr. Data DevOps Engineer

    hace 2 semanas

    Cordoba, Argentina Proofpoint A tiempo completo

    It's fun to work in a company where people truly BELIEVE in what they're doing! - We're committed to bringing passion and customer focus to the business._ - Company Overview - At Proofpoint, we have a passion for protecting people, data, and brands from today’s advanced threats and compliance risks. We hire the best people in the business to: - Build and...

  • Integration/data Engineer para Empresa

    hace 3 días

    Cordoba, Argentina RH Vision A tiempo completo

    Estamos buscando para un cliente de Estados Unidos del rubro salud, que incluye plataformas de bienestar, coaching orientado a salud entre otros, un data Integrations/Data engineer. **Responsabilidades** - Rendimiento optimizado, implementando SDK y manteniendo los estándares de arquitectura de datos en todas las bases de datos comerciales. - Diseño y...

  • Data Analyst

    hace 7 días

    Cordoba, Argentina RH Vision A tiempo completo

    Data Engineer Qualifications: - At least 3 years experience with Tableau Data Prep - Experience with relational SQL and NoSQL databases (e.g. Postgres, MongoDB) - Experience with Panoply - Experience with PHP

  • Sr Data Engineer

    hace 2 semanas

    Cordoba, Argentina Vates A tiempo completo

    DESCRIPCIÓN Me contacto con vos ya que nos encontramos en la búsqueda de un **SR Data Engineer (Ref 628)** para unirse a nuestro equipo de trabajo para trabajar con nuestro cliente Claro. Somos un equipo apasionado por la tecnología, la innovación y la investigación. En Vates nos entusiasma ofrecer servicios de desarrollo de software a medida de...

  • Data Engineer con Dominio de SQL + Ssrs + BI para

    hace 1 semana

    Cordoba, Argentina RH Vision A tiempo completo

    En RH VISIÓN estamos buscadno sumar al equipo de un cliente internacional un perfil de data engineer, requiere inglés ya que será el idioma utilizado en su diaria laboral. Es necesario contar con conocimientos avanzados en BBDD y sql. Debe tener dominio de reportería en Microsoft SQL reporting. Es necesario que comprenda el uso de OLTP y...

  • Data Engineer para Cliente Internacional C/ Dominio

    hace 15 horas

    Cordoba, Argentina RH Vision A tiempo completo

    Estamos buscando un Data Engineer para un cliente de Estados Unidos donde entre su tarea principal estará el trabajo con los datos de una empresa relacionada a Merge y Acquisitions para un cliente de Estados Unidos. Deberá llevar adelante la responsabilidad de realizar métricas de informes, análisis de metodologías. Adicionalmente entre sus tareas...

  • [data Team] Data Engineer + Snowflake

    hace 1 semana

    Cordoba, Argentina RH Vision A tiempo completo

    Roles And Responsibilities Design, construct, and implement highly scalable database tables in Snowflake Data Warehouse to support data analytics and business intelligence. - Translate business requirements into data models that are easy to understand and used by different disciplines across the company. - Work closely with the data science and analytics...