Data Engineer

hace 4 días

Mendoza, Argentina Techunting A tiempo completo

Description
- Design, build, and optimize scalable ETL pipelines using Apache Spark on Amazon EMR.
- Work closely with data scientists, analysts, and other engineering teams to define, implement, and maintain high-performance data infrastructure.
- Develop and maintain automated data workflows and processes for efficient data ingestion, transformation, and loading.
- Implement best practices for data engineering, including monitoring, logging, and alerting for data pipelines.
- Collaborate with stakeholders to understand business requirements and translate them into technical solutions.
- Optimize performance of data processing jobs and troubleshoot issues with large-scale distributed systems.
- Drive innovation in data infrastructure, evaluating and integrating new tools, frameworks, and approaches.

**Requirements**:
**Qualifications**:

- 5+ years of experience in data engineering, with at least 3+ years working with Apache Spark and Amazon EMR.
- Strong programming skills in Python and Scala with a focus on performance tuning and optimization for Spark jobs.
- Deep understanding of distributed computing concepts, data partitioning, and resource management in large-scale data processing systems.
- Proficiency in building and maintaining ETL pipelines for structured and unstructured data.
- Hands-on experience with AWS services such as S3, Lambda, EMR, Glue, and RDS.
- Strong problem-solving skills and ability to debug complex systems. Preferred Qualifications:

- Experience with DevOps practices, including CI/CD, infrastructure as code (e.g., Terraform, CloudFormation), and containerization (e.g., Docker).
- Experience with Kubernetes and container orchestration for Spark jobs.
- Familiarity with streaming data processing using tools like Kafka, Kinesis, or Flink.
- Experience with modern data lake architectures, including Delta Lake or Iceberg.
- AWS Certification (e.g., AWS Certified Big Data - Specialty, AWS Certified Solutions Architect) is a plus

5 years

  • Senior Data Engineer

    hace 2 semanas

    Mendoza, Argentina Wakapi A tiempo completo

    **The Role**: We are looking for a Senior Data Engineer to join our "BF" team. You will use various methods to transform raw data into useful information. For example, you’ll create algorithms and conduct statistical analysis. Overall, you’ll strive for efficiency by aligning data with business goals. **Responsibilities**: - Analyze and organize raw data...

  • Sr Data Engineer

    hace 1 semana

    Mendoza, Argentina Wakapi Software A tiempo completo

    The Role We are looking for a highly skilled Senior Data Engineer with a strong background in TypeScript, data architecture, and large-scale data engineering. This role involves designing and building robust data pipelines, developing efficient data structures, and collaborating closely with global teams to deliver high-quality, reliable data solutions. You...

  • Remote Senior Data Engineer

    hace 1 día

    Ciudad de Mendoza, Argentina Wakapi A tiempo completo

    A data solutions company is seeking a skilled Senior Data Engineer to design and build data pipelines and optimize data scraping systems. The ideal candidate has over 5 years of experience in data engineering and a strong proficiency in TypeScript development. This role offers the flexibility of remote work for Egyptian applicants and a hybrid model for...

  • Sr Data Engineer

    hace 6 días

    Greater Mendoza, Argentina Wakapi A tiempo completo

    The RoleWe are looking for a highly skilled Senior Data Engineer with a strong background in TypeScript, data architecture, and large-scale data engineering. This role involves designing and building robust data pipelines, developing efficient data structures, and collaborating closely with global teams to deliver high-quality, reliable data solutions. You...

  • Senior Data Engineer

    hace 4 semanas

    Ciudad de Mendoza, Argentina jobr.pro A tiempo completo

    A prominent software development firm is seeking a Senior Software Engineer specializing in Data Engineering to design and develop innovative trade surveillance technology. You will be responsible for scaling data pipelines and developing microservices, significantly impacting market integrity. This role promises professional growth, flextime options, and...

  • Sr Data Engineer

    hace 1 semana

    Ciudad de Mendoza, Argentina Wakapi Software A tiempo completo

    The Role We are looking for a highly skilled Senior Data Engineer with a strong background in TypeScript, data architecture, and large-scale data engineering. This role involves designing and building robust data pipelines, developing efficient data structures, and collaborating closely with global teams to deliver high-quality, reliable data solutions. You...

  • Sr Data Engineer

    hace 1 día

    Ciudad de Mendoza, Argentina Wakapi A tiempo completo

    The Role We are looking for a highly skilled Senior Data Engineer with a strong background in TypeScript, data architecture, and large‑scale data engineering. This role involves designing and building robust data pipelines, developing efficient data structures, and collaborating closely with global teams to deliver high‑quality, reliable data solutions....

  • Senior Data Engineer: TypeScript Pipelines

    hace 4 semanas

    Ciudad de Mendoza, Argentina Wakapi Software A tiempo completo

    A growing software company is seeking a highly skilled Senior Data Engineer skilled in TypeScript and data architecture. This remote position entails designing robust data pipelines, developing data structures, and collaborating with global teams. The ideal candidate should have over 5 years of experience, proficiency in data scraping, and excellent...

  • Data Engineer Ssr

    hace 2 semanas

    Mendoza, Argentina Mindtech A tiempo completo

    Habilidades Técnicas: - Bases de datos: SQL Server, PostgreSQL, MySQL, NoSQL (MongoDB, Cassandra). - Cloud: Azure (Databricks, Data Factory, Synapse Analytics), AWS (EMR, Glue), GCP (Dataproc). - Lenguajes: Python, SQL, Scala, Java. - Herramientas: ETL (Talend, Informatica), BI (Power BI, Tableau), Orquestación (Airflow, Luigi). - Conceptos: ETL, ELT,...

  • Databricks Engineer

    hace 3 días

    Mendoza, Argentina Wakapi A tiempo completo

    **The Role**: We are seeking a Data-bricks Software Engineer to join our "AD" team who will be responsible for developing and testing back-end and front-end code to meet customer needs. In a nutshell, you’ll be building and growing in a place where cutting-edge technology is not a myth. **Responsibilities**: - Building and maintaining data pipelines and...