Senior Data Engineer

Encontrado en: beBee jobs AR - hace 1 semana

LATAM, Argentina IT Scout A tiempo completo

Open position only for people residing in Costa Rica, México, Argentina, and Brazil.


Our client builds smart technology solutions through the combination of artificial intelligence, mobile, and web development for companies in the United States, Canada & Latam. It ́s a technology company headquartered in Costa Rica. With operations throughout LATAM. Their core focus is building intelligent tech solutions to help our customers be more efficient in optimizing internal digital processes.About the job Senior Data Engineer (PySpark)

Senior Data Engineer

We are seeking a skilled Data Engineer with expertise in Python, PySpark, and Apache Airflow. This role requires proficiency in AWS services such as Redshift and Databricks, as well as strong SQL skills for data manipulation and querying.

Responsibilities:

Design, develop, and maintain scalable data pipelines and workflows using Python and PySpark.Implement and optimize ETL processes within Apache Airflow for data ingestion, transformation, and loading.Utilize AWS services such as Redshift and Databricks for data storage, processing, and analysis.Write efficient SQL queries and optimize database performance for large-scale datasets.Implement version control and continuous integration using GitLab CI for maintaining codebase integrity.Follow Test-Driven Development (TDD) practices to ensure code reliability and maintainability.
Requirements:

Bachelor's degree in Computer Science, Engineering, or a related field.4 to 7 years of professional experience in data engineering or a related role.Proficiency in Python and PySpark for building data pipelines and processing large datasets.Hands-on experience with Apache Airflow for orchestrating complex workflows and scheduling tasks.Strong knowledge of AWS services, including Redshift and Databricks, for data storage and processing.Advanced SQL skills for data manipulation, querying, and optimization.Experience with version control systems like GitLab CI for managing codebase changes.Familiarity with Test-Driven Development (TDD) practices and writing unit tests for data pipelines.Excellent problem-solving skills and attention to detail.Strong communication and collaboration skills to work effectively within a team environment.Certification in AWS or related technologies is preferred but not required.
**English: B2+ proficiency required.

  • Senior Data Engineer

    Encontrado en: beBee jobs AR - hace 1 semana

    LATAM, Argentina IT Scout A tiempo completo

    Only available for #residents of #Latinamerica Our client builds smart technology solutions through the combination of artificial intelligence, mobile, and web development for companies in the United States, Canada & Latam. It ́s a technology company headquartered in Costa Rica. With operations throughout LATAM. Their core focus is building intelligent...

  • Senior Site Reliability Engineer

    Encontrado en: beBee jobs AR - hace 1 semana

    LATAM, Argentina IT Scout A tiempo completo

    Only available for #residents of #Latinamerica Our client builds smart technology solutions through the combination of artificial intelligence, mobile, and web development for companies in the United States, Canada & Latam. It ́s a technology company headquartered in Costa Rica. With operations throughout LATAM. Their core focus is building intelligent...

  • QA Automation Engineer

    Encontrado en: beBee S AR - hace 3 semanas

    LATAM, Argentina IT Scout A tiempo completo

    ⚠️Only available for #residents of #Latinamerica⚠️ Our client builds smart technology solutions through the combination of artificial intelligence, mobile, and web development for companies in the United States, Canada & Latam. It´s a technology company headquartered in...

  • QA Automation Engineer

    Encontrado en: beBee S AR - hace 3 semanas

    LATAM, Argentina IT Scout A tiempo completo

    ⚠️Only available for #residents of #Latinamerica⚠️ Our client builds smart technology solutions through the combination of artificial intelligence, mobile, and web development for companies in the United States, Canada & Latam. It´s a technology company headquartered in...

  • Senior Cloud .Net Software Engineer

    Encontrado en: beBee jobs AR - hace 1 semana

    LATAM, Argentina IT Scout A tiempo completo

    Only available for #residents of #Latinamerica Our client builds smart technology solutions through the combination of artificial intelligence, mobile, and web development for companies in the United States, Canada & Latam. It ́s a technology company headquartered in Costa Rica. With operations throughout LATAM. Their core focus is building intelligent...

  • QA Automation Engineer

    Encontrado en: beBee jobs AR - hace 1 semana

    LATAM, Argentina IT Scout A tiempo completo

    Only available for #residents of #LatinamericaOur client builds smart technology solutions through the combination of artificial intelligence, mobile, and web development for companies in the United States, Canada & Latam. It ́s a technology company headquartered in Costa Rica. With operations throughout LATAM. Their core focus is building intelligent tech...

  • Embedded Escalation Engineer

    Encontrado en: beBee jobs AR - hace 1 semana

    LATAM, Argentina IT Scout A tiempo completo

    Only available for #residents of #Latinamerica Our client builds smart technology solutions through the combination of artificial intelligence, mobile, and web development for companies in the United States, Canada & Latam. It ́s a technology company headquartered in Costa Rica. With operations throughout LATAM. Their core focus is building intelligent...

  • Embedded Escalation Engineer

    Encontrado en: beBee jobs AR - hace 1 semana

    LATAM, Argentina IT Scout A tiempo completo

    Only available for #residents of #Latinamerica Our client builds smart technology solutions through the combination of artificial intelligence, mobile, and web development for companies in the United States, Canada & Latam. It ́s a technology company headquartered in Costa Rica. With operations throughout LATAM. Their core focus is building intelligent...

  • Embedded Escalation Engineer

    Encontrado en: beBee jobs AR - hace 1 semana

    LATAM, Argentina IT Scout A tiempo completo

    Only available for #residents of #Latinamerica Our client builds smart technology solutions through the combination of artificial intelligence, mobile, and web development for companies in the United States, Canada & Latam. It ́s a technology company headquartered in Costa Rica. With operations throughout LATAM. Their core focus is building intelligent...

  • Embedded Escalation Engineer

    Encontrado en: beBee jobs AR - hace 1 semana

    LATAM, Argentina IT Scout A tiempo completo

    Only available for #residents of #Latinamerica Our client builds smart technology solutions through the combination of artificial intelligence, mobile, and web development for companies in the United States, Canada & Latam. It ́s a technology company headquartered in Costa Rica. With operations throughout LATAM. Their core focus is building intelligent...