Data Engineer Python
hace 2 semanas
**What you will do**
- Design, develop, and maintain ETL pipelines to extract, transform, and load data across various data sources (cloud storage, databases, APIs);
- Use Apache Airflow for orchestrating workflows, scheduling tasks, and managing pipeline dependencies;
- Build and manage data pipelines on Azure and GCP clouds;
- Design and support Data Lake;
- Write Python scripts for data cleansing, transformation, and enrichment using libraries like Pandas, PySpark;
- Analyze logs and metrics from Airflow and cloud services to resolve pipeline failures or inefficiencies.
**Must haves**
- **2+ years** of experience writing efficient and scalable **Python** code, especially for data manipulation and **ETL tasks** (using libraries like **Pandas, PySpark, Dask, etc.**);
- Knowledge of **Apache Airflow** for orchestrating ETL workflows, managing task dependencies, scheduling, and error handling;
- Experience in building, optimizing, and maintaining **ETL pipelines** for large datasets, focusing on data extraction, transformation, and loading;
- Familiarity with cloud-native storage solutions;
- Understanding and working experience with different file formats;
- Expertise in writing efficient **SQL queries** for data extraction, transformation, and analysis;
- Familiarity with complex **SQL operations** (joins, aggregations, window functions, etc.);
- Familiarity with **IAM** (Identity and Access Management), data encryption, and securing cloud resources and data storage on both **Azure**, **GCP**;
- Upper-intermediate English level.
**Nice to haves**
- Use some Java libraries to request data from APIs;
- Knowledge of data governance practices, and the implementation of data lineage and metadata management in cloud environments.
-
Data Engineer
hace 7 días
Buenos Aires, Argentina Techunting A tiempo completoDescription We are seeking a highly motivated Data Engineer to join our growing team. In this role, you will play a critical part in designing, developing, and maintaining our data infrastructure on the Azure Cloud platform. You will leverage your expertise in PySpark and Python to build efficient and scalable data pipelines that ingest, transform, and load...
-
Data Engineer
hace 2 semanas
Buenos Aires, Argentina Equifax A tiempo completoComo Data Engineer, estarás a cargo del diseño y procesamiento de grandes volúmenes de datos. **¿Qué vas a hacer?-**: - Evaluar, gestionar y resolver incidentes. - Realizar cálculos en lineal utilizando Python. - Ejecución de pruebas. **¿Qué experiência necesitas?.**: - +2 años de experiência desarrollando en Python. - Capacidad analítica. -...
-
Senior Data Engineer
hace 5 días
Buenos Aires, Argentina AgileEngine A tiempo completoID: 14686 **What you will do** - Design and implement data pipelines using DBT for transformation and modeling; - Manage and optimize data warehouse solutions on Snowflake; - Develop and maintain ETL processes using Fivetran for data ingestion; - Utilize Terraform for infrastructure as code (IaC) to provision and manage resources in AWS, Snowflake,...
-
Data Engineer
hace 5 días
Buenos Aires, Argentina DAR Analytics A tiempo completoDAR ANALYTICS Argentina Remote Full-time at DAR Analytics LLC At DAR Analytics LLC, we're at the forefront of data-driven solutions, helping businesses harness the true potential of their data assets. With a blend of global perspectives and cutting-edge technologies, we're redefining the landscape of data solutions, one project at a time. About The...
-
Data Engineer con Azure
hace 1 semana
Buenos Aires, Argentina NTT DATA A tiempo completoNTT Data somos todas las personas que la formamos. Un equipo de más de 140.000 profesionales, tan diverso cómo diversos son los 50 países en los que estamos presentes y los diferentes sectores en los que desarrollamos nuestra actividad; telecomunicaciones, entidades financieras, industria, utilities, energía, administración pública y...
-
Sr Data Engineer
hace 2 semanas
Buenos Aires, Argentina MindIT HR Agency A tiempo completoWe are looking for Sr Data Engineer. **Place of work**: Remote from LatAm. **Contract Type**: Contractor - Long-term. Full time **Selection process**: 1) Technical Interview (60 min) 2) HR Interview (30') 3) Technical Interview with client (60 min) Our client is a software company that provides services to many industries, including financial services,...
-
Python SQL Engineer
hace 5 días
Buenos Aires, Argentina Perform A tiempo completoWe're in search of a talented **Python SQL Engineer** to join our team, focusing on developing efficient data solutions and ensuring seamless integration with our systems. If you have a passion for coding, data management, and thrive in an innovative environment, we encourage you to apply. **Roles and Responsibilities**: - Develop, test, and deploy...
-
Senior Data Engineer
hace 2 semanas
Buenos Aires, Argentina HR Oasis A tiempo completoWe are actively seeking a seasoned Senior Data Engineer with over 5 years of experience, specializing in the development of Data Pipelines with a specific focus on ETL. Proficiency in Python is a prerequisite, and a background in Machine Learning infrastructure is highly desirable. Experience with AWS is also a required skill. **Responsibilities**: Design,...
-
Data Engineer Iii
hace 1 semana
Buenos Aires, Argentina JPMorganChase A tiempo completoJoin us as we embark on a journey of collaboration and innovation, where your unique skills and talents will be valued and celebrated. Together we will create a brighter future and make a meaningful difference. As a Data Engineer III at JPMorgan Chase, you are an integral part of an agile team that works to enhance, build, and deliver data collection,...
-
Data Engineer
hace 2 semanas
Buenos Aires, Argentina Perform A tiempo completoWe are seeking a skilled and motivated Data Engineer to join our Business Technology team. The team is responsible for driving business data analytics and ensuring robust data engineering practices. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining scalable data pipelines and infrastructure. **Required Skills**: -...