Latam-Azure Data Engineer

AgileEngine is a top-ranking provider of software solutions to Fortune 500, Global 500, and Future 50 companies. Listed on Inc. 5000 among the fastest-growing US companies, we are always open to talented software, UX, and data experts in the Americas, Europe, and Asia. If you like a challenging environment where you’re working with the best and are encouraged to learn and experiment daily, there’s no better place — guaranteed :) Senior Data Engineer What you will do Maintain an evergrowing Datalake with a diverse set of data sources and data consumers. Help implement data governance initiative. Maintenance, deprecation, and eventual migration of legacy ETL jobs into a LakeHouse solution. Must haves Airflow experience Worked with Spark/Glue IaC experience; CDK or Terraform Familiar with Datalake/Datawarehouse/Lakehouse Worked with Iceberg/Delta 3+ years of experience with application development Experience with AWS tools Experience with data visualization tools Experience designing, developing, operationalizing, and maintaining complex data applications at an enterprise scale Experience with creating software for retrieving, parsing, and processing structured and unstructured data Experience with building scalable ETL and ELT workflows for reporting and analytics Experience with creating solutions in a collaborative, cross-functional team environment Ability to develop scripts and programs for converting various data types into usable formats, support project team to scale, and monitor and operate data platforms Ability to obtain a security clearance Benefits of joining us Professional growth – Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps. Competitive compensation – We match your ever-growing skills, talent, and contributions with competitive USD-based compensation and budgets for education, fitness, and team activities. A selection of exciting projects – Join projects with modern solutions development and top-tier clients that include Fortune 500 enterprises and leading product brands. Flextime – Tailor your schedule for an optimal work-life balance, by having the options of working from home and going to the office – whatever makes you the happiest and most productive. Work from Home Lead Data Software Engineer 2000 Santa Fe, Santa Fe AgileEngine We are looking forLead Data Software Engineer What you will do Collaborate closely with Data Scientists to understand their data requirements, model development needs, and performance optimization goals. Design, build, and maintain scalable data pipelines and infrastructure to support ML model development and deployment. Collect, process, and prepare large datasets for analysis, feature engineering, and model training. Implement data quality checks, validation, and monitoring to ensure the reliability and accuracy of data used in ML models. Optimize data storage, retrieval, and processing performance for ML workloads. Develop and maintain ETL (Extract, Transform, Load) processes and workflows. Manage data versioning, storage, and access control for ML datasets. Collaborate with DevOps and IT teams to ensure smooth deployment and scaling of ML models in production environments. Stay up-to-date with emerging technologies, tools, and best practices in data engineering and ML infrastructure. Must haves Bachelor’s or Master’s degree in Computer Science, Data Science, or a related field Proven experience as a Data Engineer, preferably in a role supporting Data Scientists Strong proficiency in programming languages such as Python, Java, or Scala Proficiency with data storage and processing technologies, including SQL databases, NoSQL databases, and distributed computing frameworks (e.g., Hadoop, Spark) Experience with data warehousing solutions and data integration tools Experience with data pipeline and workflow management tools: AWS glue, Airflow, etc Knowledge of ML frameworks (e.g., TensorFlow, PyTorch) and ML model deployment Familiarity with cloud platforms (e.g., AWS, Azure, Google Cloud) and containerization (e.g., Docker, Kubernetes) Excellent problem-solving skills and a collaborative mindset Excellent oral and written communication skills with a keen sense of customer service Nice to haves Experience in ad/marketing environment Experience working with Data Lakes Experience with Scala Experience with Glue/EMR/Redshift/Airflow Experience with Terraform Benefits of joining us Professional growth – Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps. Competitive compensation – We match your ever-growing skills, talent, and contributions with competitive USD-based compensation and budgets for education, fitness, and team activities. A selection of exciting projects – Join projects with modern solutions development and top-tier clients that include Fortune 500 enterprises and leading product brands. Flextime – Tailor your schedule for an optimal work-life balance, by having the options of working from home and going to the office – whatever makes you the happiest and most productive. #J-18808-Ljbffr