Senior Software Engineer with Data Skills

**Join Our Team as a Senior Software Engineer with Data Skills and Shape the Future of Data Engineering**

Are you a seasoned Senior Software Engineer** **with a passion for harnessing the power of data to drive business insights and innovation? Do you thrive on solving complex data challenges and love working with cutting-edge technologies like Azure Databricks? If so, we have an exciting opportunity for you

We're looking for a dynamic and experienced Senior Software Engineer with Data Skills to join our growing team. This is a leadership role where you will have the chance to shape the data landscape, influence best practices, and make a significant impact on our data-driven culture. If you're ready to take your career to the next level, keep reading

**What You'll Do**:

- **Architect and Implement Data Solutions**: Lead the design, development, and deployment of scalable data pipelines using Azure Databricks. You'll work closely with our data science and analytics teams to ensure we deliver high-quality, performant data solutions.
- **Optimize** Data Workflows**: Use your expertise to optimize our ETL processes, data storage, and compute resources. You'll be instrumental in ensuring our data platform is reliable, scalable, and efficient.
- **Drive Data Quality and Governance**: Implement robust data quality and governance frameworks. You'll ensure that our data is clean, reliable, and accessible, enabling the organization to make data-driven decisions confidently.
- **Collaborate Across Teams**: Partner with other engineers, analysts, and stakeholders to understand their data needs. You'll provide insights and build solutions that empower them to achieve their goals.
- **Mentor and Lead**: Serve as a mentor and technical leader to other members of the data engineering team. You'll share your knowledge, best practices, and foster a culture of continuous learning and improvement.
- **Leverage Cutting-Edge Technologies**: Utilize tools like Apache Airflow for orchestration, DBT for data transformations, and integrate with platforms like Python, Azure Cognitive Search, and OpenAI. You'll stay ahead of the curve, always exploring new ways to improve our data ecosystem.

**What We're Looking For**:

- **Extensive Experience in Azure Databricks**: You have deep expertise in Azure Databricks, including experience with Delta Lake, Spark, and MLflow. You know how to leverage Databricks to process large volumes of data and support advanced analytics and machine learning workloads.
- **Proficiency** in Python**: Strong Python programming skills for building data pipelines, writing custom transformations, and integrating with various APIs and data sources.
- **Expertise** with Airflow**: Experience using Apache Airflow to orchestrate complex data workflows. You understand DAGs, task dependencies, and scheduling, ensuring data pipelines run smoothly and efficiently.
- **Solid Understanding of DBT**: You have experience using DBT for transforming data in a data warehouse environment. You know how to model data, create reusable transformations, and maintain version control with Git.
- **Familiarity with Azure Services**: Hands-on experience with other Azure data services like Azure Data Lake, Azure SQL Database, and Azure Cognitive Search. You know how to build end-to-end data solutions within the Azure ecosystem.
- **Strong Problem-Solving Skills**: You're a natural problem-solver who loves tackling complex data challenges. You have a keen eye for detail and a knack for finding innovative solutions.
- **Excellent Communication and Collaboration**: You're a team player who can communicate technical concepts to non-technical stakeholders. You work well with others and thrive in a collaborative environment.
- **Certifications are a Plus**: Having any of the following certifications is highly desirable:

- Databricks Certified Data Engineer Associate
- Microsoft Certified: Azure Data Engineer Associate
- Microsoft Certified: Azure AI Engineer Associate
- **Data Engineering Best Practices**: Demonstrable understanding of best practices in data engineering, including data modeling, ETL/ELT processes, and data warehousing.
- **Data Security and Compliance**: Strong grasp of data security protocols and compliance standards, ensuring data governance and privacy.
- **Scalable Data Solutions**: Experience designing and implementing scalable data solutions, optimizing performance, and managing large-scale data processing using Azure and Databricks.
- **Machine Learning and AI**: Knowledge of implementing and integrating machine learning models and AI services within data pipelines, leveraging Azure ML and Databricks MLflow.
- **Advanced Analytics**: Skills in deploying advanced analytics solutions using Azure Synapse Analytics, Azure Databricks, and integrating with other Azure services.

**Why You'll Love Working Here**:

- **Innovative Environment**: Be part of a forward-thinking company that values innovation and encourage