Lead Data Engineer Metlife

With more than 150 years in the market and a presence in more than 60 countries, **MetLife** leads the global transformation of the Insurance Industry. They are a collaborative community of more than 50,000 employees worldwide, united by purpose and dedicated to making a difference in the lives of their customers.

**Key Responsibilities**:

- Research, evaluate, document, and maintain standards, best practices, design patterns around usage, testing, security, performance, and various other aspects of existing and emerging ETL technologies on cloud and Big Data.
- Collect, store, process and analyze large datasets to build and implement extract, load (ETL) processes.
- Create frameworks and developer tools, design training materials, conduct developer training. Evangelize new ideas, standards, best practices and solutions with the developer and tech community.
- Develop quality code with thought through performance optimizations in place right at the development stage.
- Appetite to learn new technologies and be ready to work on new cutting-edge cloud technologies.
- Ingesting huge volumes data from various platforms for needs and writing high-performance, reliable, and maintainable ETL code.
- Interact with business analysts and functional analysts in getting the requirements and implementing the ETL solutions.
- Analyze local business needs, local country IT systems, local market needs including locale, data regulatory needs and present proposals that include high level technical solution, estimate and project plan.
- Provide technical support to project teams throughout project lifecycle around technology platforms, solution design, security, debugging, profiling, performance tuning etc.
- Provide governance over project teams to ensure standards and best practices are being followed.

**What are we looking for?**
- Essential business experience and technical skills.
- 8+ years of ETL and data warehousing development experience.
- 3+ plus years of experience designing ETL and data lakes on cloud or big data based platforms.
- Demonstrated experience with designing, implementing, and deploying scalable and performant data hubs at global scale.
- Demonstrated experience in cutting-end database technologies, and cloud services such as Azure, GCP, Azure, Data Bricks or SnowFlake; deep experience in technologies such as Spark(Scala/python/Java), ADLS, Kafka, SQL, Synapse SQL, Cosmos DB, Graph DBs.
- Hands on expertise in implementing analytical data stores in Azure platform using ADLS/Azure data factory /Data Bricks and Cosmos DB (mongo/graph API).
- Strong analytic skills related to working with unstructured datasets
- Strong SQL knowledge and data analysis skills for data anomaly detection and data quality assurance.
- Eagerness to learn new technologies on the fly and ship to production
- Demonstrated experience in Configuration Management, DevOps automation
- Excellent communication skills: demonstrated ability to explain complex technical content to both technical and non-technical audiences.
- Experience working enterprise complex large scale, multi-team, programs in agile development methodologies.
- Experience in Solution Design, Data modelling, performance testing and tuning; ADLS, Synapse SQL database or GCP Big Query and GCS management and Performance tuning - Partitioning / Bucketing.
- Bachelor’s degree in computer science or related field.

**Preferred**:

- Working knowledge of English.
- Experience designing multi-tenant SaaS systems.
- Expertise in Python and experience writing Azure functions using Python/Node.js
- Experience using Event Hub for data integrations.