Big Data Engineer

**Job Overview**:
As a Big Data Engineer, you will collaborate with different SecureAuth software development teams on building Data and machine learning pipelines. You will work in a cross-functional Agile development environment to develop the data driven environment that meets, and exceed SecureAuth’s strategic Enterprise customers’ requirements, and expectations.

You will work closely with the data engineering principle to develop solutions and data processing pipelines to extend the current platform and add additional value to the overall architecture. You will be responsible for building state of the art data solutions that are both secure and cloud native. You will be working in agile with different technologies, including both batch and streaming technology stack.

We don't need you to just code, you must also be able to solve unique and complex problems that have broad impact on the SecureAuth’s business. You should be able to persuade a cross functional group of peers to embrace proposed solutions and allocate resources accordingly. Most importantly you must have the depth of knowledge, experience, and passion to deliver solutions that amaze our customers.

At SecureAuth we look for individuals who are constantly striving for excellence in both their personal and professional lives. Our rapid growth demands high performance, and we’re proud to say that we have a talented and motivated team along for the ride. If you’re looking for a new challenge, or eager to learn new technologies in a fast growing and innovative company, join us. Let’s innovate together.

**Our Stack & Technology**:

- Python, Scala, Java
- Spark, Flink, Elastic search, Hadoop, Kafka
- PostgreSQL, Dynamodb, Redis, DocumentDB
- AWS big data stack

**Job Responsibilities / Expectations**:

- Work with Python, Scala on developing data and machine learning pipelines.
- Develop new services in Python.
- Continuously evolve the modern data stack of SecureAuth.
- Demonstrate consistent innovation and creativity in approach.
- Forecast future internal or external needs and impacts, planning objectives and strategies for the organization. Level of success is determined through achievement of objectives.
- Serve as internal consultant to senior management and external spokesperson for the organization on critical projects and/or matters of company policy and practices.
- Other duties and responsibilities as assigned.

**Job Qualifications**:
**Required**:

- 10+ years of Big Data experience
- Practical experience with a solid background in Data Engineering, Data structures, and Algorithms
- Software development experience in Python and Scala, and at least one other programming language
- Experience with Golang/Javascript is a plus
- Development experience of both back-end services and data pipelines
- Demonstrated knowledge of AWS services, such as Lakeformation, S3, Dynamodb, cloudformation, Opensearch, Lambda, glue and EMR
- Demonstrated knowledge of Linux, Docker, and AWS
- Strong problem solving and verbal and written communication skills
- Knowledge of the software development life cycle

**Nice to Have**:

- DevOps experience
- Data and Machine learning pipelines development for the information security industry
- Experience of working with Kubernetes
- Machine Learning, Clustering, Reinforcement Learning, Distributional Semantics, and Information Retrieval

**Education Level**:
Masters' degree in computer science or related field plus 8 years of professional data experience, or 10+ years of professional data experience.