Here, we are revolutionizing the cyber security industry, and we want YOU to be part of the change! Our platform has created a new category of enterprise software, which companies worldwide rely on to manage the cyber security posture of their vendors. We are on a mission to create a new language for companies and their partners to communicate, understand, and improve each other’s security posture.
We want you to join us on this mission.
Backed by Sequoia and Google Ventures, we are growing tremendously year over year. As we scale, so does our need for talent - if you are intellectually curious and excited by the idea of contributing to a high-growth startup, we’d love to talk to you.
About the Role
As a Senior Big Data Engineer, you will:
Work on distributed systems that use Spark and EMR to maintain and enhance system functionality, in areas such as large systems monitoring and systems and workload management
Create analytic frameworks and tools that enables other engineers to introduce new analytics both fast and efficiently
Verify component, system integration and application level features and functionality to ensure reliability and performance reaches quality standards
Assist in the development of system performance metrics and technical performance measures used to verify achievements of capability objectives
Improve efficiency, reliability, and scalability of our data pipelines
We prefer this person to work from our NYC headquarters, but will consider remote applicants in other geographic areas.
Apply if the following sounds like you!
10+ years of experience building large scale distributed applications
Familiarity with Scala
8Experience with serialization formats primarily with Avro and columnar formats such as ORC / Parquet
Knowledgable in the Big Data Ecosystem and Frameworks with subject matter expertise in Apache Spark
Experienced in various ETL techniques, data modeling and building data pipelines
Proficient in cloud computing especially AWS or GCE. Experience using EMR & ECS a plus
You are thrilled and excited to help solve our big data challenges!