Senior Software Engineer - Hadoop

New York, NY
Open - Depends on Experience compensation
Start the conversation: This is the recruiter hiring for this position. Start networking here:
Job Description

Sr. Software Engineer: Hadoop


We are looking for experienced Hadoop engineers to join our data infrastructure team.  You should love big data and cluster computing, especially in the context of solving large-scale, real-world problems to make our company more awesome.
 
About the Engineering Team

Our staff believes that code is craft, good software and systems designs are works of art, and that the work we do is part of larger creative culture represented by the hundreds of thousands of inspired makers who make us such a wondrous marketplace. We believe that small, empowered, self-motivated teams can do big things. We also believe in the right tool for the job, not language-as-religion. Our current systems run PHP, Java, Python, Ruby, Solr/Lucene, Postgres, MySQL, and more.

About You

    BS or MS in Computer Science, or equivalent work experience
    Experience or interest in distributed systems
    Experience with large-scale Hadoop clusters
    Experience with Pig and/or Cascading
    Experience with Amazon web services: EC2, S3, and EMR (Elastic Map Reduce)
    Previous success in a performance-critical environment
    Demonstrated open-source contribution is a big plus

About the Position

    Work on the scalability, resilience, and efficiency of backend components, particularly Hadoop
    Debug runtime problems and understand the interactions between systems
    Build systems, libraries, and frameworks within, around, and on top of Hadoop
    Help build and manage a large, rapidly growing, heavily used cluster, and contribute your work to the open source community
    Code using Java, JVM scripting languages, and PHP
    Support both in-house computing systems and EC2 based cloud systems
    Work in a team-oriented environment

Hi, I'm Rick Parzick.

Indicates a required field