[david-peterson]

Data Pipeline Engineers - New Relic - Portland, San Francisco or Seattle - Full time, will assist with relocation.

Come join New Relic, where the data pipeline isn't some side-project, but is the foundation of the business.

Our data intake services have gone through several iterations over the years and we are now working on another major revision emphasizing availability and reliability. We're converging on Kafka with front-end and back-end services in Java. But there's still a lot to sort out. A few examples of the hard things we need to figure out are how to efficiently encrypt all our agent traffic, finding a performant and space-efficient alternative to MySQL for storing time-series data, and upgrading our data intake protocols to WebSockets or similar persistent, low-latency connections. Plus lots more.

You can either email me directly, or apply through http://newrelic.com/jobs - the data pipeline jobs on the site are the "distributed systems", "high performance computing", and "analytics" ones.

I will attempt to personally reply to anyone who emails me, but this is our first try on Hacker News, so my apologies in advance if I get overwhelmed.

- David Peterson, VP Data Services [e-mail]