Software Engineer - Machine Learning Infrastructure

Twitch

Full time

San Francisco, CA, USA

Apr 1

About the Role

Twitch is building the future of interactive entertainment, and the Central Science team at Twitch is invested in giving our experts the scientific tools and data they need to make decisions that help us build the best future, faster. As a software development engineer on the Central Science team, your work will directly impact Twitch's ability to respond to threats, grow an ecosystem of creators, invest resources where they matter most, and connect visitors to the content they love. You will be responsible for leveling up the capabilities and influence of our scientists by empowering them to build reliable, scalable machine learning systems and tools that are used by decision-makers in cross-functional teams throughout Twitch.

You will lead the designing, building, and maintenance of pipelines that convert raw data into refined scientific outputs while working collaboratively with science staff to scope new solutions to problems and identify opportunities to improve existing ones. We are looking for someone who is eager to partner with non-engineers on scientific projects, to engage in reciprocal mentorship with teammates possessing varied strengths and areas of expertise, to build tools that are used by leaders throughout the company to aid their decision-making, and to bring an emphasis on engineering operational excellence to our science team.

You Will:

  • Oversee the engineering roadmap for the Central Science team
  • Design, build, and maintain performant machine-learning data pipelines
  • Develop new capabilities within our data and machine-learning pipelines
  • Improve the reliability and scalability of our existing tools
  • Partner with science staff to understand data and tooling needs
  • Embrace and champion engineering best practices within your team and throughout Twitch
  • Mentor and guide science staff to develop their technical talents and help them with their growth

You Have:

  • Experience with data ETL, optimizing ML workflows, and maintaining data pipelines
  • Evidence of proficiency in creating flexible data solutions without over-engineering
  • Desire and ability to write testable, high-quality, and well documented code
  • Passion for operational excellence and process improvement

Bonus Points

  • We encourage candidates to apply who have held the responsibilities above, regardless of years of experience or educational credentials. But we roughly expect candidates to have:
  • MS in CS or a related field
  • 3+ years of industry experience as a software development engineer or in a related role, preferably in the consumer internet or gaming space, or working with a high-velocity, high-growth product / business
  • Experience building and maintaining end-to-end machine-learning pipelines
  • Experience with a data orchestration framework such as Airflow, AWS Step Functions.
  • Experience working with Amazon Web Services (e.g., S3, Redshift, or Step Functions)
  • Proficiency in SQL or working with relational databases
  • Fluency in statistical analysis and programming using Python, R, or similar tools
  • Familiarity with Twitch, our creators, and our community


Apply for this position

Apply

Your application has been successfully submitted.

Please fix the errors below and resubmit.

Something went wrong. Please try again later or contact us.

Personal Information

Profile

Details

Twitch

We are Twitch: a global community of millions who come together each day to create their own entertainment.

Apply for this position