Research Engineer, Reinforcement Learning

Target start date: Immediately. Relocation provided.

Since its founding in 2015, 1X has been at the forefront of developing advanced humanoid robots designed for household use. Our mission is to create an abundant supply of labor via safe, intelligent humanoids. At 1X, you’ll own critical projects, tackle unsolved research problems, deliver great products to customers, and be rewarded based on merit and achievement.

We are looking for a Research Engineer in Reinforcement Learning (RL). In this role, you will teach NEO to learn new capabilities via RL algorithms. This enables our robots to be safe and robust in a variety of conditions.

Tech Stack

• Linux

• Python / C++ / Bazel

• PyTorch

• Isaac Sim / Mujoco
  

Location

The role is based in Palo Alto, CA. Candidates are expected to be in-person at the office.

Responsibilities

• Full-stack engineering, from data engineering to model architecture design to shipping polished products

• Train NEO to do a diverse set of manipulation and locomotion tasks.

• Work with hardware teams to the sim2real gap between policies trained in simulation and real.

• Work with controls, QA, and data collection teams to ship RL policies to the production fleet.

• Deploy skills trained with RL into home environments