active · Approximate location
Machine Learning Engineer - Vision Foundation Models
full timeFoster City, CA
Create a free profile to personalize salary, commute and role fit.
AT A GLANCE
Technology3+ years experienceFull Time
Required
- 3+ years experience
The Perception team at Zoox is responsible for how our purpose-built robotaxi understands the world, including what happens inside the cabin. In this role, you will design, train, and evaluate vision-based in-cabin perception models that understand passengers, objects, and behavi
About the role
The Perception team at Zoox is responsible for how our purpose-built robotaxi understands the world, including what happens inside the cabin. In this role, you will design, train, and evaluate vision-based in-cabin perception models that understand passengers, objects, and behaviors inside the vehicle. These models support rider safety and the operations that keep each ride running smoothly.
You will independently own a model area end to end, from data curation and training through evaluation and deployment under real-time and compute constraints, working closely with partners across the company. Your work has a direct impact on rider safety and experience as Zoox scales its robotaxi service.
Requirements
- MS or PhD in Computer Science, Machine Learning, Computer Vision, or a related field with 6+ years of industry experience (PhD with 3+ years).
- Deep expertise in computer vision and deep learning for image and video understanding: object detection, pose and action recognition, and fine-grained classification, with hands-on experience with modern architectures (convolutional and vision-transformer detectors, and self-supervised or foundation-model backbones such as DINOv3).
- Strong proficiency in Python and PyTorch for model design, training, and evaluation.
- Experience with vision-language models or foundation-model backbones, and with auto-labeling or synthetic data for long-tail and rare classes.
- Track record of owning the full ML lifecycle on real-world data: dataset curation and labeling guidelines, training, metric design (precision, recall, and false-positive rate at an operating point), and error analysis.
- Experience with in-cabin or occupant monitoring (occupant or driver monitoring systems), ideally including multi-camera or fisheye imagery and low-light conditions.
- Experience deploying deep learning models to real-time, resource-constrained systems (robotics, automotive, or edge devices) with TensorRT / ONNX or similar.
- Proficiency in C++ for model integration.
Benefits
- Vision
Other Jobs From This Employer
Administrative Business Partner, ProductFoster City, CA
Salary not listedContract Student Worker - Freeways Data Evaluation (20 hrs/wk)Foster City, CA
Salary not listedContract Student Worker Automation & Behavioral Science EngineerFoster City, CA
Salary not listedCrash Safety Test and Validation EngineerFoster City, CA
Salary not listedEmbedded Software Engineer - Drive SystemsFoster City, CA
Salary not listed