Hugging Face
Remote (Brooklyn, NY, USA, NY, USA)
Here at Hugging Face, we’re on a journey to advance good Machine Learning and make it more accessible. Along the way, we contribute to the development of technology for the better. We have built the fastest-growing, open-source library of pre-trained models in the world. With over 100M+ installs and 65K+ stars on GitHub, over 10 thousand companies are using HF technology in production, including leading AI organizations such as Google, Elastic, Salesforce, Algolia, and Grammarly. About the Role The Accelerate library allows PyTorch users to run their training loop on any kind of distributed setup and regroups multiple methods to accelerate training or inference (mixed precision, torch dynamo…). During your internship, you will integrate a new feature in Accelerate, such as training on TPU pods, FP8 mixed precision, or integrating with torch dynamo. (All of those are examples of features that are currently being added, the exact feature added during the internship will be...