Vision Transformer on SageMaker, part 2: training with Hugging Face

This video is the second in a series of three, where I focus on training a Vision Transformer model with Amazon SageMaker and the Hugging Face Deep Learning Container.

In this video, I start from the image classification dataset that I prepared in the first video (https://youtu.be/jalopOoBL5M). Then, I download a pre-trained Vision Transformer from the Hugging Face hub, and I fine-tune it on my dataset, using a training script based on the Trainer API in the Transformers library.

⭐️⭐️⭐️ Don't forget to subscribe to be notified of future videos ⭐️⭐️⭐️

Code: https://gitlab.com/juliensimon/huggingface-demos/-/tree/main/vision-transformer
Original training code by Philipp Schmid: https://github.com/huggingface/notebooks/blob/master/sagemaker/09_image_classification_vision_transformer/scripts/train.py
More Hugging Face on SageMaker notebooks: https://github.com/huggingface/notebooks/tree/master/sagemaker

New to Transformers? Check out the Hugging Face course at https://huggingface.co/course

machine learningdeep learningdata preparation