Fine-tuning Open Source LLMs with Mistral
Andrea, a Computing Engineer at CERN, and Josep, a Data Scientist at the Catalan Tourist Board, will walk you through the steps needed to customize the open-source Mistral LLM.
Josep Ferrer, Andrea Valenzuela
無料アカウントを作成する
練習とトラックであなたの進捗を記録しましょう。
Googleで登録続行すると、次に同意したものとみなされます: 利用規約、 プライバシーポリシー 、およびデータが米国内に保管されることに同意したものとみなされます。関連

チュートリアル
Mistral 7B Tutorial: A Step-by-Step Guide to Using and Fine-Tuning Mistral 7B
The tutorial covers accessing, quantizing, fine-tuning, merging, and saving this powerful 7.3 billion parameter open-source language model.
チュートリアル
Fine-Tuning Llama 2 on Consumer Hardware: A Complete QLoRA Tutorial
Learn how to fine-tune Llama 2 on a free Google Colab GPU using QLoRA, PEFT, and the Hugging Face ecosystem to customize open-source LLMs for your use case.
チュートリアル
Codestral API Tutorial: Getting Started With Mistral’s API
To connect to the Codestral API, obtain your API key from Mistral AI and send authorized HTTP requests to the appropriate endpoint (either codestral.mistral.ai or api.mistral.ai).
While cutting-edge large language models can write almost any text you like, they are expensive to run. You can get the same performance for less money by using a smaller model and fine-tuning it to your needs.
In this session, Andrea, a Computing Engineer at CERN, and Josep, a Data Scientist at the Catalan Tourist Board, will walk you through the steps needed to customize the open-source Mistral LLM. You'll learn about choosing a suitable LLM, getting training data, tokenization, evaluating model performance, and best practices for fine-tuning.
Key Takeaways:
Resources (including links to notebooks)