Fine-tuning Open Source LLMs with Mistral
Andrea, a Computing Engineer at CERN, and Josep, a Data Scientist at the Catalan Tourist Board, will walk you through the steps needed to customize the open-source Mistral LLM.
Josep Ferrer, Andrea Valenzuela
무료 계정 만들기
실습 문제하고 트랙하세요.
Google로 계속하기계속 진행하시면 다음 사항에 동의하는 것으로 간주됩니다: 이용약관 및 개인정보 처리방침 그리고 귀하의 데이터가 미국에 저장된다는 점에 동의하는 것으로 간주됩니다.관련

튜토리얼
Mistral 7B Tutorial: A Step-by-Step Guide to Using and Fine-Tuning Mistral 7B
The tutorial covers accessing, quantizing, fine-tuning, merging, and saving this powerful 7.3 billion parameter open-source language model.
튜토리얼
Fine-Tuning Llama 2 on Consumer Hardware: A Complete QLoRA Tutorial
Learn how to fine-tune Llama 2 on a free Google Colab GPU using QLoRA, PEFT, and the Hugging Face ecosystem to customize open-source LLMs for your use case.
튜토리얼
Codestral API Tutorial: Getting Started With Mistral’s API
To connect to the Codestral API, obtain your API key from Mistral AI and send authorized HTTP requests to the appropriate endpoint (either codestral.mistral.ai or api.mistral.ai).
While cutting-edge large language models can write almost any text you like, they are expensive to run. You can get the same performance for less money by using a smaller model and fine-tuning it to your needs.
In this session, Andrea, a Computing Engineer at CERN, and Josep, a Data Scientist at the Catalan Tourist Board, will walk you through the steps needed to customize the open-source Mistral LLM. You'll learn about choosing a suitable LLM, getting training data, tokenization, evaluating model performance, and best practices for fine-tuning.
Key Takeaways:
Resources (including links to notebooks)