Fine-tuning Open Source LLMs with Mistral
Andrea, a Computing Engineer at CERN, and Josep, a Data Scientist at the Catalan Tourist Board, will walk you through the steps needed to customize the open-source Mistral LLM.
Josep Ferrer, Andrea Valenzuela
Создать бесплатный аккаунт
Практикуйтесь и следите за своим прогрессом.
Продолжить с GoogleПродолжая, вы принимаете нашу Условия использования, наши Политику конфиденциальности и то, что ваши данные хранятся в США.Связанное

Учебное руководство
Mistral 7B Tutorial: A Step-by-Step Guide to Using and Fine-Tuning Mistral 7B
The tutorial covers accessing, quantizing, fine-tuning, merging, and saving this powerful 7.3 billion parameter open-source language model.
Учебное руководство
Fine-Tuning Llama 2 on Consumer Hardware: A Complete QLoRA Tutorial
Learn how to fine-tune Llama 2 on a free Google Colab GPU using QLoRA, PEFT, and the Hugging Face ecosystem to customize open-source LLMs for your use case.
Учебное руководство
Codestral API Tutorial: Getting Started With Mistral’s API
To connect to the Codestral API, obtain your API key from Mistral AI and send authorized HTTP requests to the appropriate endpoint (either codestral.mistral.ai or api.mistral.ai).
While cutting-edge large language models can write almost any text you like, they are expensive to run. You can get the same performance for less money by using a smaller model and fine-tuning it to your needs.
In this session, Andrea, a Computing Engineer at CERN, and Josep, a Data Scientist at the Catalan Tourist Board, will walk you through the steps needed to customize the open-source Mistral LLM. You'll learn about choosing a suitable LLM, getting training data, tokenization, evaluating model performance, and best practices for fine-tuning.
Key Takeaways:
Resources (including links to notebooks)