Label Studio is an open-source data labeling platform that provides LangChain with flexibility when it comes to labeling data for fine-tuning large language models (LLMs). It also enables the preparation of custom training data and the collection and evaluation of responses through human feedback.
Installation and Setup
See the Label Studio installation guide for installation options.
We need to install the
label-studio-sdk-python Python packages:
pip install label-studio label-studio-sdk
See a usage example.
from langchain.callbacks import LabelStudioCallbackHandler