load_evaluators#

langchain.evaluation.loading.load_evaluators(evaluators: Sequence[EvaluatorType], *, llm: BaseLanguageModel | None = None, config: dict | None = None, **kwargs: Any) → List[Chain | StringEvaluator][source]#

Load evaluators specified by a list of evaluator types.

Parameters:

  • evaluators (Sequence[EvaluatorType]) – The list of evaluator types to load.

  • llm (BaseLanguageModel, optional) – The language model to use for evaluation, if none is provided, a default ChatOpenAI gpt-4 model will be used.

  • config (dict, optional) – A dictionary mapping evaluator types to additional keyword arguments, by default None

  • **kwargs (Any) – Additional keyword arguments to pass to all evaluators.

Returns:

The loaded evaluators.

Return type:

List[Chain]

Examples

>>> from langchain.evaluation import load_evaluators, EvaluatorType
>>> evaluators = [EvaluatorType.QA, EvaluatorType.CRITERIA]
>>> loaded_evaluators = load_evaluators(evaluators, criteria="helpfulness")
On this page