load_evaluators#

langchain.evaluation.loading.load_evaluators(
evaluators: Sequence[EvaluatorType],
*,
llm: BaseLanguageModel | None = None,
config: dict | None = None,
**kwargs: Any,
) → list[Chain | StringEvaluator][source]#

Load evaluators specified by a list of evaluator types.

Parameters:

  • evaluators (Sequence[EvaluatorType]) – The list of evaluator types to load.

  • llm (BaseLanguageModel, optional) – The language model to use for evaluation, if none is provided, a default ChatOpenAI gpt-4 model will be used.

  • config (dict, optional) – A dictionary mapping evaluator types to additional keyword arguments, by default None

  • **kwargs (Any) – Additional keyword arguments to pass to all evaluators.

  • Returns

  • -------

  • List[Chain] – The loaded evaluators.

  • Examples

  • --------

  • load_evaluators (>>> from langchain.evaluation import)

  • EvaluatorType

  • [EvaluatorType.QA (>>> evaluators =)

  • EvaluatorType.CRITERIA]

  • load_evaluators(evaluators (>>> loaded_evaluators =)

  • criteria="helpfulness")

Return type:

list[Chain | StringEvaluator]

On this page