resolve_pairwise_criteria#

langchain.evaluation.comparison.eval_chain.resolve_pairwise_criteria(

criteria: Mapping[str, str] | Criteria | ConstitutionalPrinciple | str | list[Mapping[str, str] | Criteria | ConstitutionalPrinciple] | None,

) → dict[source]#

Resolve the criteria for the pairwise evaluator.

Parameters:

criteria (Mapping[str, str] | Criteria | ConstitutionalPrinciple | str | list[Mapping[str, str] | Criteria | ConstitutionalPrinciple] | None) – The criteria to use.

Returns:

The resolved criteria.

Return type:

dict