Evaluators

ResponseEvaluator

ResponseEvaluator(ofc)

This class is used to evaluate the factuality of a response using the pipeline of solvers.

LLMEvaluator

LLMEvaluator(ofc)

This class is used to evaluate the performance of a Language Model.

CheckerEvaluator

CheckerEvaluator(ofc)

This class is used to evaluate the performance of a FactChecker.