openfactcheck.evaluator.ResponseEvaluator

class openfactcheck.evaluator.ResponseEvaluator(ofc)

This class is used to evaluate the factuality of a response using the pipeline of solvers.

Parameters:

ofc (OpenFactCheck)

__init__(ofc)

Initialize the ResponseEvaluator object.

Parameters:

ofc (OpenFactCheck)

Methods

__init__(ofc)	Initialize the ResponseEvaluator object.
evaluate(response[, question, callback])	Evaluate the response using the pipeline and return the output
evaluate_streaming(response[, question])	Evaluate the response using the pipeline and stream the output
persist_output(state, idx, solver_name, cont)	Persist the output of the solver
read_output(sample_name)	Read the output file for the given sample
remove_output(sample_name)	Remove the output file for the given sample