Even noisy LLM evaluators

Even (very) noisy LLM evaluators are useful for improving AI agents

The sentiment around tools for evaluating noisy language models is mixed, with GitHub activity details being unknown. This absence of definitive metrics could indicate potential opportunities for those who are capable of filling this gap.