Aug 6, 03:47 PM

Meta FAIR's Self-Taught Evaluators Boost Llama 3-70B, Surpass GPT-4 in AI Evaluation

Meta, through its FAIR division, has introduced a new AI approach called 'Self-Taught Evaluators' that aims to enhance the evaluation of language models without the need for human annotations. This method utilizes synthetic training data and an iterative self-improvement scheme to train models. The Self-Taught Evaluators have demonstrated superior performance compared to commonly used language model judges like GPT-4, and they match the performance of top reward models trained with labeled examples. The approach involves generating contrasting outputs to train a language model as a judge, producing reasoning traces and final judgments. The model has shown significant improvements, notably boosting the Llama 3-70B model's performance on RewardBench to scores of 88.3 and 88.7 with majority vote, outperforming larger models and human labels.

#Meta #FAIR #GPT #RewardBench

Written with ChatGPT (GPT-4o).

Sources

Additional media

Image #1 for story meta-fair-s-self-taught-evaluators-boost-llama-3-70b-surpass-gpt-4-ai-evaluation

Image #2 for story meta-fair-s-self-taught-evaluators-boost-llama-3-70b-surpass-gpt-4-ai-evaluation

Meta FAIR's Self-Taught Evaluators Boost Llama 3-70B, Surpass GPT-4 in AI Evaluation

Sources

Additional media

Similar Stories