TECH - Google's Alphabet And Amazon-Backed Anthropic Lead Effort To Redefine AI Evaluation Standards | Benzinga
Alphabet Inc (NASDAQ:GOOG), (NASDAQ:GOOGL) search arm Google and Amazon.com Inc (NASDAQ:AMZN)-backed Anthropic, a prominent AI startup, has announced a new initiative to fund the development of advanced AI benchmarks. The program aims to address the current inadequacies in AI benchmarking and provide a more comprehensive evaluation of AI models.
What Happened: Anthropic’s new program, revealed on Monday, will allocate funds to third-party organizations capable of creating benchmarks that can effectively evaluate the performance and impact of AI models, including generative models like Anthropic’s own Claude. Interested parties can submit their applications for evaluation on an ongoing basis.
Anthropic’s official blog post stated, “Our investment in these evaluations is intended to elevate the entire field of AI safety, providing valuable tools that benefit the whole ecosystem. Developing high-quality, safety-relevant evaluations remains challenging, and the demand is outpacing the supply.”
The current AI benchmarks are criticized for ...