AI models evaluated against FrontierMath include Anthropic's Claude 3.5.
Sources
- New secret math benchmark stumps AI models and PhDs alike (arstechnica.com)
- https://epoch.ai/frontiermath/tiers-1-4/the-benchmark (epoch.ai)
- https://arxiv.org/pdf/2411.04872 (arxiv.org)
More in Technology
- FCC measurements reported that even in major urban areas, only about 30% of allocated radio spectrum was being used at any one time.
- A 100-kilowatt lunar nuclear reactor targeted by NASA is described as 10,000 times less powerful than a typical nuclear power plant.
- Ramayah, Roy, Arokiasamy, Zbib, and Ahmed's 2007 article 'Critical success factors for successful implementation of enterprise resource planning systems in manufacturing organisations' was published in the International Journal of Business Information Systems, volume 2, issue 3, pages 276–297, with online publication on January 1, 2007 (DOI: 10.1504/IJBIS.2007.011980).
- A study comparing SBLD configurations (using minimum, median, and maximum available data) to textual search used Wilcoxon signed-rank tests and the Vargha–Delaney measure of stochastic superiority.
- A 1969 photograph shows Margaret Hamilton standing next to a stack of program listings from the Apollo Guidance Computer.
- Google researchers labeled gender categories in their smile-detection model as 'Gender 1' and 'Gender 2' specifically to reduce the risk of introducing unconscious societal bias.