SAN FRANCISCO – The Air Force Research Laboratory awarded Benchmark Space Systems $4.9 million to develop propulsion systems for ASCENT monopropellant. The two-year award announced Sept. 5 covers ...
CyberGym benchmark scores over time, showing the rapid improvement in AI vulnerability discovery capabilities. Microsoft’s multi-model MDASH system (top right) tops the leaderboard at 88.4%. (CyberGym ...
Auditing AI benchmark contamination prevents inflated performance claims. Removing public test data drops Qwen 2.5 scores to ...
To fix the way we test and measure models, AI is learning tricks from social science. It’s not easy being one of Silicon Valley’s favorite benchmarks. SWE-Bench (pronounced “swee bench”) launched in ...
Mythos has been MDASH’d. A new AI-powered system from Microsoft surpassed a headline-grabbing rival from Anthropic on a leading cybersecurity benchmark, using more than 100 specialized AI agents ...