DeepNewz, mobile.

People-sourced. AI-powered. Unbiased News.

Screenshot of DeepNewz app showing story detail view.

Screenshot of DeepNewz app showing story list view.

Agentic Evaluations News

Is the "Promethean virus" in Large Language Models real?

Jun 7, 10:50 PMJan 1, 7:59 AM

8.34%chance

8146108

OptionVotes

YES

NO

32243

2599

When will AIs be good at solving complex problems? (read description)

Mar 28, 9:19 AMJan 1, 10:59 PM

138716

OptionProbability

2027

2026

2025

2024

74

59

45

0

What year will the first AI exceed 80% on MLE-bench?

Oct 10, 11:14 PMJan 18, 7:59 AM

397377

OptionProbability

2026

2027

2028

2025

2029

After 2030

2024

2030

70

13

7

6

6

5

4

4

SOAI#3: Open-ended agents make a meaningful scientific discovery end-to-end (hypothesis, expt, iteration, paper).

Oct 9, 11:04 PMOct 10, 11:04 PM

49.32%chance

425307

OptionVotes

YES

NO

1014

986

[Situational awareness] Will pre-2028 LLMs achieve token-output control?

Jul 9, 2:27 AMJan 2, 4:59 AM

47.26%chance

101490

OptionVotes

YES

NO

1056

947

SOAI#1: A major retailer reports >5% of online sales from agentic checkout as AI agent advertising spend hits $5B.

Oct 9, 11:03 PMDec 31, 11:59 PM

26.72%chance

191273

OptionVotes

YES

NO

1656

604

Will a criminal investigation into OpenAI over the Hugging Face breach be publicly confirmed before 2028?

Jul 23, 9:04 PMDec 31, 11:59 PM

35.77%chance

10541

OptionVotes

YES

NO

1340

746

Will Al achieve 85% or higher on the Humanity's Last Exam benchmark before 2030?

Feb 7, 12:33 AMJan 1, 4:59 AM

87.3%chance

7267

OptionVotes

NO

YES

351

75

Will a multi-agent system have its time horizon evaluated by METR before EOY 2026?

Aug 1, 12:11 AMDec 31, 11:59 PM

15.77%chance

2260

OptionVotes

YES

NO

1260

944

Will Al achieve 95% or higher on the Humanity's Last Exam benchmark before 2028?

Feb 10, 1:00 AMJan 1, 4:59 AM

41.52%chance

7199

OptionVotes

YES

NO

137

104

Will a major US newspaper with at least 150 years of history partner with a top LLM (top ten by usage) by mid '29

Mar 7, 10:25 PMJul 1, 6:59 AM

56%chance

3128

OptionVotes

NO

YES

1128

886

Will an AI agent autonomously perform peer-review-quality LHC particle physics analysis by December 2029

Dec 23, 8:21 PMDec 31, 11:59 PM

54.55%chance

3121

OptionVotes

NO

YES

1351

1158

Latest stories