brianpeiris
brianpeiris@lemmy.ca
Posts
-
View post
They're getting desperate for real intelligence. I guess that's what happens when you don't have any of your own. “Paid collaboration” my ass. More like, let me pay you a pittance and sell your knowledge for 100x.
-
View post
GPT-6 Astra reaches and surpasses human-level performance on ARC-AGI-3 with a memory harness, but still at 1000x the cost - ARC Prize Foundation Summary: GPT-6 Astra scores 62.7% for $26K on ARC-AGI-3 Semi-Private with our Standard harness, and 99.9% for $19K with a Provider Adapter harness. GPT-6 Astra surpasses the human baseline in action efficiency on ARC-AGI-3. It used fewer actions than the median tested human on 96% of levels. A key behavior observed in GPT-6 Astra was its ability to t...
-
View post
Yes, the LLMs received credit for each level even if they didn't complete the entire environment. They have some replays of tasks on their website: https://arcprize.org/tasks Here's one where the human completed all 9 levels in 1458 actions, but the LLM completed only one level in 24 actions, then struggled for 190 actions until it timed-out, I guess. The LLM scored 2.8% because of the weighted average, I think. I didn't take the time to all do the math, and I'm not sure if the...
-
View post
> ARC-AGI-3 Launch event - Shared publicly live on March 25 in San Francisco at Y Combinator HQ, featuring a fireside conversation between François Chollet (creator, ARC-AGI) and Sam Altman (CEO, OpenAI) on measuring intelligence on the path to AGI. > François Chollet is a software engineer, artificial intelligence researcher, and former Senior Staff Engineer at Google. Chollet is the creator of the Keras deep-learning library released in 2015.
-
View post
Fuck Netanyahu, but what is the idea here? Do people seriously think he's dead or something?