Be2Jay/AETHER-166B-A8B
Updated • 61 • 1
JangJaewon
Be2Jay
AI & ML interests
None yet
Recent Activity
updated a model 1 day ago
Be2Jay/AETHER-166B-A8B published a model 1 day ago
Be2Jay/AETHER-166B-A8B liked a Space 2 days ago
FINAL-Bench/Darwin-9B-OpusOrganizations
updated a
model 1 day ago
published a
model 1 day ago
liked a
Space 2 days ago
liked a
model 2 days ago
liked a
Space 3 days ago
liked a
model 6 days ago
reactedto SeaWolf-AI's post with 🔥 6 days ago
Post
4641
🌍 World Model Bench — does your world model actually think?
FID measures realism. FVD measures smoothness. But neither tells you whether the model understood the scene.
We just released WM Bench — the first benchmark for cognitive intelligence in world models. The core question: when a beast charges from 3 meters away, does the model know to sprint — not walk? Does it respond differently to a human vs an animal? Does it remember the left corridor was blocked two steps ago?
Those are cognitive questions. No existing benchmark asks them. So we built one.
3 Pillars · 10 Categories · 100 Scenarios · 1,000-point scale
- 👁 P1 Perception (25%) — Can it read the scene?
- 🧠 P2 Cognition (45%) — Does it predict threats, escalate emotions, utilize memory?
- 🔥 P3 Embodiment (30%) — Does the body respond with the right motion?
All evaluation is via simple JSON I/O — no 3D engine, no special hardware. Any model with an API can participate.
We also built PROMETHEUS as a live reference implementation — runs in your browser on a T4, no install needed. Combines FloodDiffusion motion generation with a LLM cognitive brain (Perceive → Predict → Decide → Act). Scored 726/1000 (Grade B) on Track C — the only directly verified model so far. Submissions from other teams very welcome.
---
🗂 Dataset → FINAL-Bench/World-Model
🌍 Demo → FINAL-Bench/World-Model
🏆 Leaderboard → FINAL-Bench/worldmodel-bench
📝 Article → https://huggingface.co/blog/FINAL-Bench/world-model
Part of the FINAL Bench Family — alongside FINAL Bench (Feb 2026). Feedback on rubrics and missing models always welcome!
FID measures realism. FVD measures smoothness. But neither tells you whether the model understood the scene.
We just released WM Bench — the first benchmark for cognitive intelligence in world models. The core question: when a beast charges from 3 meters away, does the model know to sprint — not walk? Does it respond differently to a human vs an animal? Does it remember the left corridor was blocked two steps ago?
Those are cognitive questions. No existing benchmark asks them. So we built one.
3 Pillars · 10 Categories · 100 Scenarios · 1,000-point scale
- 👁 P1 Perception (25%) — Can it read the scene?
- 🧠 P2 Cognition (45%) — Does it predict threats, escalate emotions, utilize memory?
- 🔥 P3 Embodiment (30%) — Does the body respond with the right motion?
All evaluation is via simple JSON I/O — no 3D engine, no special hardware. Any model with an API can participate.
We also built PROMETHEUS as a live reference implementation — runs in your browser on a T4, no install needed. Combines FloodDiffusion motion generation with a LLM cognitive brain (Perceive → Predict → Decide → Act). Scored 726/1000 (Grade B) on Track C — the only directly verified model so far. Submissions from other teams very welcome.
---
🗂 Dataset → FINAL-Bench/World-Model
🌍 Demo → FINAL-Bench/World-Model
🏆 Leaderboard → FINAL-Bench/worldmodel-bench
📝 Article → https://huggingface.co/blog/FINAL-Bench/world-model
Part of the FINAL Bench Family — alongside FINAL Bench (Feb 2026). Feedback on rubrics and missing models always welcome!
updated a
model 7 days ago
published a
model 7 days ago
updated a
model 7 days ago
published a
model 7 days ago
updated a
dataset 7 days ago
published a
dataset 7 days ago
updated a
Space 7 days ago
published a
Space 7 days ago
liked a
Space 8 days ago
updated a
Space 9 days ago
v1.21 Announcement: 13-Model Leaderboard + SR-MEI Dissociation Finding
#2 opened 9 days ago
by Be2Jay
v1.21 Release: 13-Model Leaderboard + HalluCode Extension + MARL-SL H6
#1 opened 9 days ago
by Be2Jay
updated a
dataset 9 days ago