guide4.png

TL;DR: VLAs turn visual and language understanding into robot actions. World Action Models (WAMs) also learn how the world changes, using predicted futures to guide actions. Cascaded WAMs separate prediction from control, while joint WAMs learn both together. Early results are promising, but WAMs are not consistently better than VLAs and often require more inference compute.

The idea is that learning how the world changes can help robots choose actions in unfamiliar situations.

World models are bringing AI closer to understanding how the physical world works. But what is that understanding for? Can we stop at predicting what happens next? The next step is to put that knowledge into practice – and that means taking action.

A relatively new class of models is trying to connect these two abilities. They are called World Action Models (WAMs), and they aim to give robots not only a way to predict how the world changes, but also a way to act based on those predictions.

But we already have Vision-Language-Action models (VLAs), one of the main approaches in Physical AI, combining visual perception, language understanding, and robot control. So why do we need something else?

That’s exactly what we’ll explore today. We’ll look at how WAMs work, what makes them different from VLAs, the main types of WAM architectures, and whether predicting the future actually helps robots perform better.

Another question is whether robots should learn to act directly from what they see or learn to imagine what their actions will do first.

Let's explore this new path from understanding the world to interacting with it – it is very interesting! Like peaking into the future a little bit.

In today’s episode:

Not interested in this topic? Watch our overview of the freshly released Open d1 – a decision model family from Liquid AI (and why it might be better than Jev) →

https://youtube.com/embed/EjX3OQQNPoo?utm_campaign=guide-vlas-vs-world-action-models-should-robots-react-or-imagine&utm_medium=referral&utm_source=www.turingpost.com