humanoidsdata.com

Search

Search datasets, articles, and glossary terms for humanoids and embodied AI.

← All glossary terms

Models & learning

Diffusion policy

A diffusion policy is a learned robot policy that generates an action or action sequence through iterative denoising conditioned on observations and, where applicable, a task goal. This formulation can represent several plausible behaviours for the same scene and is commonly trained by imitation on time-aligned trajectories of observations and expert actions.

Also known as: action diffusion policy, diffusion-based policy

Updated

How action denoising works

During training, a diffusion policy learns to reverse noise added to expert action sequences while conditioning on observations such as images and robot state. At inference, it begins with a noisy action sample and refines it through several denoising steps. The result is an action chunk that the controller can execute before observing the world again and replanning.

The original Diffusion Policy paper formulated visuomotor control as conditional denoising in robot action space and combined it with receding-horizon control.

Why use a distribution over actions

Demonstrations can contain more than one valid response to the same scene. A humanoid might pass an obstacle on either side or grasp an object with either hand. Averaging those alternatives can produce an action that matches neither. A diffusion model can represent a multimodal action distribution and sample a coherent sequence from it.

The method also handles high-dimensional action chunks, but those properties do not guarantee that sampled motion is safe or dynamically feasible. The evidence in the original work came from manipulation tasks, so whole-body humanoid control requires its own evaluation.

Training and deployment requirements

Training trajectories need synchronised observations and actions, consistent units and a declared control frequency. The chunk length and prediction horizon determine what temporal structure the model learns. Demonstrations should include corrections and varied initial states if the policy is expected to recover from drift.

Iterative denoising also introduces inference work before an action is available. Implementations therefore choose the number of denoising steps, action horizon and replanning rate together. The authors’ official implementation publishes the training and evaluation configuration used for the reported tasks.

Sources