Study 01 of 03

How rank differs across gait phases

Measuring the policy Jacobian's effective rank separately during swing and stance reveals differences between architectures that are obscured by an average over the whole gait cycle.

What we measure

For a deterministic actor mean and observation x, the per-state Jacobian relates small observation changes to action changes. We summarize its dimensionality with the entropy effective rank of the batch-averaged sensitivity map, then split the batch by gait phase: swing, when a foot is off the ground, and stance, when it bears load.

We measure the phase gap Δφ = erank(Jswing) − erank(Jstance). The global ranks of the two architecture families are nearly equal, at 9.3 and 9.2. Averaging over the gait cycle combines swing and stance into one value; evaluating them separately reveals how the learned input–output sensitivity depends on phase.

Phase gap per configuration and pooled swing, stance, and global Jacobian effective rank
(a) Phase gap Δφ on flat terrain: every SimBa configuration has higher rank during swing than stance; every MLP configuration has a negative gap. (b) Pooled swing, stance, and global (dashed) Jacobian erank per family. The nearly equal global values (9.3 vs 9.2) obscure the phase-dependent difference.
Untrained versus trained policy Jacobian matrices
Jacobian matrix for a deployed SimBa policy. (a) Before training, the structure is nearly random. (b) After training, basic input–output relationships emerge.

Results

QuantityValue
Δφ, SimBa family (pooled)+2.14
Δφ, MLP family (pooled)−0.31
Mann–Whitney p2.5e−6
Cliff's d0.98
Global Jacobian erank, SimBa vs MLP9.3 vs 9.2
Configurations with the expected signall SimBa positive, all MLP negative

The swing-dominant pattern also appears on the sim-to-real platform and on perceptive rough terrain, suggesting that it is not specific to a single simulator or terrain.