Skip to article frontmatterSkip to article content
Site not loading correctly?

This may be due to an incorrect BASE_URL configuration. See the MyST Documentation for reference.

Generalized Wasserstein Distances

This chapter keeps the idea of comparing measures while changing the geometry of the comparison. The constructions below relax mass conservation, average lower-dimensional projections, quotient nuisance symmetries, linearize transport around a reference measure, replace the trace cost by spectral gauges, or constrain motion to conditional fibers. They are useful when standard Wp\Wass_p is too rigid or too expensive, but each modification also changes which metric, geodesic, or stability properties survive.

Unbalanced OT

Unbalanced OT allows mass creation and destruction by penalizing marginal mismatch. It is essential when histograms are not normalized, when observations contain outliers, or when only part of the source should match the target Liero et al., 2018Chizat et al., 2018Chizat et al., 2018.

Relaxed Formulation

For nonnegative measures (α,β)M+(X)×M+(Y)(\alpha,\beta)\in\mathcal M_+(\X)\times\mathcal M_+(\Y), a generic relaxed formulation is

UWc(α,β)=infπM+(X×Y)X×Yc(x,y)dπ(x,y)+Dψ1(π1α)+Dψ2(π2β),\mathsf{UW}_c(\alpha,\beta) = \inf_{\pi\in\mathcal M_+(\X\times\Y)} \int_{\X\times\Y} c(x,y)\d\pi(x,y) + \mathcal D_{\psi_1}(\pi_1\mid\alpha) + \mathcal D_{\psi_2}(\pi_2\mid\beta),

where ψ1,ψ2\psi_1,\psi_2 are convex entropy functions. Exact conservation (π1,π2)=(α,β)(\pi_1,\pi_2)=(\alpha,\beta) is replaced by a cost for changing the marginals. Writing ψs=τψˉs\psi_s=\tau\bar\psi_s exposes the relaxation scale:

UWc,τ(α,β)=infπ0cdπ+τDψˉ1(π1α)+τDψˉ2(π2β).\mathsf{UW}_{c,\tau}(\alpha,\beta) = \inf_{\pi\geq0} \int c\d\pi + \tau\mathcal D_{\bar\psi_1}(\pi_1\mid\alpha) + \tau\mathcal D_{\bar\psi_2}(\pi_2\mid\beta).

Large τ\tau makes marginal mismatch expensive and approaches balanced OT when the total masses are compatible. Small τ\tau makes creation and destruction cheap; after rescaling by τ\tau, the zero-transport part reveals the pure divergence geometry.

The two immediate numerical displays make the penalty roles explicit. Div fixes a KL marginal penalty and varies τ\tau: the transported marginals, shown in violet, are allowed to differ from the prescribed red and blue marginals, and the gaps are precisely the created or destroyed mass. Div then keeps the geometry, entropic plan regularization and relaxation strength fixed, and changes only the marginal divergence. This isolates the effect of the penalty: KL gives smooth rescaling, Burg discourages complete deletion of prescribed modes, while total variation produces sharper active-mass selection.

Figure Div fixes a KL marginal penalty and varies τ\tau: the transported marginals, shown in violet, are allowed to differ from the prescribed red and blue marginals, and the gaps are precisely the created or destroyed mass.

<IPython.core.display.Image object>

KL unbalanced OT on one-dimensional Gaussian-mixture densities. The central matrix is the transported coupling. The side curves compare the prescribed marginals with the transported marginals; increasing τ\tau makes marginal mismatch more expensive, so more mass is moved rather than created or destroyed.

The entropy used in the marginal relaxation also changes the qualitative behavior. A KL penalty leads to smooth multiplicative rescaling. The reverse-KL, or Burg, penalty blows up when a transported marginal vanishes where the prescribed marginal is positive, so it discourages complete deletion of small modes. Total variation has a linear kink and behaves closer to partial transport: mass is either kept active or created and destroyed at nearly constant marginal price.

Figure Div then keeps the geometry, entropic plan regularization and relaxation strength fixed, and changes only the marginal divergence.

<IPython.core.display.Image object>

Effect of the marginal divergence in unbalanced entropic OT. The geometric cost, entropic plan regularization ϵ\epsilon, and relaxation strength τ\tau are fixed; only the marginal penalty changes. KL allows smooth mass variation, Burg keeps transported marginals from vanishing on prescribed modes, and total variation gives a sharper active-mass selection.

Interactive panel. Use the middle-τ\tau, ϵ\epsilon, and grid controls to compare KL unbalanced couplings for the same source and target marginals as in the book figure.

These figures should be read as pictures of a single relaxed plan π\pi: the same nonnegative measure determines both the transported coupling and its two relaxed marginals. The small-τ\tau result below formalizes the opposite regime, where transport becomes negligible compared with local mass variation.

Proof

For the upper bound, restrict to diagonal plans π=(Id,Id)ρ\pi=(\Id,\Id)_\sharp\rho, whose transport cost is zero and whose two marginals are both ρ\rho. This gives the desired upper bound after optimizing over ρ\rho.

For the lower bound, let τn0\tau_n\downarrow0 and let πn\pi_n be almost minimizing plans with bounded scaled values τn1UWc,τn(α,β)\tau_n^{-1}\mathsf{UW}_{c,\tau_n}(\alpha,\beta). Since the divergences are nonnegative, cdπn=O(τn)\int c\d\pi_n=O(\tau_n), hence cdπn0\int c\d\pi_n\to0. The bounded scaled values also put the two marginals in compact divergence sublevel sets. Since a coupling has the same total mass as each marginal, the couplings are tight on X×X\X\times\X. Up to subsequences, πnπ0\pi_n\rightharpoonup\pi_0.

Lower semicontinuity of the transport cost yields cdπ0=0\int c\d\pi_0=0, so π0\pi_0 is concentrated on the diagonal. Its two marginals are therefore equal to a common measure ρ\rho. Lower semicontinuity of the marginal divergences gives

lim infn1τnUWc,τn(α,β)Dψˉ1(ρα)+Dψˉ2(ρβ),\liminf_n \frac{1}{\tau_n} \mathsf{UW}_{c,\tau_n}(\alpha,\beta) \geq \mathcal D_{\bar\psi_1}(\rho\mid\alpha) + \mathcal D_{\bar\psi_2}(\rho\mid\beta),

and optimizing over ρ\rho gives the lower bound.

In the dominated case, the minimization over ρ=rλ\rho=r\lambda decouples into the scalar envelope mψˉ1,ψˉ2\mathfrak m_{\bar\psi_1,\bar\psi_2}. For KL, no singular part is admissible when α\alpha and β\beta are dominated by λ\lambda. The pointwise objective is rlog(r/a)r+a+rlog(r/b)r+br\log(r/a)-r+a+r\log(r/b)-r+b. Its optimality condition is log(r/a)+log(r/b)=0\log(r/a)+\log(r/b)=0, hence r=abr=\sqrt{ab}, and the minimum is a+b2ab=(ab)2a+b-2\sqrt{ab}=(\sqrt a-\sqrt b)^2.

Proof

Use the variational formula for the dual of a divergence and introduce the marginal variables through continuous potentials:

infπ0supf,gcdπ+fdπ1+gdπ2Dψ1(fα)Dψ2(gβ).\inf_{\pi\geq0}\sup_{f,g} \int c\d\pi + \int -f\d\pi_1 + \int -g\d\pi_2 - \mathcal D_{\psi_1}^*(-f\mid\alpha) - \mathcal D_{\psi_2}^*(-g\mid\beta).

Exchanging the infimum and supremum gives

supf,gDψ1(fα)Dψ2(gβ)+infπ0(c(fg))dπ.\sup_{f,g} - \mathcal D_{\psi_1}^*(-f\mid\alpha) - \mathcal D_{\psi_2}^*(-g\mid\beta) + \inf_{\pi\geq0} \int \big(c-(f\oplus g)\big)\d\pi .

The last infimum is 0 when fgcf\oplus g\leq c and -\infty otherwise.

Reverse and Homogeneous Formulations

The Liero--Mielke--Savare formulation rewrites marginal penalties as a local transport cost and then homogenizes it. Assuming first that the reference measures and transported marginals have mutually absolutely continuous parts, one can factor the objective as

c(x,y)dπ(x,y)+Dψ1(π1α)+Dψ2(π2β)=(c(x,y)+ψ1 ⁣(dπ1dα(x))dαdπ1(x)+ψ2 ⁣(dπ2dβ(y))dβdπ2(y))dπ(x,y).\begin{aligned} &\int c(x,y)\d\pi(x,y) + \mathcal D_{\psi_1}(\pi_1\mid\alpha) + \mathcal D_{\psi_2}(\pi_2\mid\beta) \\ &\quad = \int \left( c(x,y) + \psi_1\!\left(\frac{\d\pi_1}{\d\alpha}(x)\right) \frac{\d\alpha}{\d\pi_1}(x) + \psi_2\!\left(\frac{\d\pi_2}{\d\beta}(y)\right) \frac{\d\beta}{\d\pi_2}(y) \right) \d\pi(x,y). \end{aligned}

This motivates the local reverse cost

Lc(r,s):=c+rψ1(1/r)+sψ2(1/s),L_c(r,s) \eqdef c+r\psi_1(1/r)+s\psi_2(1/s),

with the usual recession convention at r=0r=0 or s=0s=0. If α=Fπ1+α\alpha=F\pi_1+\alpha^\perp and β=Gπ2+β\beta=G\pi_2+\beta^\perp are the Lebesgue decompositions of the reference marginals with respect to the transported marginals, then

UWc(α,β)=infπ0Lc(x,y)(F(x),G(y))dπ(x,y)+ψ1(0)α(X)+ψ2(0)β(Y).\mathsf{UW}_c(\alpha,\beta) = \inf_{\pi\geq0} \int L_{c(x,y)}(F(x),G(y))\d\pi(x,y) + \psi_1(0)\alpha^\perp(\X) + \psi_2(0)\beta^\perp(\Y).

The homogeneous formulation is obtained by taking the perspective transform of LcL_c,

Hc(r,s):=infθ>0θLc(r/θ,s/θ),H_c(r,s) \eqdef \inf_{\theta>0} \theta L_c(r/\theta,s/\theta),

which is positively 1-homogeneous. It defines

HWc(α,β)=infπ0Hc(x,y)(F(x),G(y))dπ(x,y)+ψ1(0)α(X)+ψ2(0)β(Y).\mathsf{HW}_c(\alpha,\beta) = \inf_{\pi\geq0} \int H_{c(x,y)}(F(x),G(y))\d\pi(x,y) + \psi_1(0)\alpha^\perp(\X) + \psi_2(0)\beta^\perp(\Y).

For both the proof and the cone construction, it is useful to expose the equivalent semi-coupling form Liero et al., 2018:

HWc(α,β)=infλM+(X×Y)u,v0{Hc(x,y)(u(x,y),v(x,y))dλ(x,y)  ;  (p1)(uλ)=α,(p2)(vλ)=β}.\mathsf{HW}_c(\alpha,\beta) = \inf_{\substack{\lambda\in\mathcal M_+(\X\times\Y)\\u,v\geq0}} \left\{ \int H_{c(x,y)}(u(x,y),v(x,y))\d\lambda(x,y) \; ;\; (\mathrm p_1)_\sharp(u\lambda)=\alpha,\quad (\mathrm p_2)_\sharp(v\lambda)=\beta \right\}.

The cases u=0u=0 or v=0v=0 encode the recession terms and therefore mass that is created or destroyed rather than transported.

Proof

Since Hc(r,s)Lc(r,s)H_c(r,s)\leq L_c(r,s) by choosing scale one, every competitor in the reverse formulation gives a homogeneous competitor of no larger cost. Hence HWUW\mathsf{HW}\leq\mathsf{UW}.

Conversely, fix a feasible semi-coupling (λ,u,v)(\lambda,u,v) in (15). For a positive measurable scale θ\theta, set π~=θλ\widetilde\pi=\theta\lambda. Disintegrate λ\lambda with respect to its first spatial marginal. If uˉ(x)\bar u(x) and θˉ(x)\bar\theta(x) are the conditional averages of uu and θ\theta, then α=uˉ(p1)λ\alpha=\bar u(\mathrm p_1)_\sharp\lambda and π~1=θˉ(p1)λ\widetilde\pi_1=\bar\theta(\mathrm p_1)_\sharp\lambda. Convexity of the perspective (a,m)aψ1(m/a)(a,m)\mapsto a\psi_1(m/a) and conditional Jensen give

Dψ1(π~1α)uψ1(θ/u)dλ.\mathcal D_{\psi_1}(\widetilde\pi_1\mid\alpha) \leq \int u\,\psi_1(\theta/u)\d\lambda.

The second marginal gives the analogous estimate. Therefore

cdπ~+Dψ1(π~1α)+Dψ2(π~2β)[cθ+uψ1(θ/u)+vψ2(θ/v)]dλ.\int c\d\widetilde\pi +\mathcal D_{\psi_1}(\widetilde\pi_1\mid\alpha) +\mathcal D_{\psi_2}(\widetilde\pi_2\mid\beta) \leq \int\big[c\theta+u\psi_1(\theta/u)+v\psi_2(\theta/v)\big]\d\lambda.

The pointwise infimum over θ>0\theta>0 is Hc(u,v)H_c(u,v). A measurable η\eta-minimizing scale exists by the normal-integrand selection theorem; the recession conventions cover vanishing weights. Letting η0\eta\downarrow0 and then minimizing over semi-couplings gives UWHW\mathsf{UW}\leq\mathsf{HW}.

Conic Lifting

Assume now that X=Y\X=\Y and ψ1=ψ2=ψ\psi_1=\psi_2=\psi. The homogeneous formulation lifts the problem to the cone space C[X]:=(X×R+)/\mathfrak C[\X]\eqdef(\X\times\RR_+)/\sim, where all points (x,0)(x,0) are identified at the apex. For an exponent p1p\geq1, define

D((x,r),(y,s)):=Hc(x,y)(rp,sp)1/p.\mathsf D((x,r),(y,s)) \eqdef H_{c(x,y)}(r^p,s^p)^{1/p}.

Several classical unbalanced geometries are obtained by choosing ψ\psi, cc and pp so that D\mathsf D is a distance on the cone:

D((x,r),(y,s))2=r2+s22rscos(d(x,y)π/2).\mathsf D((x,r),(y,s))^2 = r^2+s^2-2rs\cos(d(x,y)\wedge\pi/2).
D((x,r),(y,s))2=r2+s22rsed(x,y)2/2.\mathsf D((x,r),(y,s))^2 = r^2+s^2-2rs e^{-d(x,y)^2/2}.

This is a cone metric when the Gaussian kernel k(x,y)=ed(x,y)2/2k(x,y)=e^{-d(x,y)^2/2} is positive definite. In particular, this holds on subsets of Hilbert spaces. Positive definiteness is an additional hypothesis on a general metric space.

D((x,r),(y,s))=r+s(rs)(2d(x,y))+.\mathsf D((x,r),(y,s)) = r+s-(r\wedge s)(2-d(x,y))_+.

For a finite measure η\eta on the cone, define its weighted base projection Ppη\mathsf P_p\eta by

Xφ(x)d(Ppη)(x)=C[X]φ(x)rpdη(x,r).\int_\X \varphi(x)\d(\mathsf P_p\eta)(x) = \int_{\mathfrak C[\X]}\varphi(x)r^p\d\eta(x,r).

The corresponding cone action value is

CW(α,β)=infγM+(C[X]2){D((x,r),(y,s))pdγ  ;  Ppγ1=α,Ppγ2=β}.\mathsf{CW}(\alpha,\beta) = \inf_{\gamma\in\mathcal M_+(\mathfrak C[\X]^2)} \left\{ \int \mathsf D((x,r),(y,s))^p\d\gamma \; ; \; \mathsf P_p\gamma_1=\alpha,\quad \mathsf P_p\gamma_2=\beta \right\}.
Proof

The equality UW=HW\mathsf{UW}=\mathsf{HW} is the preceding proposition. A feasible semi-coupling (λ,u,v)(\lambda,u,v) lifts to the cone through

(x,y)((x,u(x,y)1/p),(y,v(x,y)1/p)).(x,y)\longmapsto \big((x,u(x,y)^{1/p}),(y,v(x,y)^{1/p})\big).

Its weighted base marginals are α,β\alpha,\beta, and its cone action is exactly Hc(x,y)(u,v)dλ\int H_{c(x,y)}(u,v)\d\lambda, so CWHW\mathsf{CW}\leq\mathsf{HW}. Conversely, disintegrate a cone plan over (x,y)(x,y) and set u=E[rpx,y]u=\mathbb E[r^p\mid x,y] and v=E[spx,y]v=\mathbb E[s^p\mid x,y]. Jensen’s inequality for the convex function HcH_c produces a feasible semi-coupling of no larger action. Hence HWCW\mathsf{HW}\leq\mathsf{CW}.

For the triangle inequality, two plans that share the same weighted middle projection need not share the same ordinary cone marginal. Homogeneity is the essential correction: common radial rescaling preserves weighted projections and action. After normalization and addition of harmless apex mass, two nearly optimal plans for (α,β)(\alpha,\beta) and (β,ζ)(\beta,\zeta) can be given the same ordinary middle lift

Mδo+(x(x,1))βM\delta_{\mathfrak o}+(x\mapsto(x,1))_\sharp\beta

for a sufficiently large finite MM. The ordinary gluing lemma and Minkowski’s inequality then prove the triangle inequality. Radial normalization by (rp+sp)1/p(r^p+s^p)^{1/p} also restricts minimizing plans to bounded radii and fixed mass; compactness and lower semicontinuity yield an optimizer. A zero-action optimizer is concentrated on the cone diagonal, so its two weighted projections coincide and α=β\alpha=\beta.

Entropic KL Relaxation

A generic entropic regularization of unbalanced OT reads

POTλTV(α,β):=infπM+(X×Y)cdπ+Dψ1(π1α)+Dψ2(π2β)+ϵDϕ(παβ).\operatorname{POT}^{\TV}_\lambda(\alpha,\beta) \eqdef \inf_{\pi\in\mathcal M_+(\X\times\Y)} \int c\d\pi + \mathcal D_{\psi_1}(\pi_1\mid\alpha) + \mathcal D_{\psi_2}(\pi_2\mid\beta) + \epsilon\mathcal D_\phi(\pi\mid\alpha\otimes\beta).

Its dual is

supf,gDψ1(fα)Dψ2(gβ)ϵDϕ(fgcϵ|αβ).\sup_{f,g} - \mathcal D_{\psi_1}^*(-f\mid\alpha) - \mathcal D_{\psi_2}^*(-g\mid\beta) - \epsilon\mathcal D_\phi^* \left(\frac{f\oplus g-c}{\epsilon}\middle|\alpha\otimes\beta\right).

For Dϕ=KL\mathcal D_\phi=\operatorname{KL}, the primal-dual relation is dπ=e(fgc)/ϵdαdβ\d\pi=e^{(f\oplus g-c)/\epsilon}\d\alpha\d\beta. If, in addition, Dψ1=Dψ2=τKL\mathcal D_{\psi_1}=\mathcal D_{\psi_2}=\tau\operatorname{KL}, coordinate maximization gives the damped soft transforms

fωgcˉ,ϵ,gωfc,ϵ,ω:=ττ+ϵ,f\leftarrow\omega\,g^{\bar c,\epsilon}, \qquad g\leftarrow\omega\,f^{c,\epsilon}, \qquad \omega\eqdef\frac{\tau}{\tau+\epsilon},

where the soft transforms are defined in Definition: Continuous Soft cc-Transforms. Equivalently,

f(x)=τϵτ+ϵlogYexp(g(y)c(x,y)ϵ)dβ(y),g(y)=τϵτ+ϵlogXexp(f(x)c(x,y)ϵ)dα(x).\begin{aligned} f(x) &= - \frac{\tau\epsilon}{\tau+\epsilon} \log\int_\Y \exp\left(\frac{g(y)-c(x,y)}{\epsilon}\right)\d\beta(y),\\ g(y) &= - \frac{\tau\epsilon}{\tau+\epsilon} \log\int_\X \exp\left(\frac{f(x)-c(x,y)}{\epsilon}\right)\d\alpha(x). \end{aligned}

In the discrete case, with Ki,j=eCi,j/ϵaibjK_{i,j}=e^{-C_{i,j}/\epsilon}a_i b_j and ω=τ/(τ+ϵ)\omega=\tau/(\tau+\epsilon), this gives the generalized Sinkhorn scaling

ui(ai(Kv)i)ω,vj(bj(Ku)j)ω,P=diag(u)Kdiag(v).u_i\leftarrow \left(\frac{a_i}{(Kv)_i}\right)^\omega, \qquad v_j\leftarrow \left(\frac{b_j}{(K^\top u)_j}\right)^\omega, \qquad P=\diag(u)K\diag(v).

The exponent ω<1\omega<1 is the visible difference with balanced Sinkhorn: marginal corrections are damped because violating the marginals is allowed.

The KL case in Div is obtained from these damped updates. The interactive panel above exposes the two most important regularization scales. Increasing τ\tau pushes the transported marginals closer to the prescribed ones; increasing ϵ\epsilon spreads the coupling itself.

Metric Contraction of the Damped Updates

Balanced entropic potentials have a gauge ambiguity, whereas KL marginal penalties make the unbalanced potentials unique up to null sets. The natural metric is therefore the ordinary LL^\infty distance on potentials, or, equivalently, the Thompson metric on positive scalings,

dT((u,v),(u,v)):=max{logulogu,logvlogv}.d_T((u,v),(u',v')) \eqdef \max\{\|\log u-\log u'\|_\infty, \|\log v-\log v'\|_\infty\}.
Proof

Soft cc-transforms are order reversing, commute with additive constants up to sign, and are 1-Lipschitz in LL^\infty. Thus, writing D=d((f,g),(f,g))D=d_\infty((f,g),(f',g')),

f~f~ωD,g~g~ωf~f~ω2D.\|\widetilde f-\widetilde f'\|_\infty\leq\omega D, \qquad \|\widetilde g-\widetilde g'\|_\infty \leq\omega\|\widetilde f-\widetilde f'\|_\infty \leq\omega^2D.

Hence the product distance contracts by ω\omega. Banach’s fixed-point theorem gives existence, uniqueness, and the geometric rate.

Partial Optimal Transport

Total variation gives a sharp active-mass selection and connects unbalanced OT with the classical partial-transport problem. The latter fixes in advance the amount of transported mass. For

0mmin{α(X),β(Y)},0\leq m\leq \min\{\alpha(\X),\beta(\Y)\},

define

POTm(α,β):=infπM+(X×Y)π1α, π2βπ(X×Y)=mcdπ.\operatorname{POT}_m(\alpha,\beta) \eqdef \inf_{\substack{\pi\in\mathcal M_+(\X\times\Y)\\ \pi_1\leq\alpha,\ \pi_2\leq\beta\\ \pi(\X\times\Y)=m}} \int c\,\d\pi .

Thus only a submeasure of α\alpha is transported onto a submeasure of β\beta; the remaining mass is left unmatched. The corresponding Lagrangian form is obtained by adding total-variation penalties. For a price λ>0\lambda>0 for discarding or creating one unit of mass, denote by POTλTV(α,β)\operatorname{POT}^{\TV}_\lambda(\alpha,\beta) the value

infπM+(X×Y)cdπ+λαπ1TV+λβπ2TV.\inf_{\pi\in\mathcal M_+(\X\times\Y)} \int c\,\d\pi + \lambda\|\alpha-\pi_1\|_{\TV} + \lambda\|\beta-\pi_2\|_{\TV}.

Assume c0c\geq0. Allowing transported marginals larger than the available marginals does not improve the value: excess transported mass can be trimmed, which decreases the transport cost and cannot increase the sum of the two total-variation penalties. Hence an optimal plan may be chosen with π1α\pi_1\leq\alpha and π2β\pi_2\leq\beta. If m=π(X×Y)m=\pi(\X\times\Y), the penalty then reduces to

λ(α(X)m)+λ(β(Y)m),\lambda\big(\alpha(\X)-m\big)+\lambda\big(\beta(\Y)-m\big),

so the precise relation is a one-dimensional Lagrange duality in the transported mass.

Proof

Write V(m)=POTm(α,β)V(m)=\operatorname{POT}_m(\alpha,\beta). Compactness gives an optimizer. Convex combinations of subcouplings show that VV is convex, while rescaling a plan shows that it is nondecreasing. If m0<m1m_0<m_1, choose submeasures of mass m1m0m_1-m_0 from the residual source and target measures of an optimizer at m0m_0, couple them, and add this coupling. This proves V(m1)V(m0)c(m1m0)V(m_1)-V(m_0)\leq\|c\|_\infty(m_1-m_0), so VV is Lipschitz.

Grouping every penalized competitor by its total transported mass gives the displayed scalar infimum. Equality forces simultaneous optimality in the fixed-mass and scalar problems. The converse is precisely the subgradient inequality. Since the extended convex function is Lipschitz on [0,M][0,M] and nondecreasing, a nonnegative subgradient exists at every mass after including the interval’s normal cone.

Proof

When both endpoint masses equal mm, the inequalities π1α\pi_1\leq\alpha, π2β\pi_2\leq\beta and the mass constraint force π1=α\pi_1=\alpha, π2=β\pi_2=\beta. Thus partial couplings are exactly balanced couplings, and normalization by mm gives the formula. On a larger class, α=mδx+rδy\alpha=m\delta_x+r\delta_y and β=mδx+rδz\beta=m\delta_x+r\delta_z are distinct but share the zero-cost partial plan mδ(x,x)m\delta_{(x,x)}.

Thus TV penalization is the Lagrangian envelope of constrained partial OT: increasing λ\lambda selects larger transported masses, while small λ\lambda makes deletion and creation cheaper. The constrained theory, including active regions and free boundaries, was developed by Caffarelli--McCann and Figalli Caffarelli & McCann (2010)Figalli (2010). Modern computational and learning applications include partial Wasserstein and partial Gromov--Wasserstein variants, for instance in Chapel--Alaya--Gasso Chapel et al. (2020).

Figure Div shows this active-region mechanism for two one-dimensional two-Gaussian mixtures, with the source mixture shifted to the left and the target mixture shifted to the right.

<IPython.core.display.Image object>

Partial optimal transport with prescribed transported mass. The central image is the optimal subcoupling, with contrast normalized independently in each panel to keep the low-mass plans readable. The pale red and blue side curves are the original source and target densities, while the violet curves are the active truncated marginals. As the transported mass decreases, only the lowest-cost overlapping parts remain matched and the remaining mass is left unmatched.

Interactive panel. Decrease the transported mass to see how partial OT selects active submarginals and leaves the rest unmatched.

The same mechanism becomes a geometric active-region selection in higher dimension. Div shows a two-dimensional shape example: the partial plan selects the closest pieces of the two supports, while leaving distant regions unmatched.

Figure Div shows a two-dimensional

<IPython.core.display.Image object>

Two-dimensional partial optimal transport between a red cat-shaped indicator measure and a blue annulus indicator measure. Both supports are sampled by farthest-point sampling. Saturated points are the active source and target marginals of the optimal partial plan, while pale points are available mass left unmatched. As the prescribed mass decreases, the active regions contract to the nearest compatible pieces of the two shapes.

Interactive panel. Vary the transported mass to see which source and target points remain active when partial transport discards outlying mass.

Sliced Wasserstein Distances

Sliced Wasserstein distances replace one high-dimensional comparison by an average of explicit one-dimensional optimal transport problems.

One-Dimensional Projections

The idea was proposed by Marc Bernot, and its first published use for Wasserstein barycenters and texture mixing is due to Rabin, Peyré, Delon and Bernot Rabin et al., 2011. It is cheap, differentiable after sorting, and often effective in imaging and learning. For measures on Rd\RR^d and θSd1\theta\in\mathbb S^{d-1}, let Pθ(x)=θ,xP_\theta(x)=\dotp{\theta}{x}.

Spherical Averaging

The projected measures live on the real line, where Wasserstein distances are explicit through sorting or quantiles. Averaging over directions defines the sliced distance.

Since each projected problem can be solved by sorting or quantiles, SWp\operatorname{SW}_p is much cheaper to approximate numerically than high-dimensional OT. It metrizes the same weak-plus-moment topology as Wp\Wass_p, but its geometry is not bi-Lipschitz equivalent to Wp\Wass_p in high dimension Nadjahi et al., 2019.

Figure Div turns this Radon viewpoint into a concrete comparison: each planar density produces a family of one-dimensional projected laws, which can then be compared by ordinary one-dimensional Wasserstein distances.

<IPython.core.display.Image object>

Sliced Wasserstein projections between two planar densities. Fixed directions are drawn on both densities, and the middle panels show smoothed one-dimensional density estimates of the projected measures. Sliced OT averages one-dimensional Wasserstein discrepancies over many such directions.

The interactive demo separates two uses of a slice: comparing projected measures and lifting the sorted one-dimensional matching back to the plane. The lifted plan is always feasible in the original space, but it need not be the quadratic optimal plan.

Interactive panel. Use the projection angle and number of directions to see how sliced Wasserstein distances reduce high-dimensional transport to one-dimensional matchings.

Proof

Non-negativity and symmetry follow from the one-dimensional Wasserstein distance. For the triangle inequality, apply the triangle inequality of Wp\Wass_p in every direction and then Minkowski’s inequality in Lp(Sd1)L^p(\mathbb S^{d-1}).

If SWp(α,β)=0\operatorname{SW}_p(\alpha,\beta)=0, the projected measures agree for almost every direction. Continuity of characteristic functions extends the equality to all directions, and Cramér--Wold gives α=β\alpha=\beta.

Let π\pi be any coupling of α\alpha and β\beta. Projecting π\pi gives

Wp((Pθ)α,(Pθ)β)pRd×Rdθ,xypdπ(x,y).\Wass_p\big((P_\theta)_\sharp\alpha,(P_\theta)_\sharp\beta\big)^p \leq \int_{\mathbb R^d\times\mathbb R^d} |\langle\theta,x-y\rangle|^p\d\pi(x,y).

Rotational invariance yields

Sd1θ,zpdσ(θ)=κd,pzp.\int_{\mathbb S^{d-1}}|\langle\theta,z\rangle|^p\d\sigma(\theta) = \kappa_{d,p}\|z\|^p.

Integrating the projected bound and optimizing over π\pi proves the direct comparison. The beta-integral formula for the first coordinate of a uniform point on the sphere gives the displayed value of κd,p\kappa_{d,p}.

For the topology, Wp\Wass_p convergence implies sliced convergence by this upper bound. Conversely, if SWp(αn,α)0\operatorname{SW}_p(\alpha_n,\alpha)\to0, then

Sd1θ,xpdαn(x)dσ(θ)=κd,pxpdαn(x).\int_{\mathbb S^{d-1}}\int |\langle\theta,x\rangle|^p \d\alpha_n(x)\d\sigma(\theta) = \kappa_{d,p}\int\|x\|^p\d\alpha_n(x).

The projected-quantile formula gives uniform moment bounds and hence tightness. Every subsequence has a further subsequence whose projected Wp\Wass_p distances vanish for almost every direction; Cramér--Wold identifies every weak limit with α\alpha. If Qn,θQ_{n,\theta} and QθQ_\theta are the projected quantiles, then

SWp(αn,α)=Qn,θQθLp(Sd1×(0,1)).\operatorname{SW}_p(\alpha_n,\alpha) = \|Q_{n,\theta}-Q_\theta\|_{L^p(\mathbb S^{d-1}\times(0,1))}.

Together with the spherical identity, this gives convergence of the ppth moments, hence convergence in Wp\Wass_p.

The compact-support reverse estimates use the Radon structure of slices. Bonnotte’s Lemma 5.1.4 Bonnotte, 2013 proves

W1(α,β)CdRdd+1SW1(α,β)1d+1\Wass_1(\alpha,\beta) \leq C_dR^{\frac{d}{d+1}}\operatorname{SW}_1(\alpha,\beta)^{\frac{1}{d+1}}

by smoothing a Kantorovich--Rubinstein test function, representing the smoothed test through one-dimensional projections, and optimizing the smoothing scale. On BRB_R,

Wpp(2R)p1W1,SW1SWp.\Wass_p^p\leq(2R)^{p-1}\Wass_1, \qquad \operatorname{SW}_1\leq\operatorname{SW}_p.

The first inequality evaluates the pp-cost on a W1\Wass_1-optimal coupling; the second uses W1Wp\Wass_1\leq\Wass_p on each slice and Hölder’s inequality in the direction variable. They give Bonnotte’s general-pp estimate. The sharper p=1p=1 theorem of Carlier, Figalli, Mérigot and Wang Carlier et al., 2025 replaces 1/(d+1)1/(d+1) by the optimal exponent 1/d1/d. Combining it with the same two inequalities gives

WppCd,pRp1dSWp1d,\Wass_p^p \leq C_{d,p}R^{p-\frac1d}\operatorname{SW}_p^{\frac1d},

which is equivalent to the final two-sided formulation. Thus every pp admits a bounded-support lower bound on SWp\operatorname{SW}_p in terms of Wp\Wass_p; sharpness is asserted only for p=1p=1.

The infinitesimal comparison is most transparent along smooth Brenier perturbations. The usual Wasserstein distance sees the full L2(α)L^2(\alpha) norm of the displacement, while slicing sees only its one-dimensional projections. The same result also isolates the different behavior of finite atomic curves.

Intrinsic Sliced Length

In dimension one, SW2=W2\SW_2=\Wass_2. For d2d\geq2, SW2\SW_2 is not a length metric Park & Slepčev, 2025. Its intrinsic, or path, metric is

SW2(α,β):=infγ0=α, γ1=βγ SW2-absolutely continuous01γ˙tSW2dt,\ell_{\SW_2}(\alpha,\beta) \eqdef \inf_{\substack{\gamma_0=\alpha,\ \gamma_1=\beta\\ \gamma\ \text{$\SW_2$-absolutely continuous}}} \int_0^1\abs{\dot\gamma_t}_{\SW_2}\,\d t,

where γ˙tSW2\abs{\dot\gamma_t}_{\SW_2} is the metric derivative. Park and Slepčev prove that the infimum is attained, so (P2(Rd),SW2)(\Pp_2(\RR^d),\ell_{\SW_2}) is a geodesic space. Every path length dominates the endpoint distance, while Proposition Proposition: Metric Properties of Sliced Wasserstein bounds the sliced length of a W2\Wass_2-geodesic. Therefore

SW2SW2d1/2W2.\SW_2\leq\ell_{\SW_2}\leq d^{-1/2}\Wass_2.

Neither inequality identifies the intrinsic geometry with a rescaled Wasserstein geometry. Proposition Proposition: First-Order Comparison: Strictness and Atomic Equality shows that the sliced metric derivative equals d1/2d^{-1/2} times the Wasserstein metric derivative along finite atomic curves with fixed weights. By contrast, the Gaussian deformation in the same proposition is strictly slower for SW2\SW_2. Its sliced speed depends continuously on time, so strictness persists on a short interval. Integrating along that W2\Wass_2-geodesic gives, for every sufficiently small t0t\neq0,

SW2(α,αt)<d1/2W2(α,αt).\ell_{\SW_2}(\alpha,\alpha_t) <d^{-1/2}\Wass_2(\alpha,\alpha_t).

There is no reverse comparison by a constant depending only on dimension. Example 3.2 of Park and Slepčev considers two nearby parallel line segments moving in opposite directions. Most projected motions cancel after slicing: for every δ>0\delta>0, the construction produces a compactly supported atomless curve (αtδ)t(\alpha_t^\delta)_t such that, for small t0t\geq0,

α˙tδW2=1,α˙tδSW2Cd(t+δ).\abs{\dot\alpha_t^\delta}_{\Wass_2}=1, \qquad \abs{\dot\alpha_t^\delta}_{\SW_2}\leq C_d(t+\delta).

Since the first identity gives W2(α0δ,αhδ)=h+o(h)\Wass_2(\alpha_0^\delta,\alpha_h^\delta)=h+o(h), while the second gives SW2(α0δ,αhδ)Cd(δh+h2/2)\ell_{\SW_2}(\alpha_0^\delta,\alpha_h^\delta) \leq C_d(\delta h+h^2/2), one obtains

lim suph0SW2(α0δ,αhδ)W2(α0δ,αhδ)Cdδ.\limsup_{h\downarrow0} \frac{\ell_{\SW_2}(\alpha_0^\delta,\alpha_h^\delta)} {\Wass_2(\alpha_0^\delta,\alpha_h^\delta)} \leq C_d\delta.

Letting δ0\delta\to0 gives

infα,βP2(Rd)αβSW2(α,β)W2(α,β)=0.\inf_{\substack{\alpha,\beta\in\Pp_2(\RR^d)\\\alpha\neq\beta}} \frac{\ell_{\SW_2}(\alpha,\beta)}{\Wass_2(\alpha,\beta)}=0.

Thus SW2\ell_{\SW_2} and W2\Wass_2 are not globally bi-Lipschitz equivalent, even after inserting the factor d1/2d^{-1/2}.

The atomic equality remains stable in its natural regime. If η\eta is a fixed finite atomic measure with positive masses and separated atoms, Theorem 5.5 of Park and Slepčev gives

SW2(η,β)W2(η,β)1d,SW2(η,β)W2(η,β)1das W(η,β)0,\frac{\SW_2(\eta,\beta)}{\Wass_2(\eta,\beta)} \longrightarrow\frac1{\sqrt d}, \qquad \frac{\ell_{\SW_2}(\eta,\beta)}{\Wass_2(\eta,\beta)} \longrightarrow\frac1{\sqrt d} \quad\text{as }\Wass_\infty(\eta,\beta)\to0,

along βη\beta\neq\eta. By contrast, under suitable common-support and density bounds in the diffuse regime, their Theorem 5.2 shows that both SW2\SW_2 and SW2\ell_{\SW_2} are locally equivalent to H˙(d+1)/2\dot H^{-(d+1)/2}, while the infinitesimal geometry of W2\Wass_2 around a positive density is of H˙1\dot H^{-1} type. These results settle the comparison: the intrinsic sliced metric agrees asymptotically with d1/2W2d^{-1/2}\Wass_2 near finite atomic measures, but it is genuinely different globally and around diffuse measures.

Sliced Wasserstein Between Gaussians

Gaussian projections remain Gaussian, so quadratic sliced transport reduces to the one-dimensional Gaussian formula in every direction. This gives an exact angular representation and makes its relation with the Bures covariance geometry explicit.

Indeed, (Pθ)α(P_\theta)_\sharp\alpha is the one-dimensional Gaussian with mean θmα\theta^\top m_\alpha and variance θΣαθ\theta^\top\Sigma_\alpha\theta. The one-dimensional Gaussian formula, followed by the spherical identity θθdσ(θ)=Id/d\int\theta\theta^\top\d\sigma(\theta)=I_d/d, proves the displayed expressions. For positive-definite covariances, let AA be the Bures transport matrix, so that AΣαA=ΣβA\Sigma_\alpha A=\Sigma_\beta. Cauchy--Schwarz for the Σα\Sigma_\alpha-inner product gives

θΣαAθ(θΣαθ)(θΣβθ).\theta^\top\Sigma_\alpha A\theta \leq \sqrt{(\theta^\top\Sigma_\alpha\theta) (\theta^\top\Sigma_\beta\theta)}.

Integration yields the fidelity bound above because tr(ΣαA)=tr[(Σα1/2ΣβΣα1/2)1/2]\operatorname{tr}(\Sigma_\alpha A) =\operatorname{tr}[(\Sigma_\alpha^{1/2}\Sigma_\beta \Sigma_\alpha^{1/2})^{1/2}]. The singular case follows by continuity. Equality forces AθA\theta to be collinear with θ\theta in every direction, hence A=rIdA=rI_d and Σβ=r2Σα\Sigma_\beta=r^2\Sigma_\alpha.

The spherical formula is exact, but for generic anisotropic covariances it has no Bures-like matrix-square-root simplification and is evaluated by angular quadrature or Monte Carlo. In dimensions d>1d>1, nonidentical measures cannot satisfy SW2=W2\SW_2=\Wass_2 under normalized spherical averaging; the two distances coincide in dimension one.

Two isotropic covariances saturate the normalized upper bound:

Σα=s2Id,Σβ=t2IdSW22=mαmβ2d+(st)2=1dW22.\Sigma_\alpha=s^2I_d,\quad\Sigma_\beta=t^2I_d \quad\Longrightarrow\quad \SW_2^2 =\frac{\norm{m_\alpha-m_\beta}^2}{d}+(s-t)^2 =\frac1d\Wass_2^2.

One isotropic covariance alone does not suffice. If Σα=s2Id\Sigma_\alpha=s^2I_d and (λi)i(\lambda_i)_i are the eigenvalues of Σβ\Sigma_\beta, concavity of the square root gives

θΣβθ=iλiθi2iλiθi2.\sqrt{\theta^\top\Sigma_\beta\theta} =\sqrt{\sum_i\lambda_i\theta_i^2} \geq\sum_i\sqrt{\lambda_i}\theta_i^2.

Consequently,

Sd1θΣβθdσ(θ)1dtr(Σβ1/2),\int_{\Sphere^{d-1}}\sqrt{\theta^\top\Sigma_\beta\theta} \d\sigma(\theta) \geq \frac1d\operatorname{tr}(\Sigma_\beta^{1/2}),

with equality only when Σβ\Sigma_\beta is isotropic. Hence SW22<W22/d\SW_2^2<\Wass_2^2/d for an anisotropic Σβ\Sigma_\beta.

Rank-one covariances expose the orientation gap explicitly. If Σα=a2uu\Sigma_\alpha=a^2uu^\top, Σβ=b2vv\Sigma_\beta=b^2vv^\top, and χ=u,v\chi=|\langle u,v\rangle|, then

SW2(α,β)2=1d[mαmβ2+a2+b24abπ(1χ2+χarcsinχ)],W2(α,β)2=mαmβ2+a2+b22abχ.\begin{aligned} \SW_2(\alpha,\beta)^2 &=\frac1d\left[ \norm{m_\alpha-m_\beta}^2+a^2+b^2 -\frac{4ab}{\pi}\left(\sqrt{1-\chi^2}+\chi\arcsin\chi\right) \right],\\ \Wass_2(\alpha,\beta)^2 &=\norm{m_\alpha-m_\beta}^2+a^2+b^2-2ab\chi. \end{aligned}

To obtain the cross term, rotational invariance allows u=e1u=e_1 and v=χe1+1χ2e2v=\chi e_1+\sqrt{1-\chi^2}e_2. Writing (θ1,θ2)=R(cosφ,sinφ)(\theta_1,\theta_2)=R(\cos\varphi,\sin\varphi), with φ\varphi uniform and E[R2]=2/d\mathbb E[R^2]=2/d, reduces the calculation to an elementary angular integral.

Aligned rank-one covariances saturate the normalized upper bound, whereas centered, orthogonal, equal-scale covariances satisfy SW2=12/πW2/d\SW_2=\sqrt{1-2/\pi}\,\Wass_2/\sqrt d. Thus sliced transport retains the relative angle but attenuates it through angular averaging rather than the linear Bures factor χ\chi. The corresponding Gaussian sliced-Wasserstein flow is revisited in the Gaussian closure catalogue.

LqL^q-Sliced, Max-Sliced and Subspace Variants

The exponent used to aggregate projection directions need not coincide with the transport exponent. A second exponent qq controls this aggregation: finite qq pools information from many directions, whereas q=q=\infty retains only the most discriminating one. Independently, replacing lines by kk-dimensional subspaces preserves more correlations at the price of solving higher-dimensional projected OT problems. These two choices fit into one family.

Metricity and the direct comparison with Wp\Wass_p carry over from ordinary slicing. The topological statement requires slightly more care when q<pq<p: although an abstract LqL^q norm need not control an LpL^p norm, projected Wasserstein profiles have enough continuity and moment control to rule out concentration in a vanishing set of subspaces. The next proposition separates the roles of pp, qq, and kk.

Proof

Write DU(α,β)=Wp((U)α,(U)β)D_U(\alpha,\beta)= \Wass_p((U^\top)_\sharp\alpha,(U^\top)_\sharp\beta). Non-negativity and symmetry are inherited from Wp\Wass_p, while Minkowski’s inequality in Lq(σd,k)L^q(\sigma_{d,k}), or the supremum triangle inequality for q=q=\infty, proves the triangle inequality. The reverse triangle inequality for Wp\Wass_p shows that UDU(α,β)U\mapsto D_U(\alpha,\beta) is continuous. Indeed,

Wp((Un)α,(U)α)UnUop(xpdα(x))1/p.\Wass_p\big((U_n^\top)_\sharp\alpha,(U^\top)_\sharp\alpha\big) \leq \|U_n-U\|_{\mathrm{op}} \left(\int\|x\|^p\d\alpha(x)\right)^{1/p}.

Thus SWp,q,k(α,β)=0\SW_{p,q,k}(\alpha,\beta)=0 implies DU=0D_U=0 for every UU: this is immediate for q=q=\infty, while for finite qq it follows from continuity and the full support of σd,k\sigma_{d,k}. Choosing a frame whose first column is any prescribed θSd1\theta\in\mathbb S^{d-1} shows that all one-dimensional projections of α\alpha and β\beta agree; Cramér--Wold gives α=β\alpha=\beta.

Every UU^\top is 1-Lipschitz, so DUWpD_U\leq\Wass_p, and monotonicity of LqL^q norms proves the first comparison. To compare dimensions, let VSt(d,)V\in\operatorname{St}(d,\ell) and RSt(,k)R\in\operatorname{St}(\ell,k). Since (VR)=RV(VR)^\top=R^\top V^\top, projection contraction gives DVRDVD_{VR}\leq D_V. Moreover, VRVR is uniformly distributed on St(d,k)\operatorname{St}(d,k) when VV and RR carry their invariant measures. Integration proves monotonicity in kk; the supremum case follows by extending each kk-frame to an \ell-frame.

For any πΓ(α,β)\pi\in\Gamma(\alpha,\beta),

DU(α,β)pU(xy)pdπ(x,y).D_U(\alpha,\beta)^p \leq \int\|U^\top(x-y)\|^p\d\pi(x,y).

Integrating in UU and minimizing in π\pi gives DLppκd,k,pWpp\|D_\cdot\|_{L^p}^p\leq\kappa_{d,k,p}\Wass_p^p. Monotonicity of LqL^q norms proves the case qpq\leq p; for qpq\geq p, combine this estimate with DUWpD_U\leq\Wass_p. Finally, average

Wp((PUω)α,(PUω)β)DU(α,β)\Wass_p\big((P_{U\omega})_\sharp\alpha,(P_{U\omega})_\sharp\beta\big) \leq D_U(\alpha,\beta)

over UU and ωSk1\omega\in\mathbb S^{k-1}. Since UωU\omega is uniform on Sd1\mathbb S^{d-1}, this gives SWpSWp,p,k\SW_p\leq\SW_{p,p,k}. For qpq\geq p, this also transfers the compact-support reverse estimates for ordinary sliced Wasserstein.

It remains to prove the topological assertion. Define Mp(η)=(xpdη(x))1/pM_p(\eta)=(\int\|x\|^p\d\eta(x))^{1/p}. For the Dirac mass at the origin,

DU(η,δ0)p=Uxpdη(x),DU(η,δ0)pdσd,k(U)=κd,k,pMp(η)p.D_U(\eta,\delta_0)^p = \int\|U^\top x\|^p\d\eta(x), \qquad \int D_U(\eta,\delta_0)^p\d\sigma_{d,k}(U) = \kappa_{d,k,p}M_p(\eta)^p.

Since DU(η,δ0)Mp(η)D_U(\eta,\delta_0)\leq M_p(\eta), one obtains

SWp,q,k(η,δ0){κd,k,p1/qMp(η),1qp,κd,k,p1/pMp(η),pq.\SW_{p,q,k}(\eta,\delta_0) \geq \begin{cases} \kappa_{d,k,p}^{1/q}M_p(\eta), & 1\leq q\leq p,\\ \kappa_{d,k,p}^{1/p}M_p(\eta), & p\leq q\leq\infty. \end{cases}

Consequently, if SWp,q,k(αn,α)0\SW_{p,q,k}(\alpha_n,\alpha)\to0, the triangle inequality gives a uniform bound on Mp(αn)M_p(\alpha_n). The functions Dn,U=DU(αn,α)D_{n,U}=D_U(\alpha_n,\alpha) are therefore uniformly equicontinuous because

Dn,UDn,VUVop(Mp(αn)+Mp(α)).|D_{n,U}-D_{n,V}| \leq \|U-V\|_{\mathrm{op}} \big(M_p(\alpha_n)+M_p(\alpha)\big).

On the compact Stiefel manifold, equicontinuity and full support upgrade LqL^q convergence to uniform convergence. Choosing a frame whose first column is θ\theta then shows uniformly that

Wp((Pθ)αn,(Pθ)α)Dn,U0.\Wass_p\big((P_\theta)_\sharp\alpha_n,(P_\theta)_\sharp\alpha\big) \leq D_{n,U}\longrightarrow0.

Thus SWp(αn,α)0\SW_p(\alpha_n,\alpha)\to0, and Proposition Proposition: Metric Properties of Sliced Wasserstein yields Wp(αn,α)0\Wass_p(\alpha_n,\alpha)\to0. The converse follows from SWp,q,kWp\SW_{p,q,k}\leq\Wass_p.

Min-SW Lifted Transport Plans

The preceding constructions compare projected measures. Min-SW uses a projection differently: it lifts the one-dimensional monotone coupling back to the ambient space and retains the lift with the smallest quadratic cost. Consider equal-weight empirical measures α=n1iδxi\alpha=n^{-1}\sum_i\delta_{x_i} and β=n1iδyi\beta=n^{-1}\sum_i\delta_{y_i}. For a direction θ\theta along which both projected point families have distinct coordinates, let σθ,τθSn\sigma_\theta,\tau_\theta\in\mathfrak S_n be their sorting permutations:

xσθ(1),θ<<xσθ(n),θ,yτθ(1),θ<<yτθ(n),θ.\dotp{x_{\sigma_\theta(1)}}{\theta}<\cdots< \dotp{x_{\sigma_\theta(n)}}{\theta}, \qquad \dotp{y_{\tau_\theta(1)}}{\theta}<\cdots< \dotp{y_{\tau_\theta(n)}}{\theta}.

Lifting the one-dimensional monotone matching gives

πθ=1ni=1nδ(xσθ(i),yτθ(i))Π(α,β).\pi_\theta = \frac1n\sum_{i=1}^n \delta_{(x_{\sigma_\theta(i)},y_{\tau_\theta(i)})} \in\Couplings(\alpha,\beta).

The cost of (104) is an upper bound on W2(α,β)2\Wass_2(\alpha,\beta)^2, and Min-SW minimizes this upper bound over θ\theta. This inexpensive feasible-plan construction was introduced by Mahey, Chapel, Gasso, Bonet and Courty Mahey et al., 2023.

Projected ties make the extension beyond this generic empirical setting less immediate. At a tie, the sorting permutations are not unique. Breaking ties by labels is not invariant under a relabeling of the atoms, while a lexicographic rule depends on an auxiliary coordinate system; both choices can be discontinuous under perturbations. For a non-discrete measure, a projection fiber may carry an entire conditional distribution, so there are no labels to sort. Tanguy, Chapel and Delon Tanguy et al., 2025 avoid arbitrary tie breaking by optimizing over all compatible lifts. Set

αθ=(Pθ)α,βθ=(Pθ)β,\alpha_\theta=(P_\theta)_\sharp\alpha, \qquad \beta_\theta=(P_\theta)_\sharp\beta,

and let

ϖθ=(qαθ,qβθ)Leb[0,1]\varpi_\theta = (q_{\alpha_\theta},q_{\beta_\theta})_\sharp \mathrm{Leb}_{[0,1]}

be their canonical monotone coupling, as in Theorem Theorem: One-dimensional Kantorovich solution. Define

Cθ(α,β):={πΠ(α,β)  :  (Pθ,Pθ)π=ϖθ}.\mathcal C_\theta(\alpha,\beta) \eqdef \left\{ \pi\in\Couplings(\alpha,\beta) \;:\; (P_\theta,P_\theta)_\sharp\pi=\varpi_\theta \right\}.

This set is nonempty. Indeed, disintegrate along PθP_\theta,

α(dx)=Rαs(dx)dαθ(s),β(dy)=Rβt(dy)dβθ(t),\alpha(\d x)=\int_\RR \alpha^s(\d x)\d\alpha_\theta(s), \qquad \beta(\d y)=\int_\RR \beta^t(\d y)\d\beta_\theta(t),

and form the conditionally independent lift

πθ0(dx,dy)=R2αs(dx)βt(dy)dϖθ(s,t).\pi_\theta^0(\d x,\d y) = \int_{\RR^2} \alpha^s(\d x)\beta^t(\d y) \d\varpi_\theta(s,t).

It belongs to Cθ(α,β)\mathcal C_\theta(\alpha,\beta). A representation-invariant measure-level extension is therefore

Min-SW2(α,β)2:=minθSd1minπCθ(α,β)Rd×Rdxy2dπ(x,y).\MinSW_2(\alpha,\beta)^2 \eqdef \min_{\theta\in\Sphere^{d-1}} \min_{\pi\in\mathcal C_\theta(\alpha,\beta)} \int_{\RR^d\times\RR^d}\norm{x-y}^2\d\pi(x,y).

Both minima are attained for α,βP2(Rd)\alpha,\beta\in\Pp_2(\RR^d) Tanguy et al., 2025. Unlike the particular lift (109), the inner minimization may correlate the conditional laws on Pθ1(s)×Pθ1(t)P_\theta^{-1}(s)\times P_\theta^{-1}(t); it chooses the least costly transverse coupling compatible with the prescribed projected coupling. When the empirical projections have no ties, Cθ(α,β)={πθ}\mathcal C_\theta(\alpha,\beta)=\{\pi_\theta\} and (110) reduces to (104).

For comparison, fixing θ\theta before comparing the measures restores a metric on equal-weight nn-point clouds whose θ\theta-projections are injective: it is n1/2n^{-1/2} times the Euclidean distance between the two tuples ordered along θ\theta. The constrained fixed-direction extension is likewise a metric on the class of measures with atomless θ\theta-projections Tanguy et al., 2025. It is the subsequent pair-dependent minimization over θ\theta that destroys the triangle inequality. In dimension one no such directional choice remains, and Min-SW2=W2\MinSW_2=\Wass_2.

The right-hand side of (111) and the diameter estimate are absolute upper bounds, not multiplicative comparisons with W2\Wass_2. Beyond the exactness criterion above, the cited theory does not provide a universal converse of the form Min-SW2CW2\MinSW_2\leq C\Wass_2.

Figure Div illustrates the resulting gap: the direction selected by Min-SW produces a valid lifted planar coupling, but that coupling need not be the quadratic optimal plan.

<IPython.core.display.Image object>

Min-SW lifted plan. A deterministic angular sweep selects a projection, after which the red and blue atoms are sorted and matched in one dimension. The middle panel lifts this matching back to the plane. Its cost upper-bounds W22W_2^2, but the resulting feasible plan need not equal the quadratic optimal plan shown on the right.

Interactive panel. Rotate the slicing direction to see how one-dimensional sorting induces a lifted feasible plan in the original plane.

Quotient Wasserstein and Wasserstein-Procrustes

Many comparison problems contain nuisance transformations: two shapes, images or point clouds should be considered close after translating, rotating or otherwise reparametrizing one of them. Quotient Wasserstein distances encode this idea by computing transport after optimizing over a group action. This construction is the metric analogue of passing from objects to shapes modulo symmetries, and connects OT with shape spaces, metamorphosis models and global-invariance variants of transport Trouvé & Younes, 2005Zemel & Panaretos, 2019Alvarez-Melis et al., 2019.

Proof

Isometry of the action gives Wp(gα,gβ)=Wp(α,β)\Wass_p(g_\sharp\alpha,g_\sharp\beta)=\Wass_p(\alpha,\beta), which proves the second formula above. Non-negativity and symmetry are inherited from Wp\Wass_p. For the triangle inequality, choose g1,g2Gg_1,g_2\in\mathcal G and write

Wp(α,(g1)β)+Wp(β,(g2)γ)=Wp(α,(g1)β)+Wp((g1)β,(g1g2)γ).\Wass_p(\alpha,(g_1)_\sharp\beta) + \Wass_p(\beta,(g_2)_\sharp\gamma) = \Wass_p(\alpha,(g_1)_\sharp\beta) + \Wass_p((g_1)_\sharp\beta,(g_1g_2)_\sharp\gamma).

The triangle inequality for Wp\Wass_p, followed by the infimum over g1,g2g_1,g_2, gives the result. If the infimum is attained and the quotient distance is zero, there exist g,hGg,h\in\mathcal G such that Wp(gα,hβ)=0\Wass_p(g_\sharp\alpha,h_\sharp\beta)=0, hence gα=hβg_\sharp\alpha=h_\sharp\beta, which is exactly equality of the two orbits. For compact groups, continuity of the action and compactness give the required attainment. Without attainment, distinct orbits at zero orbit distance must be identified to obtain a genuine metric space.

Rigid Motions and Wasserstein-Procrustes

The most common example is the Euclidean group E(d)=O(d)Rd\mathrm E(d)=\mathrm O(d)\ltimes\RR^d. For measures on Rd\RR^d, quotienting by rotations and translations gives the Wasserstein-Procrustes problem

infRO(d),tRd,πΠ(α,β)Rx+ty2dπ(x,y).\inf_{R\in\mathrm O(d),\,t\in\RR^d,\,\pi\in\Couplings(\alpha,\beta)} \int\norm{Rx+t-y}^2\d\pi(x,y).

Replacing O(d)\mathrm O(d) by SO(d)\mathrm{SO}(d) enforces orientation preservation. This is the case p=2p=2 of the quotient distance; for a general exponent pp, one replaces the quadratic cost by the ppth power of the Euclidean distance. Although the translation group is noncompact, the quadratic problem is well behaved: for fixed RR and π\pi, the optimal translation aligns RxˉR\bar x with yˉ\bar y. The remaining rigid step is therefore an orthogonal Procrustes problem over the compact group O(d)\mathrm O(d).

For empirical measures, this couples a transport problem with a rigid registration problem. Classical iterative closest point methods alternate nearest-neighbor assignment and rigid least squares Besl & McKay, 1992. Wasserstein-Procrustes replaces these hard many-to-one nearest-neighbor correspondences by a mass-preserving OT plan. This makes the registration less tied to sampling density and better suited to ambiguous correspondences.

Two complementary machine-learning formulations clarify the scope of this construction. Grave, Joulin and Berthet Grave et al., 2019 formulate unsupervised alignment of high-dimensional embeddings as a Wasserstein-Procrustes problem. In their equal-weight setting, one jointly estimates an orthogonal matrix and a permutation; they use a convex-relaxation initialization and a stochastic large-scale solver, with bilingual lexicon induction as the main application. Alvarez-Melis, Jegelka and Jaakkola Alvarez-Melis et al., 2019 place the same idea in a broader framework: the coupling and a latent global transformation are optimized jointly over a flexible invariance class because cross-space costs are otherwise ill-defined. The rigid quadratic model and block updates below are the isometric Procrustes specialization of this global-invariance viewpoint.

This is an extrinsic counterpart of the Gromov--Wasserstein viewpoint developed in Gromov--Wasserstein. Procrustes alignment searches only over ambient rigid motions, whereas GW is invariant under intrinsic measure-preserving isometries. The following comparison makes this relation precise.

Proof

Fix g,hE(d)g,h\in\mathrm E(d). For every coupling πΠ(α,β)\pi\in\Pi(\alpha,\beta), the push-forward π~=(g×h)π\widetilde\pi=(g\times h)_\sharp\pi, where (g×h)(x,y)=(g(x),h(y))(g\times h)(x,y)=(g(x),h(y)), couples gαg_\sharp\alpha and hβh_\sharp\beta. Rigid motions preserve pairwise Euclidean distances, so the GW objective has the same value at π\pi and π~\widetilde\pi. Applying the same argument to g1g^{-1} and h1h^{-1} proves

GW((Rd,,α),(Rd,,β))=GW((Rd,,gα),(Rd,,hβ)).\operatorname{GW}((\RR^d,\norm{\cdot},\alpha),(\RR^d,\norm{\cdot},\beta)) = \operatorname{GW}((\RR^d,\norm{\cdot},g_\sharp\alpha), (\RR^d,\norm{\cdot},h_\sharp\beta)).

The fixed-space estimate Proposition: Fixed-Space GW Is Controlled by Wasserstein therefore gives

GW((Rd,,α),(Rd,,β))2Wp(gα,hβ).\operatorname{GW}((\RR^d,\norm{\cdot},\alpha),(\RR^d,\norm{\cdot},\beta)) \leq 2\,\Wass_p(g_\sharp\alpha,h_\sharp\beta).

Taking the infimum over g,hE(d)g,h\in\mathrm E(d) proves the claim.

Thus a good Wasserstein-Procrustes registration certifies small GW distortion. The converse need not hold: GW may be small because of an intrinsic correspondence that is not induced by an ambient rigid motion. The Mémoli profile lower bound in Proposition: Memoli Profile Lower Bound gives the complementary intrinsic lower certificate.

The empirical problem naturally suggests an alternating minimization. Given a current rigid motion (R(k),t(k))(R^{(k)},t^{(k)}), first compute the OT coupling between the registered source cloud and the target cloud,

P(k)arg minPU(a,b)i,jPijR(k)xi+t(k)yj2.\P^{(k)} \in \argmin_{\P\in\CouplingsD(\a,\b)} \sum_{i,j}\P_{ij}\norm{R^{(k)}x_i+t^{(k)}-y_j}^2 .

Then freeze this coupling and update the rigid motion by

(R(k+1),t(k+1))arg minRO(d),tRdi,jPij(k)Rxi+tyj2,(R^{(k+1)},t^{(k+1)}) \in \argmin_{R\in\mathrm O(d),\,t\in\RR^d} \sum_{i,j}\P^{(k)}_{ij}\norm{Rx_i+t-y_j}^2 ,

or by the same formula with RSO(d)R\in\mathrm{SO}(d) if orientation should be preserved. The first step is an ordinary discrete OT problem with the current registered cost matrix; the next proposition shows that the second step is an orthogonal Procrustes problem with an explicit singular-value formula.

Proof

For fixed RR, differentiating with respect to tt gives t=yˉRxˉt=\bar y-R\bar x. Substituting this value centers the variables and leaves

i,jPijR(xixˉ)(yjyˉ)2.\sum_{i,j}\P_{ij}\norm{R(x_i-\bar x)-(y_j-\bar y)}^2.

The two quadratic terms independent of RR are fixed, so the problem is equivalent to maximizing i,jPijR(xixˉ),yjyˉ=tr(RMP)\sum_{i,j}\P_{ij}\dotp{R(x_i-\bar x)}{y_j-\bar y} =\tr(R^\top M_\P). Von Neumann’s trace inequality gives the maximum for R=UVR=UV^\top. Under the constraint RSO(d)R\in\mathrm{SO}(d), the same argument applies with the additional determinant constraint on URVU^\top R V, which gives the displayed diagonal correction.

Equations (122)--(123) give a block-coordinate method. The objective is not jointly convex, so the scheme should be read as a registration heuristic for the quotient problem rather than as a global solver. The exact block update moves the rigid motion fully; for visualization or continuation, one may damp the displayed motion between two successive poses.

Figure Div follows this block-coordinate scheme through a deliberately large translation, showing how the transport correspondences and the rigid registration stabilize together.

<IPython.core.display.Image object>

Wasserstein-Procrustes alignment of two bunny silhouettes under a strong translation and a moderate rotation. The target silhouette is shown in black. The moving source silhouette is sampled by farthest-point sampling and colored from red to blue at iterations (1,2,3,5,10). Each step solves an equal-weight OT assignment, then updates the rigid motion by the closed-form Procrustes formula; faint segments show selected correspondences of the current OT assignment. The displayed motion is damped only to make the registration path visible, while the underlying update is the block-coordinate method above.

Interactive panel. Step through the alternating OT assignment and rigid Procrustes updates. Changing the true deformation, damping, noise level and number of points shows when the block-coordinate registration is stable and when correspondences start to lock onto the wrong silhouette parts.

Vector Quantiles and Linear Optimal Transport

Linear OT starts from the multivariate analogue of quantile coordinates. The one-dimensional quantile function represents a probability measure by the monotone map sending a fixed reference law to it; in dimension d>1d>1, Brenier’s theorem gives the corresponding construction after choosing an absolutely continuous reference probability ρ\rho, typically the uniform law on a convex body or a standard Gaussian.

Vector Quantiles

Assume that ρ\rho is absolutely continuous. For a target law α\al with finite second moment, its vector quantile relative to ρ\rho is the Brenier map

Tα=ϕα,(Tα)ρ=α,T_\al=\nabla\phi_\al, \qquad (T_\al)_\sharp\rho=\al,

or equivalently the solution of

minTρ=αxT(x)2dρ(x).\min_{T_\sharp\rho=\al} \int\norm{x-T(x)}^2\d\rho(x).

This construction is canonical only after fixing ρ\rho: changing the reference law changes the coordinates used to represent α\al. The same transport-based quantile map has been used in several complementary statistical directions. Conditional vector quantile regression replaces scalar conditional quantiles by conditional Brenier maps Carlier et al., 2016Carlier et al., 2017; Monge--Kantorovich ranks and depth use transports to a spherical reference Chernozhukov et al., 2017; center-outward distribution and quantile functions build multivariate ranks and signs from the forward and inverse maps Hallin et al., 2021; and scalable nonlinear vector quantile regression learns such conditional maps with flexible models Rosenberg et al., 2023.

Linearized Wasserstein Coordinates

Linear OT replaces a nonlinear transport distance by a Hilbert norm between reference maps. It is useful when one reference measure is fixed and many nearby distributions must be compared cheaply. Let TαT_\alpha be the Brenier map pushing ρ\rho to α\alpha, understood as an element of L2(ρ;Rd)L^2(\rho;\RR^d) and hence defined only ρ\rho-almost everywhere. The linear OT embedding is

αTαIdL2(ρ;Rd),LOTρ(α,β)=TαTβL2(ρ).\alpha\mapsto T_\alpha-\Id\in L^2(\rho;\RR^d), \qquad \operatorname{LOT}_\rho(\alpha,\beta) = \norm{T_\alpha-T_\beta}_{L^2(\rho)}.

If one of the two targets equals the reference, the linearized distance is exact: for instance, LOTρ(ρ,α)=TαIdL2(ρ)=W2(ρ,α)\operatorname{LOT}_\rho(\rho,\alpha) =\norm{T_\alpha-\Id}_{L^2(\rho)} =\Wass_2(\rho,\alpha). For two arbitrary targets, the coupling (Tα,Tβ)ρ(T_\alpha,T_\beta)_\sharp\rho is admissible but not generally optimal, so LOTρ\operatorname{LOT}_\rho is a tangent-space approximation of the Wasserstein geometry. Introduced for the analysis of image populations Wang et al., 2013, LOT has subsequently been used for continuous image-pattern analysis Kolouri et al., 2016, provable classification of transformed distributions Moosmüller & Cloninger, 2023, collider-event analysis Cai et al., 2020, and scalable Wasserstein dimensionality reduction Cloninger et al., 2025. Uniqueness of the Brenier maps also shows that LOTρ\operatorname{LOT}_\rho is a genuine distance on the class of targets for which these maps are defined.

For a family (αs)s(\alpha_s)_s with weights (λs)s(\lambda_s)_s, the linearized barycenter is obtained by averaging maps,

Tˉ=sλsTαs,αˉLOT=Tˉρ.\bar T=\sum_s\lambda_s T_{\alpha_s}, \qquad \bar\alpha_{\operatorname{LOT}}=\bar T_\sharp\rho.

This is exact in one dimension, where quantile functions linearize W2\Wass_2, and it is especially useful when many barycenters with changing weights must be evaluated quickly.

Figure Div makes the LOT embedding explicit: map averaging is exact in one-dimensional quantile coordinates, whereas in two dimensions its linearized barycenter can differ from the genuine McCann midpoint.

<IPython.core.display.Image object>

Linear OT coordinates. Fixing a reference measure ρ\rho turns each target into a map TαT_\alpha from ρ\rho to α\alpha, or equivalently into the displacement field TαIdT_\alpha-\Id. In one dimension this is exactly the quantile parametrization of W2\Wass_2. In two dimensions, averaging the maps gives the linearized barycenter, which is compared with the genuine McCann midpoint.

The next control keeps the exact one-dimensional setting. The reference density defines the coordinate system, the target maps are quantile maps from that reference, and the barycenter is obtained by averaging those maps before pushing the reference forward.

Interactive panel. Use the reference and deformation controls to inspect how linear optimal transport embeds measures through maps from a fixed template.

The usefulness of these coordinates depends on controlling how much they distort the underlying Wasserstein geometry. The following global estimate is therefore important: LOT always dominates W2\Wass_2, while on compact supports with a uniform reference it remains Hölder-continuous with respect to perturbations measured by W1\Wass_1.

Proof

The first inequality is immediate: (Tα,Tβ)ρ(T_\alpha,T_\beta)_\sharp\rho is a feasible coupling between α\alpha and β\beta. The second inequality is the global quantitative stability theorem of Mérigot, Delalande and Chazal Mérigot et al., 2020. Its proof controls the difference of Kantorovich potentials by W1\Wass_1 and then uses convexity and interpolation estimates to control their gradients in L2(ρ)L^2(\rho).

In one dimension, quantiles make the embedding isometric and the exponent improves to one. In several dimensions the theorem is global but only Hölder; it is not a global Lipschitz estimate in W2\Wass_2.

Principal Components in Linear OT Coordinates

The preceding embedding turns probability measures into displacement fields in a fixed Hilbert chart, so ordinary principal component analysis can be applied to deformations rather than to densities. Given training measures (αi)i=1N(\alpha_i)_{i=1}^N, set

zi:=TαiId,zˉ:=1Ni=1Nzi.z_i \eqdef T_{\alpha_i}-\Id, \qquad \bar z \eqdef \frac1N\sum_{i=1}^N z_i .

The map Id+zˉ\Id+\bar z defines the linear OT mean (Id+zˉ)ρ(\Id+\bar z)_\sharp\rho. The empirical covariance operator on L2(ρ;Rd)L^2(\rho;\RR^d) is the finite-rank operator

CLOTh:=1Ni=1Nzizˉ,hL2(ρ)(zizˉ),\mathcal C_{\operatorname{LOT}} h \eqdef \frac1N\sum_{i=1}^N \dotp{z_i-\bar z}{h}_{L^2(\rho)} (z_i-\bar z),

and its leading orthonormal eigenvectors eke_k define the principal linear OT modes. Equivalently, one diagonalizes the N×NN\times N Gram matrix Gij=1Nzizˉ,zjzˉL2(ρ)G_{ij}=\frac1N\dotp{z_i-\bar z}{z_j-\bar z}_{L^2(\rho)}. If Gv(k)=λkv(k)Gv^{(k)}=\lambda_k v^{(k)} with λk>0\lambda_k>0 and v(k)=1\norm{v^{(k)}}=1, then

ek=1Nλki=1Nvi(k)(zizˉ)e_k=\frac{1}{\sqrt{N\lambda_k}}\sum_{i=1}^N v_i^{(k)}(z_i-\bar z)

is the corresponding unit eigenvector of CLOT\mathcal C_{\operatorname{LOT}}. The score of αi\alpha_i along mode eke_k is

ai,k:=zizˉ,ekL2(ρ).a_{i,k} \eqdef \dotp{z_i-\bar z}{e_k}_{L^2(\rho)} .

A low-rank reconstruction, or a synthetic excursion with prescribed coefficients a=(a1,,am)a=(a_1,\ldots,a_m), is then obtained by pushing the reference through

Ta(x):=x+zˉ(x)+k=1makek(x),αa:=(Ta)ρ.T_a(x) \eqdef x+\bar z(x)+\sum_{k=1}^m a_k e_k(x), \qquad \alpha_a \eqdef (T_a)_\sharp\rho .

For small excursions around the mean displacement, this gives a practical tangent-space PCA for probability measures: it captures dominant modes of deformation while avoiding repeated pairwise OT computations. For large coefficients, TaT_a may fail to be the Brenier map from ρ\rho to αa\alpha_a, and may even leave the regular chart where TaT_a is a gradient of a convex function. Thus the curve aαaa\mapsto\alpha_a should be read as a chart-dependent linearized visualization rather than as an intrinsic Wasserstein geodesic. This LOT-PCA viewpoint was introduced for image variability analysis in Wang et al., 2013 and developed in transport-based signal analysis Thorpe et al., 2017Kolouri et al., 2017; it complements intrinsic principal-geodesic or geodesic-PCA approaches, which optimize directly in the curved Wasserstein space Seguy & Cuturi, 2015Bigot et al., 2017.

Figure Div first shows the exact one-dimensional case.

<IPython.core.display.Image object>

One-dimensional linear OT PCA for well-separated synthetic two-Gaussian mixtures. The PCA is fit on a large training ensemble, while the dataset panel displays only representative densities and the quantile average in violet. Each mode panel shows densities obtained from (Q_{\bar\alpha}+a e_k), using slightly extrapolated coefficients (a) increasing from red to blue. Since the embedding is the exact quantile parametrization (Q_\alpha\in L^2(0,1)), this is PCA in exact Wasserstein coordinates.

Figure Div then illustrates a regularized numerical approximation of the same construction on MNIST digit-zero images.

<IPython.core.display.Image object>

Principal components in linear OT coordinates for MNIST digit-zero histograms. The reference is a Sinkhorn barycenter, and each mode panel displays negative, zero, and positive excursions in a tangent displacement direction. The panels use white for zero displayed mass and black for high displayed mass; this is only a rendering convention. The modes capture rotations, aspect-ratio changes, and stroke-thickness deformations in the chart around the barycenter.

Interactive panel. Use the reference and deformation controls to inspect how linear optimal transport turns measures into displacement coordinates.

Spectral and Robust Wasserstein Distances

Spectral OT changes the scalar quadratic cost by measuring the whole displacement covariance through a matrix gauge. The same object admits a robust projected formulation: instead of fixing one projection, one maximizes over the polar set of the gauge. Subspace robust OT is the important non-convex rank-constrained version of this idea Paty & Cuturi, 2019; spectral gauges provide its convex minimax counterpart and connect to recent spectral-gradient viewpoints such as Muon dynamics Peyré, 2026.

The monotonicity condition means that increasing the displacement covariance in Loewner order cannot decrease the transport penalty.

The special case γ(M)=tr(M)\gamma(M)=\tr(M) gives the usual quadratic Wasserstein distance W2\Wass_2. The spectral gauge γ(M)=λmax(M)\gamma(M)=\lambda_{\max}(M) instead measures the worst transported variance direction. For A0A\succeq0, define the quadratic projected transport cost

W2,A(α,β)2:=infπΠ(α,β)(xy)A(xy)dπ(x,y)=W2((A1/2)α,(A1/2)β)2.\Wass_{2,A}(\alpha,\beta)^2 \eqdef \inf_{\pi\in\Couplings(\alpha,\beta)} \int (x-y)^\top A(x-y)\d\pi(x,y) = \Wass_2((A^{1/2})_\sharp\alpha,(A^{1/2})_\sharp\beta)^2.

The equality remains valid when AA is singular. Projecting any coupling gives one inequality; conversely, disintegrate α\alpha and β\beta over their A1/2A^{1/2}-images and lift an optimal projected coupling by conditionally coupling the fibers.

The polar set of the gauge is

Bγ:={A0:tr(AM)γ(M) for all M0},\mathcal B_\gamma \eqdef \{A\succeq0: \tr(AM)\leq\gamma(M)\ \text{for all } M\succeq0\},

so that, for a closed gauge, γ(M)=supABγtr(AM)\gamma(M)=\sup_{A\in\mathcal B_\gamma}\tr(AM).

For the Schatten gauge γq\gamma_q, Schatten Hölder duality gives

Bγq={A0:ASq1},1q+1q=1,\mathcal B_{\gamma_q} = \{A\succeq0:\norm{A}_{S_{q^\ast}}\leq1\}, \qquad \frac1q+\frac1{q^\ast}=1,

with the usual endpoint conventions. Thus the trace gauge has polar set {A:0AI}\{A:0\preceq A\preceq I\}, the Frobenius gauge is self-polar on S+d\mathbb S_+^d, and the spectral gauge has polar set {A0:tr(A)1}\{A\succeq0:\tr(A)\leq1\}.

Proof

Using the polar representation of γ\gamma,

Wγ(α,β)2=infπΠ(α,β)supABγtr(AMπ).\Wass_\gamma(\alpha,\beta)^2 = \inf_{\pi\in\Couplings(\alpha,\beta)} \sup_{A\in\mathcal B_\gamma} \tr(AM_\pi).

The coupling set is convex and compact for weak convergence under compact support. The polar set Bγ\mathcal B_\gamma is convex and compact, and the map (π,A)tr(AMπ)(\pi,A)\mapsto\tr(AM_\pi) is affine in each variable and continuous. Sion’s minimax theorem gives

infπsupABγtr(AMπ)=supABγinfπtr(AMπ)=supABγW2,A(α,β)2.\inf_\pi\sup_{A\in\mathcal B_\gamma}\tr(AM_\pi) = \sup_{A\in\mathcal B_\gamma}\inf_\pi\tr(AM_\pi) = \sup_{A\in\mathcal B_\gamma}\Wass_{2,A}(\alpha,\beta)^2.

For fixed A0A\succeq0, W2,A\Wass_{2,A} is the Wasserstein pseudodistance associated with the seminorm xA1/2xx\mapsto\norm{A^{1/2}x}. A supremum of pseudodistances is symmetric and satisfies the triangle inequality. If aIBγaI\in\mathcal B_\gamma and AbIA\preceq bI for all ABγA\in\mathcal B_\gamma, then

aW2(α,β)2Wγ(α,β)2bW2(α,β)2,a\Wass_2(\alpha,\beta)^2 \leq \Wass_\gamma(\alpha,\beta)^2 \leq b\Wass_2(\alpha,\beta)^2,

which proves definiteness and equivalence with W2\Wass_2.

For the Ky Fan gauge

γk(M)==1kλ(M),\gamma_k(M)=\sum_{\ell=1}^k\lambda_\ell(M),

where the eigenvalues are sorted in decreasing order, the polar set is

Bγk={A:0AI, tr(A)k}.\mathcal B_{\gamma_k} = \{A:0\preceq A\preceq I,\ \tr(A)\leq k\}.

Thus k=dk=d gives γd(M)=tr(M)\gamma_d(M)=\tr(M) and recovers W2\Wass_2. The convex hull of rank-kk projectors is

{A:0AI, tr(A)=k},\{A:0\preceq A\preceq I,\ \tr(A)=k\},

and, since M0M\succeq0, the associated support function is the same Ky Fan gauge. Thus Wγk\Wass_{\gamma_k} is the convexified spectral counterpart of SRW2,k\operatorname{SRW}_{2,k}, while SRW2,k\operatorname{SRW}_{2,k} keeps the original non-convex rank constraint. More precisely,

SRW2,k(α,β)Wγk(α,β)W2(α,β),kdW2(α,β)Wγk(α,β).\operatorname{SRW}_{2,k}(\alpha,\beta) \leq \Wass_{\gamma_k}(\alpha,\beta) \leq \Wass_2(\alpha,\beta), \qquad \sqrt{\frac{k}{d}}\Wass_2(\alpha,\beta) \leq \Wass_{\gamma_k}(\alpha,\beta).

Indeed, Bγk\mathcal B_{\gamma_k} contains the rank-kk projectors and (k/d)I(k/d)I, and it is contained in {0AI}\{0\preceq A\preceq I\}. For k=1k=1, γ1(M)=λmax(M)\gamma_1(M)=\lambda_{\max}(M) and Bγ1={A0:tr(A)1}\mathcal B_{\gamma_1}=\{A\succeq0:\tr(A)\leq1\}.

Figure Div compares the trace and top-eigenvalue geometries at both levels: the selected transport plans and the displacement interpolations they induce.

<IPython.core.display.Image object>

Trace and spectral gauges for displacement covariances. The trace gauge minimizes the average squared displacement and gives the usual quadratic transport plan. The λmax\lambda_{\max} gauge penalizes the worst projected displacement variance; the displayed plan is obtained by approximating the robust formulation with finitely many directions.

The interactive demo turns the displacement covariance into a visible object. The trace gauge sums both covariance eigenvalues, while the top-eigenvalue gauge cares only about the worst transported direction.

Interactive panel. Use the spectral weights and deformation controls to see how the gauge changes the geometry used to compare measures.

Conditional Wasserstein Distances

Many applications compare probability laws while keeping an external condition fixed: a class label, a time variable, a spatial location, or, later in Section Conditional Wasserstein Training of Infinite ResNets, the depth of a residual network. The resulting geometry is a fiberwise, or conditional, version of optimal transport. It is based on disintegration of measures and is closely related to conditional and constrained variants of transport used in weak transport and conditional simulation Villani, 2009Santambrogio, 2015Backhoff Veraguas et al., 2019Oliver, 2014Barboni et al., 2024.

The recent literature uses this same fiberwise constraint in several complementary directions. Peszek and Poyato study heterogeneous gradient flows in the topology of fibered optimal transport, emphasizing fixed-fiber transport and PDEs with heterogeneities Peszek & Poyato, 2023. Hosseini, Hsu and Taghvaei develop conditional optimal transport on function spaces through triangular maps and Kantorovich relaxations, motivated by amortized Bayesian inference Hosseini et al., 2025. Chemseddine, Hagemann, Steidl and Wald introduce conditional Wasserstein distances for Bayesian inverse problems and OT flow matching, with restricted couplings that compare posterior laws condition by condition Chemseddine et al., 2025. Kerrigan, Migliorini and Smyth give a dynamic conditional OT formulation and use it to build simulation-free conditional flows Kerrigan et al., 2024. The definition below isolates the common geometric core: transport is ordinary within each fiber and forbidden across distinct conditions.

The equality in (158) is not a formal exchange of an infimum and an integral. The stated hypotheses make the fiberwise value measurable and permit measurable selection of optimal plans, or measurable near-optimal selection when minimizers are unavailable. Equivalently, conditional transport is ordinary transport on S×ΩS\times\Omega with an infinite cost for moving mass between different values of ss.

Thus Lcλ\MK_c^\lambda is the general conditional Kantorovich value, whereas Wp,λ\Wass_{p,\lambda} is its metric specialization to the constant family cs=cp=dpc_s=c_p=\dist^p, after taking the ppth root. Equivalently,

Wp,λ(α,β)p=Lcpλ(α,β);\Wass_{p,\lambda}(\alpha,\beta)^p = \MK_{c_p}^\lambda(\alpha,\beta);

the two definitions use exactly the same conditional coupling problem.

Proof

Non-negativity and symmetry follow from the corresponding properties of Wp\Wass_p on each fiber. If Wp,λ(α,β)=0\Wass_{p,\lambda}(\alpha,\beta)=0, then Wp(αs,βs)=0\Wass_p(\alpha_s,\beta_s)=0 for λ\lambda-a.e. ss, hence αs=βs\alpha_s=\beta_s for λ\lambda-a.e. ss and the disintegrated measures α\alpha and β\beta coincide. For the triangle inequality, let γPp,λ(S×Ω)\gamma\in\Pp_{p,\lambda}(S\times\Omega). Since Wp(αs,γs)Wp(αs,βs)+Wp(βs,γs)\Wass_p(\alpha_s,\gamma_s)\leq\Wass_p(\alpha_s,\beta_s)+\Wass_p(\beta_s,\gamma_s) for a.e. ss, Minkowski’s inequality in Lp(S,λ)L^p(S,\lambda) gives

Wp,λ(α,γ)Wp,λ(α,β)+Wp,λ(β,γ).\Wass_{p,\lambda}(\alpha,\gamma) \leq \Wass_{p,\lambda}(\alpha,\beta)+\Wass_{p,\lambda}(\beta,\gamma).

For completeness and separability, identify each measure with the λ\lambda-a.e. equivalence class of the measurable map sαsPp(Ω)s\mapsto\alpha_s\in\mathcal P_p(\Omega). The conditional distance is exactly the metric of Lp(S,λ;Pp(Ω))L^p(S,\lambda;\mathcal P_p(\Omega)). Since (Pp(Ω),Wp)(\mathcal P_p(\Omega),\Wass_p) is Polish, so is this metric-valued LpL^p space.

Proof

For 0rt10\leq r\leq t\leq1, the fiberwise geodesic property gives

Wp(αr,s,αt,s)=(tr)Wp(α0,s,α1,s)for λ-a.e. s.\Wass_p(\alpha_{r,s},\alpha_{t,s}) = (t-r)\Wass_p(\alpha_{0,s},\alpha_{1,s}) \quad\text{for }\lambda\text{-a.e. }s.

Integrating the ppth power over SS gives

Wp,λ(αr,αt)=(tr)Wp,λ(α0,α1).\Wass_{p,\lambda}(\alpha_r,\alpha_t) = (t-r)\Wass_{p,\lambda}(\alpha_0,\alpha_1).

Hence the conditional curve has constant speed and realizes the distance between its endpoints. In Euclidean space one may take, for each ss, an optimal plan πsΠ(α0,s,α1,s)\pi_s\in\Couplings(\alpha_{0,s},\alpha_{1,s}) and set αt,s=((1t)p1+tp2)πs\alpha_{t,s}=((1-t)\mathrm p_1+t\mathrm p_2)_\sharp\pi_s, where p1,p2\mathrm p_1,\mathrm p_2 are the two coordinate projections. On a general geodesic space, the same construction uses a measurable family of optimal dynamical plans; when geodesics are non-unique, different measurable selections can produce different conditional geodesics.

References
  1. Liero, M., Mielke, A., & Savaré, G. (2018). Optimal entropy-transport problems and a new Hellinger–Kantorovich distance between positive measures. Inventiones Mathematicae, 211(3), 969–1117.
  2. Chizat, L., Peyré, G., Schmitzer, B., & Vialard, F.-X. (2018). Unbalanced optimal transport: dynamic and Kantorovich formulation. Journal of Functional Analysis, 274(11), 3090–3123.
  3. Chizat, L., Schmitzer, B., Peyré, G., & Vialard, F.-X. (2018). An interpolating distance between optimal transport and Fisher–Rao metrics. Foundations of Computational Mathematics, 18(1), 1–44.
  4. Caffarelli, L. A., & McCann, R. J. (2010). Free boundaries in optimal transport and Monge-Ampère obstacle problems. Annals of Mathematics, 171(2), 673–730.
  5. Figalli, A. (2010). The optimal partial transport problem. Archive for Rational Mechanics and Analysis, 195(2), 533–560.
  6. Chapel, L., Alaya, M. Z., & Gasso, G. (2020). Partial Optimal Transport with Applications on Positive-Unlabeled Learning. arXiv Preprint arXiv:2002.08276.
  7. Lübeck, F., Bunne, C., Gut, G., Sarabia del Castillo, J., Pelkmans, L., & Alvarez-Melis, D. (2022). Neural Unbalanced Optimal Transport via Cycle-Consistent Semi-Couplings. arXiv Preprint arXiv:2209.15621. https://arxiv.org/abs/2209.15621
  8. Klein, D., Uscidda, T., Theis, F., & Cuturi, M. (2024). GENOT: Entropic (Gromov) Wasserstein Flow Matching with Applications to Single-Cell Genomics. Advances in Neural Information Processing Systems, 37. 10.52202/079017-3301
  9. Rabin, J., Peyré, G., Delon, J., & Bernot, M. (2011). Wasserstein barycenter and its application to texture mixing. International Conference on Scale Space and Variational Methods in Computer Vision, 435–446.
  10. Nadjahi, K., Durmus, A., Simsekli, U., & Badeau, R. (2019). Asymptotic Guarantees for Learning Generative Models with the Sliced-Wasserstein Distance. Advances in Neural Information Processing Systems.
  11. Cramér, H., & Wold, H. (1936). Some Theorems on Distribution Functions. Journal of the London Mathematical Society, s1-11(4), 290–294. 10.1112/jlms/s1-11.4.290
  12. Bonnotte, N. (2013). Unidimensional and Evolution Methods for Optimal Transportation [Phdthesis, Université Paris-Sud]. https://theses.hal.science/tel-00946781v1
  13. Carlier, G., Figalli, A., Mérigot, Q., & Wang, Y. (2025). Sharp Comparisons between Sliced and Standard 1-Wasserstein Distances. arXiv Preprint arXiv:2510.16465. 10.48550/arXiv.2510.16465
  14. Park, S., & Slepčev, D. (2025). Geometry and Analytic Properties of the Sliced Wasserstein Space. Journal of Functional Analysis, 289(7), 110975. 10.1016/j.jfa.2025.110975
  15. Deshpande, I., Hu, Y.-T., Sun, R., Pyrros, A., Siddiqui, N., Koyejo, S., Zhao, Z., Forsyth, D. A., & Schwing, A. G. (2019). Max-Sliced Wasserstein Distance and Its Use for GANs. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 10648–10656.