Skip to article frontmatterSkip to article content
Site not loading correctly?

This may be due to an incorrect BASE_URL configuration. See the MyST Documentation for reference.

Monge Problem between Measures

The goal of this chapter is to pass from finite matching to transport between arbitrary probability laws. The central stakes are to define measures, push-forwards and Monge maps carefully enough that the discrete picture survives, while exposing why deterministic maps can fail to exist. Monge’s original formulation Monge, 1781 and modern treatments Villani, 2003Villani, 2009Santambrogio, 2015Rachev & Rüschendorf, 1998 are the conceptual background for this transition.

The previous chapter handled two sets with the same number of points. To relax this to a more general setting, one needs probability distributions, so that points may carry unequal masses and continuous densities can be treated in the same language as finite clouds.

Measures

Measures are the language that lets point clouds, densities and singular objects be handled uniformly. We only recall the facts needed later: integration, total variation, densities and probabilistic laws.

Histograms

Discrete And Empirical Measures

The Dirac mass should be thought of as a unit of mass infinitely concentrated at one location.

An empirical probability distribution is uniform on a point cloud,

α=1ni=1nδxi.\al=\frac1n\sum_{i=1}^n\delta_{x_i}.

In applications, it is useful to manipulate both the positions xix_i and the weights aia_i. Moving the positions is a Lagrangian discretization; changing the weights is an Eulerian one. The Lagrangian view is often more adaptive, but it tends to break convexity.

General Measures

We write M(X)\Mm(\X) for the finite signed Borel measures on a metric space (X,d)(\Xx,d). The Borel sets form the smallest σ\sigma-algebra containing the open subsets of X\Xx, obtained by closing the open sets under complements and countable unions. Unless otherwise stated, all measures are finite.

A Dirac measure is defined by δx(A)=1\delta_x(A)=1 if xAx\in A and 0 otherwise. For the discrete measure above,

α(A)=xiAai.\al(A)=\sum_{x_i\in A} a_i .

We denote by M+(X)\Mm_+(\X) the set of positive finite measures on X\X and by M+1(X)\Mm_+^1(\X) the set of probability measures, i.e. positive measures of total mass one.

Polish Metric Spaces

Many measure-theoretic statements used later require a mild regularity assumption on the underlying space. The point is not to restrict applications, since Euclidean spaces, complete separable manifolds and separable Hilbert spaces are covered, but to exclude pathological measurable spaces where disintegration, tightness or weak convergence can fail to behave properly.

This assumption already includes genuinely infinite-dimensional spaces. In the Euclidean dynamical formulations used later, the path space

S=C([0,1];Rd),d(γ,η):=supt[0,1]γ(t)η(t).\Ss=C([0,1];\RR^d),\qquad d_\infty(\gamma,\eta) \eqdef \sup_{t\in[0,1]}\|\gamma(t)-\eta(t)\|.

is Polish. Completeness follows because a uniformly Cauchy sequence of continuous paths converges uniformly to a continuous path, and separability follows by approximating paths uniformly by piecewise-linear paths with rational breakpoints and rational values. This example is used later as the state space for laws of trajectories: the endpoint evaluation maps are continuous on S\Ss, which makes endpoint constraints well behaved for dynamical optimal plans and Schrodinger bridges; see the path-space formulation in Path-Space Formulation and Section Path-Space Schrodinger Problem.

Polish spaces are the natural ambient category for probability measures. Borel probability measures on them are regular, tightness gives compactness criteria, regular conditional probabilities and disintegrations exist under standard assumptions, and Wasserstein spaces remain Polish; see Proposition Proposition: Wasserstein Spaces As Ground Spaces.

Radon Measures

A positive Borel measure is Radon if it is inner regular, meaning that the mass of every Borel set is the supremum of the masses of its compact subsets. Every finite Borel measure on a Polish space is Radon. Such a measure integrates measurable functions, and we write the pairing as

f,α:=f(x)dα(x).\langle f,\al\rangle \eqdef \int f(x)\d\al(x).

For a discrete measure this becomes

Xf(x)dα(x)=i=1naif(xi).\int_\X f(x)\d\al(x)=\sum_{i=1}^n a_i f(x_i).

Integration against a finite measure on a compact space defines a continuous linear form on the Banach space (C(X),)(\Cc(\Xx),\|\cdot\|_\infty), since fdαfα(X)|\int f\d\al|\leq \|f\|_\infty |\al|(\Xx). Conversely, the Riesz--Markov--Kakutani representation theorem identifies every continuous linear form on C(X)\Cc(\Xx) with integration against a finite signed Radon measure Rudin, 1987Bogachev, 2007. This is the duality M(X)=C(X)\Mm(\Xx)=\Cc(\Xx)^* that later supports convex duality.

Relative Densities

On Rd\RR^d the reference λ\lambda is often Lebesgue measure dx\d x.

Total Variation

The norm inherited from the duality M(X)=C(X)\Mm(\Xx)=\Cc(\Xx)^* is the total variation norm.

The absolute value of a signed measure is

α(A):=supA=iBiiα(Bi),|\al|(A) \eqdef \sup_{A=\cup_i B_i}\sum_i |\al(B_i)|,

where the supremum is over finite or countable measurable partitions of AA. If α=iaiδxi\al=\sum_i a_i\delta_{x_i} with distinct atoms, then α=iaiδxi|\al|=\sum_i |a_i|\delta_{x_i}. If dα(x)=ρ(x)dλ(x)\d\al(x)=\rho(x)\d\lambda(x), then dα(x)=ρ(x)dλ(x)\d|\al|(x)=|\rho(x)|\d\lambda(x).

Proof

The inequality αTVα(X)\|\al\|_{\TV}\leq|\al|(\Xx) follows from

fdαfdαfα(X).\left|\int f\d\al\right| \leq \int |f|\d|\al| \leq \|f\|_\infty |\al|(\Xx).

For the reverse inequality, write the Jordan decomposition α=α+α\al=\al^+-\al^-. The measurable sign s=dα/dαs=\d\al/\d|\al| takes values in {1,1}\{-1,1\} outside a null set and satisfies dα=sdα\d\al=s\d|\al|. By regularity of Radon measures on compact spaces, ss can be approximated in L1(α)L^1(|\al|) by continuous functions fkf_k with fk1\|f_k\|_\infty\leq1. Hence fkdαsdα=α(X)\int f_k\d\al\to\int s\d\al=|\al|(\Xx).

For absolutely continuous measures dα=ραdλ\d\al=\rho_\al\d\lambda and dβ=ρβdλ\d\be=\rho_\be\d\lambda,

αβTV=Xρα(x)ρβ(x)dλ(x).\|\al-\be\|_{\TV} = \int_\Xx |\rho_\al(x)-\rho_\be(x)|\d\lambda(x).

For two discrete measures, one first recasts both measures as weight vectors on the same finite support. If

α=i=1na~iδxi,β=j=1mb~jδyj,\al=\sum_{i=1}^n \tilde a_i\delta_{x_i}, \qquad \be=\sum_{j=1}^m \tilde b_j\delta_{y_j},

let z1,,zrz_1,\ldots,z_r be the distinct points in the union {xi}i{yj}j\{x_i\}_i\cup\{y_j\}_j and set

ak=i:xi=zka~i,bk=j:yj=zkb~j.a_k=\sum_{i:x_i=z_k}\tilde a_i, \qquad b_k=\sum_{j:y_j=z_k}\tilde b_j.

Then α=k=1rakδzk\al=\sum_{k=1}^r a_k\delta_{z_k} and β=k=1rbkδzk\be=\sum_{k=1}^r b_k\delta_{z_k}. This convention merges masses located at the same point before comparing the two measures. If the two input supports are already enumerated without repetitions and are disjoint, this simply amounts to taking (zk)k=(x1,,xn,y1,,ym)(z_k)_k=(x_1,\ldots,x_n,y_1,\ldots,y_m) and padding the weights as a=(a~,0m)a=(\tilde a,0_m) and b=(0n,b~)b=(0_n,\tilde b). With this common-support notation,

αβTV=k=1rakbk.\|\al-\be\|_{\TV}=\sum_{k=1}^r |a_k-b_k|.

Probabilistic Interpretation

Probability measures represent laws of random variables. Let (Ω,F,P)(\Omega,\Ff,\PP) be an abstract probability space and let X\X be Polish. A random variable with values in X\X is a measurable map X:(Ω,F)(X,B(X))X:(\Omega,\Ff)\to(\X,\Bb(\X)), or simply X:ΩXX:\Omega\to\X once the measurable structures are understood. Its law is the Radon probability measure α=XP\al=X_\sharp\PP defined by

α(A)=P{ωΩ:X(ω)A}.\al(A)=\PP\{\omega\in\Omega : X(\omega)\in A\}.

For every integrable ff, integration with respect to the law is expectation:

Xf(x)dα(x)=E[f(X)].\int_\X f(x)\d\al(x)=\mathbb{E}[f(X)].

Push Forward

Push-forwards encode how maps move mass. This short section is the bridge between deterministic maps and linear operations on measures.

For a measurable map T:XY\T:\X\to\Y, the push-forward operator T:M(X)M(Y)\T_\sharp:\Mm(\X)\to\Mm(\Y) records the distribution of image points. It sends a Dirac mass to Tδx=δT(x)\T_\sharp\delta_x=\delta_{\T(x)}. For discrete measures,

Tα=iaiδT(xi).\T_\sharp\al=\sum_i a_i\delta_{\T(x_i)}.

The operation is linear in the input measure, although its definition for a general measure uses inverse images rather than a decomposition into Dirac masses. Moving from T\T to T\T_\sharp thus linearizes the action of a map at the price of moving from X\Xx to the measure space M(X)\Mm(\Xx).

Proof

Apply the push-forward identity to a compactly supported continuous function hh and use the change of variables y=T(x)y=\T(x):

Vh(y)ρβ(y)dy=Uh(T(x))ρα(x)dx=Vh(y)ρα(T1y)dydet(T(T1y)).\begin{aligned} \int_V h(y)\rho_\be(y)\d y &= \int_U h(\T(x))\rho_\al(x)\d x \\ &= \int_V h(y)\rho_\al(\T^{-1}y) \frac{\d y}{|\det(\T'(\T^{-1}y))|}. \end{aligned}

Uniqueness of Lebesgue densities gives the target-variable identity; setting y=T(x)y=\T(x) gives the source-variable formula.

Figure Div makes the determinant factor visible. Even when the source density is uniform, nonlinear diffeomorphisms can compress area around one or several centers and expand it elsewhere; the target density is therefore not obtained by the naive composition ραT1\rho_\al\circ\T^{-1} alone. The high-density bumps appear exactly where the deformed grid cells have small area.

<IPython.core.display.Image object>

Jacobian determinant in the density push-forward formula. The three panels show smooth diffeomorphisms that strongly compress a uniform source grid around one, three, and five centers. The deformed grid is drawn as a dense red mesh, and the pushed density is shown through black level sets of ρβ(y)=detT(T1y)1\density{\be}(y)=|\det\T'(\T^{-1}y)|^{-1}. The tighter crop focuses on the bump region, where small grid cells coincide with large values of the pushed density.

Interactive panel. Change the compression strength, width, and residual rotation to see how the determinant controls the density amplification.

Monge’s Formulation

Monge’s problem asks for a deterministic map transporting one law onto another while minimizing a prescribed cost. It is geometrically direct, because every source point is assigned one destination, but analytically fragile: the feasible set is non-convex, it can be empty, and a map cannot split mass. These limitations motivate Kantorovich’s relaxation in the next chapter.

Monge Problem

Given αM+1(X)\al\in\Mm_+^1(\Xx), βM+1(Y)\be\in\Mm_+^1(\Yy) and a nonnegative measurable cost c:X×Y[0,+]c:\Xx\times\Yy\to[0,+\infty], the Monge problem is

Mc(α,β):=infT:XY measurable{Xc(x,T(x))dα(x)  :  Tα=β}.\Monge_c(\al,\be) \eqdef \inf_{\T:\Xx\to\Yy\,\text{ measurable}} \left\{ \int_\Xx c(x,\T(x))\d\al(x) \;:\; \T_\sharp\al=\be \right\}.

The constraint Tα=β\T_\sharp\al=\be means that T\T pushes the mass of α\al onto β\be. By convention, the infimum is ++\infty when no feasible map exists.

Proof

The push-forward condition implies that all images T(xi)\T(x_i) belong to the support of β\be. For any target atom zz,

β({z})=α(T1({z}))=1n#{i:T(xi)=z}.\be(\{z\}) = \al(\T^{-1}(\{z\})) = \frac1n\#\{i:\T(x_i)=z\}.

This proves the counting statement. If every target atom has mass 1/n1/n, each target receives exactly one source atom, hence a permutation. The converse and the cost identity follow by direct substitution.

Proof

A standard measure-isomorphism theorem identifies the atomless standard probability space (X,α)(\Xx,\al) with ([0,1],Leb)([0,1],\mathrm{Leb}) modulo null sets Bogachev, 2007. Since the Polish target is a standard Borel space, choose a Borel isomorphism from a full-β\be Borel subset of Y\Yy onto a Borel subset of [0,1][0,1]. The generalized quantile of the pushed law sends Lebesgue measure to that law. Composing with the inverse Borel isomorphism and the source isomorphism gives the desired transport map, after arbitrary definitions on discarded null sets.

<IPython.core.display.Image object>

Semi-discrete Monge maps. The red contours show the continuous source density α\al. The colored regions extend the numerical Laguerre cells over the whole displayed domain, while their masses are computed with respect to α\al. The circular atoms form the discrete target β\be. Their colors are tied to horizontal position, with a small random perturbation, and are reused for the cells. Faint segments connect cell barycenters to their images under the piecewise-constant Monge map.

Interactive panel. Vary the target masses, source density and number of dual-weight updates to see how ordinary Voronoi cells deform into Laguerre cells with the prescribed semi-discrete masses.

The next figure shows a finite-dimensional instance of this deterministic viewpoint. The source and target measures are empirical color clouds in RGB space, and the map transports colors while leaving pixel positions fixed. Grayscale equalization is one-dimensional, but full palette transfer requires transporting empirical measures in a three-dimensional color space. Early methods used affine statistics or iterated one-dimensional projections Reinhard et al., 2001Pitié et al., 2005; replacing these projections by a three-dimensional OT map gives a more intrinsic palette match Rabin et al., 2011.

Figure Div shows a finite-dimensional instance of this deterministic viewpoint.

<IPython.core.display.Image object>

Color transfer as a Monge map in RGB space, from a beach photograph to a flower photograph. The top row applies the palette map to the source image; the bottom row shows the empirical color clouds in the RGB cube. Only colors are transported here, not pixel locations.

Interactive panel. Use the interpolation, resolution, target palette, and contrast controls to replay the RGB color transport while keeping pixel locations fixed.

Monge Distance

When X=Y\Xx=\Yy, 1p<+1\leq p<+\infty and c(x,y)=d(x,y)pc(x,y)=d(x,y)^p for a metric dd, set

Eα(T):=Xd(x,T(x))pdα(x).\mathcal{E}_\al(\T) \eqdef \int_\Xx d(x,\T(x))^p\d\al(x).

The Monge value defines the directed quantity

W~p(α,β)p:=infT:XX measurable{Eα(T)  :  Tα=β}.\widetilde{\Wass}_p(\al,\be)^p \eqdef \inf_{\T:\Xx\to\Xx\,\text{ measurable}} \left\{ \mathcal{E}_\al(\T) \;:\; \T_\sharp\al=\be \right\}.

If the constraint set is empty, then W~p(α,β)=+\widetilde{\Wass}_p(\al,\be)=+\infty.

Proof

Nonnegativity is immediate. If W~p(α,β)=0\widetilde{\Wass}_p(\al,\be)=0, choose feasible maps Tk\T_k with d(x,Tk(x))pdα(x)0\int d(x,\T_k(x))^p\d\al(x)\to0. For every bounded 1-Lipschitz function hh,

hdβhdα=h(Tk(x))h(x)dα(x)(d(x,Tk(x))pdα(x))1/p0.\left|\int h\d\be-\int h\d\al\right| = \left|\int h(\T_k(x))-h(x)\d\al(x)\right| \leq \left(\int d(x,\T_k(x))^p\d\al(x)\right)^{1/p} \to0.

Since bounded Lipschitz functions separate probability measures on Polish spaces, α=β\al=\be. The identity map proves the converse.

If either term on the right of the triangle inequality is infinite, there is nothing to prove. Otherwise take ϵ\epsilon-minimizers Sα=γS_\sharp\al=\ga and Tγ=βT_\sharp\ga=\be. The composition TST\circ S is feasible from α\al to β\be, and Minkowski’s inequality gives

W~p(α,β)Eα(S)1/p+Eγ(T)1/pW~p(α,γ)+W~p(γ,β)+2ϵ.\widetilde{\Wass}_p(\al,\be) \leq \mathcal{E}_\al(S)^{1/p} + \mathcal{E}_\ga(T)^{1/p} \leq \widetilde{\Wass}_p(\al,\ga) + \widetilde{\Wass}_p(\ga,\be) + 2\epsilon .

Letting ϵ0\epsilon\to0 proves the result.

The directed value W~p\widetilde{\Wass}_p is useful conceptually, but it is too rigid to be the main distance between measures: it can be infinite and asymmetric. Kantorovich’s formulation remedies both issues by replacing maps with couplings.

Existence And Uniqueness Of The Monge Map

This section records the main regimes where Monge’s deterministic formulation becomes well posed. Brenier’s theorem is the central result: for the squared Euclidean cost, absolute continuity of the source restores existence, uniqueness and convex-potential structure.

Brenier’s Theorem

Brenier’s theorem Brenier, 1987Brenier, 1991 ensures that in Rd\RR^d, for the quadratic cost, absolute continuity of the source is enough for Monge’s problem to have a unique solution. It also gives the decisive structural description: the optimal map is the gradient of a convex potential.

Proof Sketch

The proof uses Kantorovich relaxation and duality, developed later in the book. Choose optimal cc-concave potentials (f,g)(f,g) and set ϕ(x)=x2/2f(x)/2\phi(x)=\|x\|^2/2-f(x)/2. Then ϕ\phi is convex, and complementary slackness is equivalent to the Fenchel equality ϕ(x)+ϕ(y)=x,y\phi(x)+\phi^*(y)=\langle x,y\rangle, or yϕ(x)y\in\partial\phi(x), for almost every pair under an optimal plan. Since α\al has a density and convex functions are differentiable Lebesgue-almost everywhere, ϕ(x)={ϕ(x)}\partial\phi(x)=\{\nabla\phi(x)\} for α\al-almost every xx. Every optimal plan is therefore concentrated on the same graph, proving existence and uniqueness of the Brenier map.

Brenier’s theorem is the higher-dimensional analogue of the one-dimensional monotone rearrangement theorem. In one dimension, the derivative of a convex function is an increasing map; in several dimensions, the corresponding object is the gradient of a convex function. Such gradients are monotone fields:

ϕ(x)ϕ(x),xx0.\langle \nabla\phi(x)-\nabla\phi(x'),x-x'\rangle\geq0.

Radial Measures

Radial symmetry gives a useful higher-dimensional case where the Brenier map reduces to a one-dimensional monotone rearrangement. A measure α\al on Rd\RR^d is radial if Qα=αQ_\sharp\al=\al for every orthogonal map QQ. Such a measure is determined by the law of the radius x\norm{x}, and the optimal map transports this radius while keeping the angular direction fixed.

Proof

Let αR=()α\al_R=(\norm{\cdot})_\sharp\al and βR=()β\be_R=(\norm{\cdot})_\sharp\be be the radial laws. Since α\al is absolutely continuous, αR\al_R has no atoms. The map τ=Fβ1Fα\tau=F_\be^{-1}\circ F_\al is therefore the monotone one-dimensional transport from αR\al_R to βR\be_R. If XαX\sim\al and R=XR=\norm{X}, then τ(R)\tau(R) has law βR\be_R. Moreover, by radiality, the conditional direction X/XX/\norm{X} given R=rR=r is uniform on the sphere for αR\al_R-a.e. r>0r>0. Thus T\T changes only the radius, from RR to τ(R)\tau(R), and keeps the uniform angular distribution. It follows that Tα\T_\sharp\al is radial with radial law βR\be_R, hence Tα=β\T_\sharp\al=\be.

It remains to check optimality. The function τ\tau is nondecreasing and nonnegative. Define ψ(r):=0rτ(s)ds\psi(r)\eqdef\int_0^r\tau(s)\d s on R+\RR_+. Then ψ\psi is convex and nondecreasing, so ϕ(x):=ψ(x)\phi(x)\eqdef\psi(\norm{x}) is convex on Rd\RR^d. Since α\al is absolutely continuous, it does not charge the origin nor the radii where the monotone function τ\tau is discontinuous. Thus

ϕ(x)=τ(x)xx=T(x)for α-a.e. x.\nabla\phi(x)=\frac{\tau(\norm{x})}{\norm{x}}x =\T(x) \qquad\text{for }\al\text{-a.e. }x.

The map T\T is therefore a gradient of a convex potential and pushes α\al to β\be. Brenier’s theorem identifies it as the unique quadratic optimal Monge map. The displayed cost formula follows by substituting T(x)\T(x) in xT(x)2dα(x)\int\norm{x-\T(x)}^2\d\al(x).

If α\al is not absolutely continuous, the same radial idea is still useful but has to be interpreted at the level of couplings of the radial variables: atoms on spheres may have to be split, so a Monge map need not exist.

Polar Factorization

Brenier’s theorem provides a canonical way to extract the monotone part of a nondegenerate square-integrable map u:ΩRdu:\Omega\to\RR^d. Its law β=uλ\be=u_\sharp\lambda records where the mass ends up, but forgets how the points of Ω\Omega were labelled. Brenier’s polar factorization Brenier, 1987Brenier, 1991 separates these effects: a measure-preserving rearrangement changes labels, then the unique convex-gradient map sends the uniform source to the output law.

Proof

Let T=ϕ\T=\nabla\phi be the Brenier map from λ\lambda to β\be and let SS be the reverse Brenier map. The two maps are inverse almost everywhere. Hence s=Sus=S\circ u satisfies sλ=λs_\sharp\lambda=\lambda and Ts=u\T\circ s=u almost everywhere. The same inverse identity gives uniqueness.

Absolute continuity is a sufficient form of Brenier’s nondegeneracy hypothesis. Without such a hypothesis, deterministic polar factorization may fail or be nonunique.

Figure Div separates these two factors on a colored grid. Its three panels display xx, s(x)s(x), and u(x)=(ϕs)(x)u(x)=(\nabla\phi\circ s)(x). The map ss swirls the square grid while preserving area, whereas ϕ\nabla\phi is a symmetric positive definite affine map and hence the gradient of a convex quadratic potential.

<IPython.core.display.Image object>

Polar factorization as a relabeling followed by a Brenier map. From left to right, the panels show xx, s(x)s(x) with sλ=λs_\sharp\lambda=\lambda, and u(x)=ϕ(s(x))u(x)=\nabla\phi(s(x)). Here ss is generated by the area-preserving flow of a divergence-free Hamiltonian vector field, while the Brenier factor is the symmetric positive definite affine map ϕ(z)=Bz\nabla\phi(z)=Bz. Faint arrows indicate the successive maps.

Interactive panel. Vary the area-preserving swirl and the SPD stretch to separate relabeling from the Brenier factor.

For linear maps under a Gaussian reference, this reduces to the usual matrix polar decomposition. If XN(0,Id)X\sim\Gaussian(0,\Id) and u(x)=Axu(x)=Ax, then uN(0,Id)=N(0,AA)u_\sharp\Gaussian(0,\Id)=\Gaussian(0,AA^\top). The Brenier map from N(0,Id)\Gaussian(0,\Id) to this Gaussian is xSxx\mapsto Sx, where S=(AA)1/2S=(AA^\top)^{1/2} is symmetric positive semidefinite. Hence

A=SO.A=SO.

When AA is invertible, O=S1AO=S^{-1}A is orthogonal. In the singular square case, SAS^\dagger A is only a partial isometry and must be extended on its kernel to an orthogonal matrix OO before OxOx preserves the full standard Gaussian law. The factor SxSx is the convex-gradient transport part, whereas OxOx is the measure-preserving relabeling.

Displacement Interpolation

An optimal map does not only match two endpoint measures; it tells how to draw a path between them. Each particle keeps its identity and travels at constant speed from its initial position to its image.

Proof

For s<ts<t, define Ss,t=TtTs1S_{s,t}=\T_t\circ\T_s^{-1} along transported particles. Then (Ss,t)αs=αt(S_{s,t})_\sharp\al_s=\al_t and

W~p(αs,αt)pTt(x)Ts(x)pdα(x)=(ts)pW~p(α,β)p.\widetilde{\Wass}_p(\al_s,\al_t)^p \leq \int \|\T_t(x)-\T_s(x)\|^p\d\al(x) = (t-s)^p\widetilde{\Wass}_p(\al,\be)^p.

The reverse inequality follows by applying the triangle inequality to the three legs ααsαtβ\al\to\al_s\to\al_t\to\be. For a Brenier map T=ϕ\T=\nabla\phi, Tt\T_t is the gradient of (1t)x2/2+tϕ(x)(1-t)\|x\|^2/2+t\phi(x), which is strongly convex for every t<1t<1 and hence injective on the differentiability set of ϕ\phi.

Figure Div illustrates this displacement geodesic on two non-convex silhouettes, both through representative particle paths and through the evolving transported density.

<IPython.core.display.Image object>

McCann displacement interpolation between a cat silhouette and a heart silhouette. The first row displays a small farthest-point subset of transported particles along Tt(x)=(1t)x+tT(x)T_t(x)=(1-t)x+tT(x). The second row renders kernel-smoothed densities from a denser transported cloud as color images: white means zero density, while high density saturates in the red-to-blue interpolation color of the corresponding time.

Interactive panel. Use the interpolation and particle controls to compare the particle motion with the evolving density during McCann displacement interpolation.

Regularity And The Monge-Ampere Equation

The previous results identify the optimal map. Regularity theory asks when this map is a classical smooth deformation rather than only an almost-everywhere gradient. For quadratic costs this becomes the regularity theory of the Monge--Ampere equation.

Proof Sketch

The potential solves the Monge--Ampere equation

det(2ϕ(x))=ρ(x)η(ϕ(x))\det(\nabla^2\phi(x)) = \frac{\rho(x)}{\eta(\nabla\phi(x))}

in the Alexandrov sense, with second boundary condition ϕ(Ω)=Λ\nabla\phi(\Omega)=\Lambda. Density bounds and convexity of the domains give strict convexity and localization of sections. Caffarelli’s interior theory then yields the Cloc2,αC^{2,\alpha}_{\mathrm{loc}} estimates Caffarelli, 2003Villani, 2009.

Figure Div illustrates the geometric role of the convexity assumption through a finite-sample stress test rather than a counterexample. A quadratic assignment transports a dense farthest-point sample of the disk to a dense farthest-point sample of a connected non-convex target made of two disks joined by a thin rectangle. The panels show the corresponding empirical McCann interpolation, so the loss of convex target geometry is visible directly along the transported particles.

<IPython.core.display.Image object>

Empirical quadratic OT interpolation from a disk to a connected non-convex two-disk domain. A 5200-point farthest-point sample of the disk is matched to a 5200-point farthest-point sample of two disks connected by a thin rectangle. The panels display (1t)xi+tTN(xi)(1-t)x_i+tT_N(x_i) for the empirical optimal assignment TNT_N. Colors are inherited from the horizontal coordinate of xix_i in the initial disk, making the transported material regions visible throughout the interpolation.

Interactive panel. Change the neck strength and number of displayed rings to see how a smooth source foliation bends when the target develops a non-convex throat.

For smooth densities, the change-of-variables formula gives the Monge--Ampere equation

det(2ϕ(x))ρβ(ϕ(x))=ρα(x).\det(\nabla^2\phi(x))\density{\be}(\nabla\phi(x)) = \density{\al}(x).

With suitable boundary conditions, this characterizes the Brenier potential up to an additive constant among convex solutions. The convexity constraint forces det(2ϕ(x))0\det(\nabla^2\phi(x))\geq0 and is necessary for this fully nonlinear elliptic equation to be well posed.

The following proposition records the infinitesimal form.

Proof

The change-of-variables equation for Tϵ\T_\epsilon is

ρ0(x)=ρϵ(Tϵ(x))det(Tϵ(x)).\rho_0(x) = \rho_\epsilon(\T_\epsilon(x))\det(\nabla\T_\epsilon(x)).

Expanding ρϵ(x+ϵu)=ρ0(x)+ϵr(x)+ϵρ0,u+o(ϵ)\rho_\epsilon(x+\epsilon\nabla u)=\rho_0(x)+\epsilon r(x)+ \epsilon\langle\nabla\rho_0,\nabla u\rangle+o(\epsilon) and

det(I+ϵ2u)=1+ϵΔu+o(ϵ)\det(I+\epsilon\nabla^2u)=1+\epsilon\Delta u+o(\epsilon)

gives

ρ0=ρ0+ϵ(r+(ρ0u))+o(ϵ).\rho_0 = \rho_0 + \epsilon\left(r+\nabla\cdot(\rho_0\nabla u)\right) + o(\epsilon).

The first-order term must vanish.

Beyond The Quadratic Euclidean Cost

The quadratic Euclidean cost is the model case, but optimal-map theory also covers many non-quadratic costs. The key point is to separate three roles: a convexity-like structure gives potentials, a twist condition prevents splitting, and curvature-type conditions give regularity.

WpW_p Costs

The quadratic cost is special because it identifies the optimal map with the Euclidean gradient of an ordinary convex potential. For the Wasserstein cost, normalized as c(x,y)=xyp/pc(x,y)=\norm{x-y}^p/p with p>1p>1, the same Monge-map picture survives, but the potential is adapted to the cost. More generally, for c(x,y)=h(xy)c(x,y)=h(x-y) with hh smooth and strictly convex, absolute continuity of the source again rules out splitting and yields a unique optimal map. This map is characterized by a cc-convex potential ff: at differentiability points of ff,

f(x)=xc(x,T(x)).\nabla f(x)=\nabla_x c(x,\T(x)).

For c(x,y)=xyp/pc(x,y)=\norm{x-y}^p/p, this gives the explicit relation

T(x)=xf(x)q2f(x),1p+1q=1.\T(x)=x-\norm{\nabla f(x)}^{q-2}\nabla f(x), \qquad \frac1p+\frac1q=1.

Thus the Brenier formula T=ϕ\T=\nabla\phi should be read as the quadratic representative of a broader cc-convex theory. The Euclidean theory for strictly convex displacement costs is developed in Gangbo--McCann’s work on the geometry of optimal transportation Gangbo & McCann, 1996; see also the general treatment in Villani, 2009.

Squared Geodesic Distance

On a Riemannian manifold, the natural analogue of the quadratic Euclidean cost is the squared geodesic distance c(x,y)=dM(x,y)2/2c(x,y)=d_M(x,y)^2/2. The optimal map is no longer written with a vector-space subtraction, but with the exponential map

T(x)=expx(ϕ(x)),\T(x)=\exp_x(-\nabla\phi(x)),

where ϕ\phi is cc-convex. This is the intrinsic version of the formula T=xϕT=x-\nabla\phi in normal coordinates. The main additional issues are the cut locus, possible non-uniqueness of minimizing geodesics, and regularity of the exponential map, which is why the Euclidean statement is usually presented first. The Riemannian polar-factorization theorem of McCann McCann, 2001 gives the corresponding optimal-map framework, and these ideas feed into displacement convexity and the general manifold theory of optimal transport McCann, 1997Villani, 2009.

Figure Div makes this intrinsic interpolation explicit on the closed upper hemisphere M=S+2={xR3:x=1, x30}M=\mathbb S^2_+=\{x\in\mathbb R^3:\|x\|=1,\ x_3\geq0\}. Consider two equal-weight empirical measures α=n1iδxi\alpha=n^{-1}\sum_i\delta_{x_i} and β=n1jδyj\beta=n^{-1}\sum_j\delta_{y_j} and the intrinsic cost

Cij=12dS2(xi,yj)2=12arccos ⁣(xi,yj)2.C_{ij}=\frac12d_{\mathbb S^2}(x_i,y_j)^2 =\frac12\arccos\!\bigl(\langle x_i,y_j\rangle\bigr)^2.

The Birkhoff--von Neumann theorem gives an optimal permutation coupling Pi,σ(i)=1/nP^\star_{i,\sigma(i)}=1/n. For a non-antipodal matched pair, let

ϑi=arccos ⁣(xi,yσ(i)),γi(t)=sin((1t)ϑi)sinϑixi+sin(tϑi)sinϑiyσ(i).\vartheta_i=\arccos\!\bigl(\langle x_i,y_{\sigma(i)}\rangle\bigr), \qquad \gamma_i(t) =\frac{\sin((1-t)\vartheta_i)}{\sin\vartheta_i}x_i +\frac{\sin(t\vartheta_i)}{\sin\vartheta_i}y_{\sigma(i)}.

Each γi\gamma_i is a constant-speed minimizing spherical geodesic, and αt=n1iδγi(t)\alpha_t=n^{-1}\sum_i\delta_{\gamma_i(t)} is the intrinsic McCann interpolation. The paths stay in the hemisphere because both sine coefficients are nonnegative on [0,1][0,1].

<IPython.core.display.Image object>

Intrinsic McCann interpolation on the upper hemisphere. The thin violet great-circle arcs show the fixed optimal permutation coupling between the hollow red and blue endpoint atoms. The filled atoms follow these arcs at t=0,1/4,1/2,3/4,1t=0,1/4,1/2,3/4,1, with color interpolated from red to blue.

Poincare Disk

Negative curvature gives a complementary intrinsic picture. The Poincare disk is

D2={xR2:x<1},gx=4(1x2)2I2,\mathbb D^2=\{x\in\mathbb R^2:\|x\|<1\}, \qquad g_x=\frac{4}{(1-\|x\|^2)^2}I_2,

a complete Riemannian manifold of constant curvature -1. Its geodesic distance is

dD(x,y)=arcosh ⁣(1+2xy2(1x2)(1y2)).d_{\mathbb D}(x,y) =\operatorname{arcosh}\!\left( 1+\frac{2\|x-y\|^2}{(1-\|x\|^2)(1-\|y\|^2)} \right).

For equal-weight point clouds, the cost Cij=dD(xi,yj)2/2C_{ij}=d_{\mathbb D}(x_i,y_j)^2/2 again admits an optimal permutation coupling, denoted by σ\sigma. Introduce the hyperboloid lift and Lorentz product

ι(x)=(1+x2,2x)1x2,X,YL=X0Y0+X1:2,Y1:2.\iota(x)=\frac{(1+\|x\|^2,2x)}{1-\|x\|^2}, \qquad \langle X,Y\rangle_L=-X_0Y_0+\langle X_{1:2},Y_{1:2}\rangle.

Put Xi=ι(xi)X_i=\iota(x_i), Yi=ι(yσ(i))Y_i=\iota(y_{\sigma(i)}), and ηi=dD(xi,yσ(i))\eta_i=d_{\mathbb D}(x_i,y_{\sigma(i)}). The constant-speed geodesic is

Zi(t)=sinh((1t)ηi)sinhηiXi+sinh(tηi)sinhηiYi,γi(t)=Zi,sp(t)Zi,0(t)+1.Z_i(t) =\frac{\sinh((1-t)\eta_i)}{\sinh\eta_i}X_i +\frac{\sinh(t\eta_i)}{\sinh\eta_i}Y_i, \qquad \gamma_i(t)=\frac{Z_{i,\mathrm{sp}}(t)}{Z_{i,0}(t)+1}.

In disk coordinates, its trace is a Euclidean circle orthogonal to the unit circle, with diameters as the limiting case. Thus αt=n1iδγi(t)\alpha_t=n^{-1}\sum_i\delta_{\gamma_i(t)} is the hyperbolic McCann interpolation shown below. The sinh\sinh coefficients are the negative-curvature counterparts of the sin\sin coefficients in the spherical formula.

<IPython.core.display.Image object>

Intrinsic McCann interpolation in the Poincare disk. The black circle is the ideal boundary, the faint grid gives hyperbolic radial and distance coordinates, and the thin violet arcs are the fixed optimal geodesic coupling. Filled atoms move from the hollow red source to the hollow blue target at t=0,1/4,1/2,3/4,1t=0,1/4,1/2,3/4,1.

Twist Condition

The first non-degeneracy condition asks that the first-order information at a source point identifies at most one target point. This is the structural hypothesis that turns an optimal relation into a map.

Proof

The proof uses the Kantorovich duality formalism developed later in Chapter Paragraph. Let (f,g)(f,g) be optimal Kantorovich potentials and let π\pi be an optimal plan. Complementary slackness gives f(x)+g(y)=c(x,y)f(x)+g(y)=c(x,y) for π\pi-almost every (x,y)(x,y), while dual feasibility gives f(z)+g(y)c(z,y)f(z)+g(y)\leq c(z,y) for all zz. Thus, for almost every contact pair, the function zc(z,y)g(y)z\mapsto c(z,y)-g(y) touches ff from above at xx. At a point where ff is differentiable, this gives

f(x)=xc(x,y).\nabla f(x)=\nabla_x c(x,y).

If the cost is twisted, this equation determines at most one yy. Hence no optimal plan can split the mass of such an xx between several target points. Since differentiability holds on a full α\al-measure set, the plan is concentrated on the graph of a measurable map there.

The quadratic cost satisfies twist since xxy2=2(xy)\nabla_x\norm{x-y}^2=2(x-y); the bilinear cost c(x,y)=x,yc(x,y)=-\dotp{x}{y} satisfies twist since xc(x,y)=y\nabla_x c(x,y)=-y; more generally c(x,y)=h(xy)c(x,y)=h(x-y) is twisted when hh is smooth strictly convex and h\nabla h is injective. On a Riemannian manifold, the squared geodesic cost is twisted locally away from the cut locus. By contrast, a separated cost a(x)+b(y)a(x)+b(y) is never twisted, since xc\nabla_x c does not see yy.

Ma--Trudinger--Wang Curvature

Twist gives a map, but it does not by itself make this map continuous or smooth. For a general smooth cost, the relevant structural hypothesis is the Ma--Trudinger--Wang (MTW) condition, introduced for a priori estimates of the generated Jacobian equation associated with optimal transport Ma et al., 2005Trudinger & Wang, 2001.

The tensor above is often called the cost-sectional curvature. With this sign convention, it measures how the negative xx-Hessian of the cost bends when the target point is varied through the dual momentum pp.

Proof

This is the regularity theory of Ma--Trudinger--Wang, Trudinger--Wang and Loeper, stated structurally rather than with all boundary hypotheses. The cc-convex potential solves a generated Jacobian equation. Weak MTW controls the geometry of its contact sets and yields interior Hölder estimates. Strong MTW adds a quantitative curvature lower bound; combined with smooth densities, domain geometry and elliptic estimates, it yields higher regularity. Conversely, Loeper proved that weak MTW is necessary for continuity for arbitrary smooth positive data Ma et al., 2005Trudinger & Wang, 2001Loeper, 2009Villani, 2009.

The flat quadratic and bilinear costs have zero MTW curvature, hence satisfy the weak condition. For the squared Riemannian distance, the MTW tensor is a refined curvature condition on the cost: near the diagonal it recovers sectional curvature, negative sectional curvature gives an obstruction, and global regularity also depends on cut-locus and domain-convexity issues. Many smooth strictly convex costs fail MTW, which is why twist is enough for existence of a map but not for regularity.

One-Dimensional Transport And Quantiles

Cumulative and quantile functions

In one dimension, optimal transport is completely explicit. The cumulative distribution function orders the mass, and the optimal coupling is obtained by matching equal quantile levels. This case is both a computational tool and the template for several linearized constructions used later.

Figure Div follows four smooth laws through these three representations. Each density mode produces a change of slope in the cumulative function, while intervals of low density become steep portions of the quantile function. The aligned quarter-mass guides make the inversion between the last two panels explicit.

<IPython.core.display.Image object>

Densities, cumulative functions and quantiles for four Gaussian mixtures. Red-to-blue colors identify mixtures with one through four components across all three panels. The cumulative functions integrate the modes into successive increases of mass, while inversion exchanges slowly varying cumulative regions with steep quantile regions. Faint guides mark the same quarter-mass levels in the last two panels.

Proof

Assume first that α\al has a strictly positive density, so that Fα\cumul{\al} is strictly increasing and continuous. Let γ=(Fα1)Leb[0,1]\ga=(\cumul{\al}^{-1})_\sharp\mathrm{Leb}_{[0,1]}. For every xx,

Fγ(x)=011(,x](Fα1(z))dz=011[0,Fα(x)](z)dz=Fα(x).\cumul{\ga}(x) = \int_0^1 \mathbf{1}_{(-\infty,x]}(\cumul{\al}^{-1}(z))\d z = \int_0^1 \mathbf{1}_{[0,\cumul{\al}(x)]}(z)\d z = \cumul{\al}(x).

General measures follow from the same argument with generalized inverses and right-continuity. If α\al has no atoms, the probability integral transform gives (Fα)α=Leb[0,1](\cumul{\al})_\sharp\al=\mathrm{Leb}_{[0,1]}.

1D Monge solutions

The quantile construction becomes a deterministic Monge map only when the source has no atoms, because the cumulative distribution function can then be used as a genuine change of variable. This gives an explicit one-dimensional Monge solution in the atomless case. If α\al has atoms, a deterministic map may fail to realize the same quantile matching because an atom cannot be split; the corresponding relaxed statement is treated in Section Relaxation For Arbitrary Measures, paragraph Kantorovich solution in 1D.

Proof

By the quantile push-forward proposition, atomlessness of α\al gives (Fα)α=Leb[0,1](\cumul{\al})_\sharp\al=\mathrm{Leb}_{[0,1]}, while (qβ)Leb[0,1]=β(q_\be)_\sharp\mathrm{Leb}_{[0,1]}=\be. Hence Tα=β\T_\sharp\al=\be.

Let SS be any admissible map and set πS=(Id,S)α\pi_S=(\Id,S)_\sharp\al. The one-dimensional uncrossing theorem for relaxed couplings, proved later as Theorem Theorem: One-dimensional Kantorovich solution, shows that the quantile coupling π=(qα,qβ)Leb[0,1]\pi^\star=(q_\al,q_\be)_\sharp\mathrm{Leb}_{[0,1]} is optimal among all couplings. Since α\al has no atoms, (Id,T)α=π(\Id,\T)_\sharp\al=\pi^\star, and therefore

h(xT(x))dα(x)=h(xy)dπ(x,y)h(xy)dπS(x,y)=h(xS(x))dα(x).\int h(x-\T(x))\d\al(x) = \int h(x-y)\d\pi^\star(x,y) \leq \int h(x-y)\d\pi_S(x,y) = \int h(x-S(x))\d\al(x).

This proves optimality of T\T among Monge maps.

Proof

The first formula follows from Theorem Theorem: One-dimensional Kantorovich solution: the optimal coupling is obtained by taking the same quantile level rr for both measures. For p=1p=1, use the layer-cake identity. If qαq_\al and qβq_\be are the quantile functions, then

01qα(r)qβ(r)dr=Rλ{r:qα(r)x<qβ(r) or qβ(r)x<qα(r)}dx,\int_0^1 |q_\al(r)-q_\be(r)|\d r = \int_\RR \lambda\{r:q_\al(r)\leq x<q_\be(r)\ \text{or}\ q_\be(r)\leq x<q_\al(r)\} \d x,

and the measure of the set inside the integral is Fα(x)Fβ(x)|\cumul{\al}(x)-\cumul{\be}(x)| for almost every xx.

For p=2p=2, Bobkov and Ledoux Bobkov & Ledoux, 2019 gave a complementary representation involving only cumulative distribution functions. It gives the same exact value as the quantile formula, but replaces the inverse-CDF step by an integral over CDF values. This is useful when cumulative functions are easier to estimate or aggregate than quantiles. This cumulative formula has recently been used to design data-parallel estimators of sliced Wasserstein distances Vauthier et al., 2026.

Proof

For any u,v[a,b]u,v\in[a,b], one has

uv2=2abxb[1{uxy<v}+1{vxy<u}]dydx,|u-v|^2 = 2\int_a^b\int_x^b \Big[ \mathbf 1_{\{u\leq x\leq y<v\}} + \mathbf 1_{\{v\leq x\leq y<u\}} \Big]\d y\,\d x,

because, when u<vu<v, the integration domain is the triangle uxy<vu\leq x\leq y<v, whose area is (vu)2/2(v-u)^2/2, and the case v<uv<u is symmetric. Apply this identity with u=qα(r)u=q_\al(r) and v=qβ(r)v=q_\be(r), where qα=Fα1q_\al=\cumul{\al}^{-1} and qβ=Fβ1q_\be=\cumul{\be}^{-1}, and integrate with respect to r(0,1)r\in(0,1). Fubini’s theorem applies since the integrand is bounded. For xyx\leq y, the generalized inverse identities give, up to endpoint sets of zero Lebesgue measure,

λ{r:qα(r)x and qβ(r)>y}=(Fα(x)Fβ(y))+,\lambda\{r:q_\al(r)\leq x\ \text{and}\ q_\be(r)>y\} = \big(\cumul{\al}(x)-\cumul{\be}(y)\big)_+,

and the same argument with α\al and β\be exchanged gives the second positive part.

The last panel of Figure Div is the one-dimensional specialization of the displacement interpolation introduced above.

<IPython.core.display.Image object>

One-dimensional transport through quantiles. The same two smooth laws are shown as densities, cumulative functions and quantile functions. The last panel displays the displacement interpolation obtained by the linear quantile path Qt=(1t)Qα+tQβQ_t=(1-t)Q_\alpha+tQ_\beta, which is the explicit one-dimensional W2\Wass_2 geodesic.

Interactive panel. Use the time and endpoint controls to follow the one-dimensional Wasserstein geodesic through quantiles, CDFs, and densities.

In quantile coordinates, the interpolating measure is characterized by

Fαt1(r)=(1t)Fα1(r)+tFβ1(r),r(0,1).\cumul{\al_t}^{-1}(r) = (1-t)\cumul{\al}^{-1}(r)+t\cumul{\be}^{-1}(r), \qquad r\in(0,1).

OT on trees

The line is the simplest tree. On a general tree, the order is no longer total, but each edge still defines a cut and hence a cumulative imbalance. This gives an exact formula for the W1\Wass_1 cost associated with the tree geodesic distance. The formula is classical in fast earth-mover computations on tree metrics Ling & Okada, 2007 and is also the mechanism behind tree-sliced Wasserstein distances Le et al., 2019.

Proof

Let σ=αβ\sigma=\al-\be. Removing an edge ee splits the tree into VeV_e and its complement. For any coupling π\pi, the net amount of mass crossing ee from VeV_e to VVeV\setminus V_e minus the amount crossing in the reverse direction is fixed and equals σ(Ve)\sigma(V_e). Hence the total amount of transported mass whose path uses ee is at least σ(Ve)|\sigma(V_e)|. Since every unit of mass crossing ee pays the length e\ell_e, summing over edges gives

x,ydT(x,y)πxy=eEex,y: e[x,y]πxyeEeσ(Ve),\sum_{x,y}d_{\mathsf{T}}(x,y)\pi_{xy} = \sum_{e\in E}\ell_e \sum_{x,y:\ e\in[x,y]}\pi_{xy} \geq \sum_{e\in E}\ell_e|\sigma(V_e)|,

where [x,y][x,y] is the unique path between xx and yy.

It remains to realize this lower bound. Process the rooted tree from the leaves to the root. At a vertex vov\neq o, compute the total signed mass in the subtree below vv, namely Fe=σ(Ve)F_e=\sigma(V_e) for the edge ee joining vv to its parent. If Fe>0F_e>0, send FeF_e units of surplus from this subtree to the parent side; if Fe<0F_e<0, import Fe-F_e units from the parent side into the subtree. After this operation the subtree has zero net imbalance and can be collapsed into its parent. Continuing upward balances all subtrees because σ(V)=0\sigma(V)=0. Decomposing these edge fluxes into source-to-target paths yields a coupling whose traffic across each edge is exactly Fe|F_e|, and therefore whose cost is the right-hand side of (90). The same postorder pass computes all FeF_e, proving the complexity claim.

For a chain rooted at one end, the sets VeV_e are rays, so the tree formula is the discrete version of the one-dimensional identity (84). This edgewise cumulative decoupling is specific to the geodesic-distance cost dTd_{\mathsf{T}}, i.e. to W1\Wass_1. For powers dTpd_{\mathsf{T}}^p with p>1p>1, the term (e[x,y]e)p\big(\sum_{e\in[x,y]}\ell_e\big)^p couples all edges along a path, so the simple sum of absolute subtree imbalances no longer gives the optimal value. The tree structure remains algorithmically useful in a different sense: tree metrics give fast surrogates and embeddings for EMD-type computations on histograms Indyk & Thaper, 2003Andoni et al., 2008Ling & Okada, 2007, and randomized or data-adapted trees lead to tree-sliced Wasserstein distances that trade the exact Euclidean ground metric for much faster one-dimensional/tree computations Le et al., 2019.

The same tree can nevertheless be used as a genuine geodesic space. If π\pi is an optimal coupling for the squared tree distance dT2d_{\mathsf{T}}^2, the associated displacement interpolation moves each packet of mass πij\pi_{ij} at constant speed along the unique path from xix_i to xjx_j. Figure Div shows this tree analogue of McCann interpolation. The intermediate measures are not necessarily supported on the original vertices: mass may sit inside edges while it travels through the branching structure.

<IPython.core.display.Image object>

McCann interpolation on a finite tree. A quadratic optimal plan is computed between two non-uniform vertex histograms for the squared geodesic distance on the tree. Each transported packet then moves along the unique tree path connecting its source and target vertices. Circle areas encode transported masses, colors interpolate from the source measure α\al in red to the target measure β\be in blue, and faint colored corridors mark the tree branches carrying transport.

Triangular Rearrangements

There is another canonical way to build transport maps in several dimensions: transport one coordinate at a time by conditional one-dimensional quantiles. This construction is not usually cost-optimal, but it gives a deterministic rearrangement under weak assumptions.

Proof

The construction is recursive. For k=1k=1, let T1\T_1 be the monotone rearrangement between the first marginals of α\al and β\be. Suppose T1,,Tk1\T_1,\ldots,\T_{k-1} have been constructed. Write x<k=(x1,,xk1)x_{<k}=(x_1,\ldots,x_{k-1}) and T<k=(T1,,Tk1)\T_{<k}=(\T_1,\ldots,\T_{k-1}). Let αx<kk\al^k_{x_{<k}} and βy<kk\be^k_{y_{<k}} be regular conditional laws of the kk-th coordinate given the previous coordinates. Define Tk(x<k,)\T_k(x_{<k},\cdot) as the one-dimensional monotone rearrangement from αx<kk\al^k_{x_{<k}} to βT<k(x<k)k\be^k_{\T_{<k}(x_{<k})}. The chain rule for disintegrations shows that after step kk the first kk coordinates of Tα\T_\sharp\al match those of β\be.

Figure Div shows the two-dimensional mechanism on image histograms.

<IPython.core.display.Image object>

Triangular rearrangement between the same cat and heart densities as in the McCann interpolation figure. The panels are computed directly on image histograms. The first three transitions move mass horizontally by the monotone rearrangement between the xx-marginals; the pivot has the target horizontal marginal. The last three transitions keep each column fixed and move mass vertically by one-dimensional monotone rearrangements between conditional laws.

Interactive panel. Use the horizontal and vertical interpolation sliders to inspect the Knothe triangular rearrangement one coordinate update at a time.

This construction transports successively along coordinate axes and is often called axis-wise transport. It depends on the chosen ordering of coordinates and is not generally optimal for the quadratic cost. It is nevertheless a useful limiting object: Brenier maps for increasingly anisotropic quadratic costs converge to triangular rearrangements under suitable assumptions Carlier et al., 2010.

Proof Sketch

Let πϵ=(Id,Tϵ)α\pi_\epsilon=(\Id,T_\epsilon)_\sharp\al and write

Ik(γ)=xkyk2dγ(x,y),Fϵ(γ)=k=1dϵk1Ik(γ).I_k(\gamma)=\int |x_k-y_k|^2\d\gamma(x,y), \qquad F_\epsilon(\gamma)=\sum_{k=1}^d\epsilon^{k-1}I_k(\gamma).

Compactness gives a weakly convergent subsequence. Passing to the limit at the leading scale forces its first-coordinate marginal to be the unique monotone coupling. Optimality against the Knothe coupling and the lower bound I1(πϵ)I1(πKR)I_1(\pi_\epsilon)\geq I_1(\pi_{\mathrm{KR}}) then give, after cancellation and division by ϵ\epsilon,

k=2dϵk2Ik(πϵ)k=2dϵk2Ik(πKR).\sum_{k=2}^d\epsilon^{k-2}I_k(\pi_\epsilon) \leq \sum_{k=2}^d\epsilon^{k-2}I_k(\pi_{\mathrm{KR}}).

Disintegration identifies the second coordinate as the conditional monotone rearrangement. The scale-separated induction of Carlier et al., 2010 controls the residual earlier-coordinate costs and repeats this argument at every subsequent scale. Thus every weak limit is the triangular graph coupling. A Lusin--Portmanteau argument and compact support then upgrade convergence in law to convergence in L2(α)L^2(\al).

Gaussian Measures And The Bures Metric

Gaussian measures form the most important finite-dimensional family preserved by quadratic optimal transport. The mean moves linearly, while the covariance follows the Bures--Wasserstein geometry of positive semidefinite matrices.

One-Dimensional Gaussians

Let α=N(mα,σα2)\al=\Gaussian(m_\al,\sigma_\al^2) and β=N(mβ,σβ2)\be=\Gaussian(m_\be,\sigma_\be^2) be nondegenerate Gaussians on R\RR. Then

T(x)=σβσα(xmα)+mβ\T(x)=\frac{\sigma_\be}{\sigma_\al}(x-m_\al)+m_\be

satisfies Tα=β\T_\sharp\al=\be. It is the derivative of the convex function

ϕ(x)=σβ2σα(xmα)2+mβx,\phi(x)=\frac{\sigma_\be}{2\sigma_\al}(x-m_\al)^2+m_\be x,

so Brenier’s theorem shows that it is the optimal quadratic transport. The distance is

W2(α,β)2=(mαmβ)2+(σασβ)2.\Wass_2(\al,\be)^2 = (m_\al-m_\be)^2+(\sigma_\al-\sigma_\be)^2.

Thus the OT geometry of one-dimensional Gaussians is the Euclidean geometry of the closed half-plane (m,σ)R×R+(m,\sigma)\in\RR\times\RR_+. By contrast, the Fisher--Rao boundary σ=0\sigma=0 is infinitely far from every nondegenerate Gaussian, and the KL divergence from a nondegenerate Gaussian to a singular one is infinite.

Multivariate Gaussians

If

α=N(mα,Σα),β=N(mβ,Σβ),T(x)=mβ+A(xmα),\al=\Gaussian(\mean_\al,\cov_\al), \qquad \be=\Gaussian(\mean_\be,\cov_\be), \qquad \T(x)=\mean_\be+A(x-\mean_\al),

then T\T is the gradient of a convex quadratic potential if and only if AA is symmetric positive semidefinite.

Proof

An affine function maps a Gaussian to a Gaussian, so the law of T(X)\T(X) is determined by mean and covariance. If XαX\sim\al and Y=T(X)Y=\T(X), then

E(Y)=mβ,E((Ymβ)(Ymβ))=AΣαA.\mathbb{E}(Y)=\mean_\be, \qquad \mathbb{E}((Y-\mean_\be)(Y-\mean_\be)^\top) = A\cov_\al A^\top.

Thus AΣαA=ΣβA\cov_\al A^\top=\cov_\be is necessary and sufficient for equality in distribution, because both laws are Gaussian.

Proof

Multiplying AΣαA=ΣβA\cov_\al A=\cov_\be on the left and right by Σα1/2\cov_\al^{1/2} gives

(Σα1/2AΣα1/2)2=Σα1/2ΣβΣα1/2.(\cov_\al^{1/2}A\cov_\al^{1/2})^2 = \cov_\al^{1/2}\cov_\be\cov_\al^{1/2}.

The positive square root gives the displayed formula for AA. This map pushes α\al to β\be and is a gradient of a convex quadratic potential, hence is optimal by Brenier. If XαX\sim\al,

EXT(X)2=mαmβ2+tr((IA)Σα(IA))=mαmβ2+tr(Σα)+tr(Σβ)2tr((Σα1/2ΣβΣα1/2)1/2).\begin{aligned} \mathbb{E}\|X-\T(X)\|^2 &= \|\mean_\al-\mean_\be\|^2 + \tr((I-A)\cov_\al(I-A)^\top) \\ &= \|\mean_\al-\mean_\be\|^2 + \tr(\cov_\al)+\tr(\cov_\be) -2\tr((\cov_\al^{1/2}\cov_\be\cov_\al^{1/2})^{1/2}). \end{aligned}
Proof

Assume first that Σ\Sigma and Λ\Lambda are positive definite. Fix two admissible laws α,β\al,\be and an arbitrary coupling π\pi between them, and write

K:=Rd×Rduvdπ(u,v).K\eqdef \int_{\RR^d\times\RR^d}uv^\top \d\pi(u,v).

Its transport cost is

uv2dπ(u,v)=tr(Σ)+tr(Λ)2tr(K).\int\norm{u-v}^2\d\pi(u,v) = \tr(\Sigma)+\tr(\Lambda)-2\tr(K).

The block second-moment matrix

(uv)(uv) ⁣dπ(u,v)=(ΣKKΛ)\int \begin{pmatrix}u\\ v\end{pmatrix} \begin{pmatrix}u\\ v\end{pmatrix}^{\!\top} \d\pi(u,v) = \begin{pmatrix} \Sigma & K\\ K^\top & \Lambda \end{pmatrix}

is positive semidefinite. Block positivity and the Schur complement give

R:=Σ1/2KΛ1/2,RRI.R\eqdef\Sigma^{-1/2}K\Lambda^{-1/2}, \qquad RR^\top\preceq I .

Thus K=Σ1/2RΛ1/2K=\Sigma^{1/2}R\Lambda^{1/2} with Rop1\norm{R}_{\mathrm{op}}\leq1. By duality between the nuclear and operator norms,

tr(K)supRop1tr(Σ1/2RΛ1/2)=Λ1/2Σ1/2=tr((Σ1/2ΛΣ1/2)1/2).\tr(K) \leq \sup_{\norm{R}_{\mathrm{op}}\leq1}\tr(\Sigma^{1/2}R\Lambda^{1/2}) = \norm{\Lambda^{1/2}\Sigma^{1/2}}_* = \tr\big((\Sigma^{1/2}\Lambda\Sigma^{1/2})^{1/2}\big).

For singular matrices, fix η>0\eta>0. Adding ηI\eta I to the two diagonal blocks preserves block positivity, so the same Schur-complement argument gives

tr(K)tr(((Σ+ηI)1/2(Λ+ηI)(Σ+ηI)1/2)1/2).\tr(K) \leq \tr\big(((\Sigma+\eta I)^{1/2}(\Lambda+\eta I)(\Sigma+\eta I)^{1/2})^{1/2}\big).

Letting η0\eta\downarrow0 and using continuity of the matrix square root gives the same trace bound with Σ,Λ\Sigma,\Lambda. Hence every admissible coupling has cost at least B(Σ,Λ)2\Bb(\Sigma,\Lambda)^2. Conversely, the centered Gaussian laws N(0,Σ)\Gaussian(0,\Sigma) and N(0,Λ)\Gaussian(0,\Lambda) satisfy the prescribed raw second-moment constraints, and Proposition Proposition: Gaussian W2\Wass_2 Formula And Bures Covariance Term gives equality, again by continuity in the singular case.

The covariance term B\Bb is the Bures--Wasserstein metric on positive semidefinite matrices Bures, 1969Gelbrich, 1990Bhatia et al., 2019. It separates Euclidean displacement of the mean from the intrinsic transport geometry of covariance ellipsoids. For 2×22\times2 covariance matrices, this geometry can be seen inside a familiar cone. The useful coordinates separate trace, anisotropy and correlation. Writing

Σ=(accb),t=a+b2,u=ab2,v=2c,\Sigma=\begin{pmatrix} a & c \\ c & b \end{pmatrix}, \qquad t=\frac{a+b}{\sqrt2},\qquad u=\frac{a-b}{\sqrt2},\qquad v=\sqrt2\,c,

identifies the vector space of symmetric 2×22\times2 matrices with R3\RR^3 through an orthonormal change of coordinates for the Frobenius inner product; the inverse map is

a=t+u2,b=tu2,c=v2.a=\frac{t+u}{\sqrt2},\qquad b=\frac{t-u}{\sqrt2},\qquad c=\frac{v}{\sqrt2}.

Moreover,

t2u2v2=2(abc2)=2det(Σ).t^2-u^2-v^2=2(ab-c^2)=2\det(\Sigma).

The condition Σ0\Sigma\succeq0 is therefore equivalent to

tu2+v2.t\geq \sqrt{u^2+v^2}.

Thus the cone of 2×22\times2 covariance matrices is the Lorentz, or ice-cream, cone. The Bures distance is not the ambient Euclidean distance in these coordinates: on the positive definite interior it is the geodesic distance of a smooth nonlinear geometry, whose geodesics are the covariance parts of Gaussian optimal transport rather than the straight chords inherited from R3\RR^3. The cone panel below illustrates this distinction.

Figure Div displays this Euclidean half-plane geometry and the corresponding displacement interpolation of the Gaussian densities.

<IPython.core.display.Image object>

One- and two-dimensional Gaussian W2\Wass_2 geodesics. In one dimension, the coordinates (m,σ)(m,\sigma) turn geodesics into Euclidean segments in the upper half-plane. Both paths share red and blue endpoint colors; the first interpolates directly between them, whereas the second passes through green at mid-time. In two dimensions, means move linearly while covariance ellipses follow the Bures--Wasserstein interpolation. The cone panel displays the same two covariance paths inside the 2×22\times2 positive-semidefinite cone, with uu and vv horizontal, tt vertical, and faint gray chords showing the ambient Euclidean segments for comparison.

Interactive panel. Use the target mean, variance, and angle controls to see how the Gaussian Wasserstein geodesic moves means and covariance ellipses.

<IPython.core.display.Image object>

Wasserstein and Fisher--Rao geodesics in the one-dimensional Gaussian family. Both interpolations share red and blue endpoint colors. The Wasserstein curves interpolate directly between them, whereas the Fisher--Rao curves pass through green at mid-time; the same palettes identify both geodesics in the left parameter-space panel. The two density panels use the same endpoint Gaussians and time samples, but the Fisher--Rao path expands the standard deviation along its hyperbolic arc before returning to the target scale.

Interactive panel. Move the endpoint and time controls to compare the straight Wasserstein path with the Fisher--Rao hyperbolic path in the Gaussian half-plane.

The cone panel in Figure Paragraph illustrates this distinction.

The two-dimensional Gaussian panels in the boxed figure show covariance ellipses evolving along the Bures--Wasserstein interpolation, together with the same covariance paths drawn in cone coordinates. The first path uses a direct red-to-blue palette, whereas the second shares these endpoints but passes through green. The interactive panel above varies the same Gaussian ingredients in real time.

<IPython.core.display.Image object>

Bures--Wasserstein and Fisher--Rao covariance geodesics in the 2×22\times2 positive-semidefinite cone. The three trajectories use distinct red-to-blue, orange-to-violet, and teal-to-gold palettes, repeated identically in both panels, while faint gray chords show the ambient Euclidean segments. The Bures paths reach rank-one covariances on the cone boundary. The Fisher--Rao paths use positive-definite regularizations with the same dominant directions because the limiting rank-one covariances are not at finite Fisher--Rao distance.

Interactive panel. Move the rank-one limiting direction and the positive-definite Fisher--Rao floor. The Bures path is allowed to touch the closed covariance cone, while the Fisher--Rao path stays inside the open cone.

Proof

The key identity is the Procrustes representation

B2(Σ,Λ)=minQQ=IΣ1/2Λ1/2QF2.\Bb^2(\Sigma,\Lambda) = \min_{Q^\top Q=I}\|\Sigma^{1/2}-\Lambda^{1/2}Q\|_F^2.

Symmetry, positivity and separation follow immediately. For the triangle inequality, choose almost optimal orthogonal matrices Q1,Q2Q_1,Q_2 for (Σ,Λ)(\Sigma,\Lambda) and (Λ,Γ)(\Lambda,\Gamma). Since Q2Q1Q_2Q_1 is admissible for (Σ,Γ)(\Sigma,\Gamma),

B(Σ,Γ)Σ1/2Γ1/2Q2Q1FΣ1/2Λ1/2Q1F+Λ1/2Γ1/2Q2F.\Bb(\Sigma,\Gamma) \leq \|\Sigma^{1/2}-\Gamma^{1/2}Q_2Q_1\|_F \leq \|\Sigma^{1/2}-\Lambda^{1/2}Q_1\|_F + \|\Lambda^{1/2}-\Gamma^{1/2}Q_2\|_F.

Letting the two choices become optimal proves the metric property.

For convexity, use the factor formulation

B2(Σ,Λ)=minUU=Σ,  VV=ΛUVF2.\Bb^2(\Sigma,\Lambda) = \min_{UU^\top=\Sigma,\;VV^\top=\Lambda}\|U-V\|_F^2.

Here UU and VV may have any common number of columns.

Choose nearly optimal factors (U0,V0)(U_0,V_0) and (U1,V1)(U_1,V_1), and set

Ut=[1tU0,tU1],Vt=[1tV0,tV1].U_t=[\sqrt{1-t}\,U_0,\sqrt t\,U_1], \qquad V_t=[\sqrt{1-t}\,V_0,\sqrt t\,V_1].

Then UtUt=(1t)Σ0+tΣ1U_tU_t^\top=(1-t)\Sigma_0+t\Sigma_1 and VtVt=(1t)Λ0+tΛ1V_tV_t^\top=(1-t)\Lambda_0+t\Lambda_1, while the squared Frobenius distance is the same convex combination. Taking the infimum proves joint convexity.

References
  1. Monge, G. (1781). Mémoire sur la théorie des déblais et des remblais. Histoire de l’Académie Royale Des Sciences, 666–704.
  2. Villani, C. (2003). Topics in Optimal Transportation (Vol. 58). American Mathematical Society.
  3. Villani, C. (2009). Optimal Transport: Old and New (Vol. 338). Springer.
  4. Santambrogio, F. (2015). Optimal Transport for Applied Mathematicians: Calculus of Variations, PDEs, and Modeling. Birkhäuser.
  5. Rachev, S. T., & Rüschendorf, L. (1998). Mass Transportation Problems: Volume I: Theory. Springer.
  6. Rudin, W. (1987). Real and Complex Analysis (Third). McGraw–Hill.
  7. Bogachev, V. I. (2007). Measure Theory. Springer.
  8. Reinhard, E., Adhikhmin, M., Gooch, B., & Shirley, P. (2001). Color Transfer between Images. IEEE Computer Graphics and Applications, 21(5), 34–41.
  9. Pitié, F., Kokaram, A. C., & Dahyot, R. (2005). N-dimensional Probability Density Function Transfer and Its Application to Color Transfer. IEEE International Conference on Computer Vision, 1434–1439.
  10. Rabin, J., Peyré, G., Delon, J., & Bernot, M. (2011). Wasserstein barycenter and its application to texture mixing. International Conference on Scale Space and Variational Methods in Computer Vision, 435–446.
  11. Brenier, Y. (1987). Décomposition polaire et réarrangement monotone des champs de vecteurs. C. R. Acad. Sci. Paris Sér. I Math., 305(19), 805–808.
  12. Brenier, Y. (1991). Polar factorization and monotone rearrangement of vector-valued functions. Communications on Pure and Applied Mathematics, 44(4), 375–417.
  13. Gangbo, W., & McCann, R. J. (1996). The geometry of optimal transportation. Acta Mathematica, 177(2), 113–161.
  14. McCann, R. J. (1997). A convexity principle for interacting gases. Advances in Mathematics, 128(1), 153–179.
  15. Caffarelli, L. (2003). The Monge-Ampere equation and optimal transportation, an elementary review. Lecture Notes in Mathematics, Springer-Verlag, 1–10.