Exponentially concave functions and a new information geometry
Abstract
A function is exponentially concave if its exponential is concave. We consider exponentially concave functions on the unit simplex. In a previous paper we showed that gradient maps of exponentially concave functions provide solutions to a MongeKantorovich optimal transport problem and give a better gradient approximation than those of ordinary concave functions. The approximation error, called Ldivergence, is different from the usual Bregman divergence. Using tools of information geometry and optimal transport, we show that Ldivergence induces a new information geometry on the simplex consisting of a Riemannian metric and a pair of dually coupled affine connections which defines two kinds of geodesics. We show that the induced geometry is dually projectively flat but not flat. Nevertheless, we prove an analogue of the celebrated generalized Pythagorean theorem from classical information geometry. On the other hand, we consider displacement interpolation under a Lagrangian integral action that is consistent with the optimal transport problem and show that the action minimizing curves are dual geodesics. The Pythagorean theorem is also shown to have an interesting application of determining the optimal trading frequency in stochastic portfolio theory.
arXiv:1605.05819 \startlocaldefs \endlocaldefs
Exponentially concave functions
and
t2This research is partially supported by NSF grants DMS1308340 and DMS1612483.
class=MSC] \kwd[Primary ]60E05 \kwd[; secondary ]52A41
information geometry \kwdoptimal transport \kwdexponential concavity \kwdLdivergence \kwdgeneralized Pythagorean theorem \kwdfunctionally generated portfolio \kwdstochastic portfolio theory
1 Introduction
Definition 1.1 (Exponential concavity).
Let be convex. We say that a function is exponentially concave if is concave. (By convention we set .)
Throughout this paper we let be the open unit simplex
(1.1) 
regarded as the collection of strictly positive probability distributions on a set with elements. This is due to the applications we have in mind, although many generalizations are possible. An interesting property of exponentially concave functions is that their gradient maps give a better firstorder approximation those of than ordinary concave functions. In [45], we introduced the concept of Ldivergence. Let be a differentiable exponentially concave function. For , concavity of implies that
(1.2) 
where is the Euclidean gradient. Clearly this approximation is sharper than the linear approximation of itself. The Ldivergence of is the error in this approximation:
(1.3) 
The extra concavity of exponentially concave functions have found several recent applications in analysis, probability and optimization. For example, in [22], the equivalence of entropic curvaturedimension conditions and Bochner’s inequality on metric measure spaces is established using the notion of convexity. When and , the negative of a convex function is exponentially concave. Better gradient approximation has also led to better algorithms in optimization and machine learning such as those in [29, 30, 35], although the authors tend to replace the logarithmic term in (1.2) by a quadratic approximation.
One of our primary applications in mind is related to stochastic portfolio theory. In [25, 23], the author considers the gradient map of an exponentially concave function as a map from to its closure . The following restatement can be found in [45, Proposition 6]. Let be a differentiable exponentially concave function on . For , define by
(1.4) 
where is the th standard basis of . Then, it can be shown that . In keeping with standard definitions in the subject we will call this map the portfolio map. In this vein also see articles [6, 24, 26, 31, 42, 49, 53, 54].
The Ldivergence of should be distinguished from the Bregman divergence of defined by
(1.5) 
Bregman divergence was introduced in [12] and is widely applied in statistics and optimization. To see the difference consider two fundamental examples. For , the KullbackLeibler divergence (also known as relative entropy) is given by
It can be shown that the relative entropy is the Bregman divergence of the Shannon entropy . On the other hand, fix and consider the cross entropy . This is an exponentially concave function of whose associated portfolio map (1.4) is constant: . The corresponding Ldivergence is given by
(1.6) 
This quantity is sometimes referred to as the free energy in statistical physics. In finance it is called the diversification return in [9, 14, 21, 52], the excess growth rate in [25, 27, 44], the rebalancing premium in [10], and the volatility return in [28].
In [45] we introduced a MongeKantorovich optimal transport problem on which can be solved using exponentially concave functions on the unit simplex. The cost function is defined for by
(1.7) 
is strictly convex on . We will recall the details of this transport problem in Section 2.1 and its relationship to exponentially concave functions. It suffices to say for now that, given a pair of Borel probability measures and on the optimal coupling of the two with respect to the above cost can be expressed in terms of the portfolio map of an exponentially concave function on the simplex. A related cost function appears in [41] in the completely different context of finding polytopes with given geometric data. It also appears to be related to the study of moment measures as introduced in [15] (see page 3836 in particular).
1.1 Our contributions
In this paper we show that information geometry provides an elegant geometric structure underlying exponential concavity, Ldivergence and the optimal transport problem. Here is a motivating question which is the starting point of this work. Suppose is an exponentially concave function on with its associated Ldivergence . Can we geometrically characterize triplets such that ? The answer to this question determines the optimal frequency of rebalancing the portfolio generated by (see Section 5.4). Also see Section 3.3 for a transport interpretation of this inequality.
Using tools of information geometry, we show that exponentially concave functions on and their Ldivergences induce a new geometric structure on the simplex regarded as a smooth manifold of probability distributions. Let be an exponentially concave function on . We only require that is smooth and the Euclidean Hessian of is strictly positive definite everywhere (see Assumption 2.5). The induced geometric structure consists of a Riemannian metric and a dual pair of affine connections and . These connections define via parallel transports two kinds of geodesic curves on called primal and dual geodesics. Interestingly, the duality in this geometry goes hand in hand with the duality in the related MongeKantorovich optimal transport problem, and this work is the first which exploits this connection. We summarize our main results as follows. First we give the answer of the motivating question.
Theorem 1.2 (Generalized Pythagorean theorem).
Given , consider the dual geodesic joining and and the primal geodesic joining and . Consider the Riemannian angle between the geodesics at . (See Proposition 4.4 which expresses the Riemannian metric as a normalized Euclidean Hessian of .) Then the difference
(1.8) 
is positive, zero or negative depending on whether the angle is less than, equal to, or greater than degrees (see Figure 1).
We also prove other remarkable properties of the geodesics: (i) There exist explicit coordinate systems under which the primal and dual geodesics are time changes of Euclidean straight lines (Theorem 5.1). In other words, the new geometry is dually projectively flat. In particular, the primal geodesics are Euclidean straight lines up to time reparameterization. Moreover, the primal and dual connections have constant sectional curvature with respect to the Riemannian metric, and thus satisfy an Einstein condition (Corollary 4.10). The primal and dual geodesics can also be constructed as time changes of Riemannian gradient flows for the functions and (Theorem 5.5). This is remarkable because while the geodesic equations depend only on the local properties of near , the gradient flows are global as they involve the derivatives of and . Indeed, this relation is known only for limited families of divergence including Bregman divergence and divergence [5].
As shown in [2, Chapter 1], the generalized Pythagorean theorem holds for any Bregman divergence which induces a dually flat geometry. We will prove that the resulting geometries from Ldivergences are not flat for (Theorem 4.9). While some extensions of the generalized Pythagorean theorem hold in certain nonflat spaces (see for example [2, Theorem 4.5]), they involve some extra terms. To the best of our knowledge Theorem 1.2 is the first exact Pythagorean theorem that holds in a geometry which is not dually flat. The difference (1.8) can also be given an optimal transport interpretation (Section 3.3).
(ii) We extend the static transport problem (1.7) to a timedependent transport problem with a corresponding convex Lagrangian action. In Theorem 6.2 we show that the action minimizing curves are the (reparametrized) dual geodesics which, in addition, satisfy the intermediate time optimality condition. This allows for a consistent displacement interpolation formulation between probability measures on the unit simplex. Previously, such studies focused almost exclusively on the Wasserstein spaces corresponding to the cost functions (here is a metric on a Polish space with suitable properties and ). Displacement interpolation and the related concept of displacement convexity were introduced in [38] and in the thesis [37]. These ideas have grown to be immensely important in classical Wasserstein transport with fundamental implications in geometry, physics, probability and PDE. See [51, Chapter 7] for a thorough discussion. Our Lagrangian, although convex, is not superlinear, and, therefore, is not covered by the standard theory. However, we expect it to lead to many equally remarkable properties.
These results suggest plenty of problems for further research. Generalizing Theorem 1.2 to more than three points is of interest in stochastic portfolio theory. Displacement interpolation has become an extremely important topic in optimal transport theory. Extensions to Riemanninan manifolds, done in [16], have led to new functional inequalities. In another vein, [34] defines Ricci curvatures on metric measure spaces in terms of displacement interpolation and displacement convexity. We expect that the displacement interpolation in this paper will lead to a new Otto calculus ([51, Chapter 15]) and related PDEs (such as HamiltonJacobi equations). It appears that Bregman divergence and Ldivergence are only two of an entire family of divergences with special properties and corresponding optimal transport problems. For example, see [43] which extends the optimal transport problem (1.7) via the cumulant generating function of a general probability distribution. We also believe that this new information geometry will be useful in dynamic optimization problems where the objective function is multiplicative in time. Finally, it is naturally of interest to study exponential concavity on general convex domains.
1.2 Related literature
We have mentioned the Ldivergence and the Bregman divergence. In general, a divergence on a set (usually a manifold of probability distributions) is a nonnegative function such that if and only if . Divergences are not metrics in general since they may be asymmetric and may not satisfy the triangle inequality. Apart from Bregman divergence, many families of divergences (such as divergence and divergence) have been applied in information theory, statistics and other areas; see the survey [7] for a catalog of these divergences. Among these divergences, Bregman divergence plays a special role because it induces a dually flat geometry on the underlying space. First studied in the context of exponential families in statistical inference by [40], it gave rise to information geometry – the geometric study of manifolds of probability distributions. Furthermore, Bregman divergence enjoys properties such as the generalized Pythagorean theorem and projection theorem which led to numerous applications. See [2, 3, 13, 32, 39] for introductions to this beautiful theory. The related concept of dual affine connection is also useful in affine differential geometry (see [17, 33, 47]). In [36] dually projectively flat manifolds are characterized in terms of the Bartlett tensors and conformal flatness. Here we identify a new and important class of examples and show that they have concrete applications.
This work is motivated by our study in mathematical finance. Recently optimal transport has been applied to financial problems such as robust asset pricing; see, for example, [1, 8, 18]. This line of work has a somewhat different flavor than ours although they share the same goal: development of modelfree mathematical finance. Portfolios generated by exponentially concave functions generate profit due to fluctuations of a sequence in representing the stock market. This idea is sometimes called volatility harvesting and leads naturally to the transport problem (1.7), as shown in [45]. In this philosophy, our work can be interpreted as developing a notion of modelfree volatility.
1.3 Outline of the paper
In the next section we recall the optimal transport problem formulated in [45] using the exponential coordinate system. Its relation with functionally generated portfolio is also reviewed. In Section 3 we relate exponential concavity with concavity and give a transportmotivated definition of Ldivergence. Here duality plays a crucial role. After reviewing the basic concepts of information geometry, we derive in Section 4 the geometric structure induced by an exponentially concave function. The properties of this new geometry are then studied in Section 5. In particular, we characterize the primal and dual geodesics and prove the generalized Pythagorean theorem which has an interesting application in mathematical finance. Finally, in Section 6 we apply the geometric structure to construct a displacement interpolation for the associated optimal transport problem. Some technical and computational details are gathered in the Appendix.
2 Optimal transport and portfolio maps
In this section we recall the optimal transport problem in [45] using the exponential coordinate system. We also review the definition of functionally generated portfolio and explain how it relates to the transport problem.
2.1 Exponential coordinate system
The exponential coordinate system defines a global coordinate system on regarded as an dimensional smooth manifold [2, Section 2.2].
Definition 2.1 (Exponential coordinate system).
The exponential coordinate of is given by
(2.1) 
We denote this map by . By convention we set . The inverse transformation is given by
(2.2) 
where as defined in (1.7).
The exponential coordinate system is the first of several coordinate systems we will introduce on the simplex. By changing coordinate systems, any function on can be expressed as a function on and vice versa. Explicitly, a function on can be expressed in exponential coordinates by . To simplify the notations, we simply write or depending on the coordinate system used. For example, if is the cross entropy where , then .
2.2 The transport problem
We refer the reader to the books [4, 51] for introductions to optimal transport and its interplay with analysis, probability and geometry. Let be equipped with the standard Euclidean metric and topology. Let and be Borel probability measures on and respectively. By a coupling of and we mean a Borel probability measure on whose marginals are and respectively. Let be the set of all couplings of and . This set is always nonempty as it contains the product measure .
Given and we consider the MongeKantorovich optimal transport problem with cost defined by (1.7):
(2.3) 
Here the expectation is taken under the probability measure under which the random element has distribution . If an optimal coupling takes the form for some measurable map , we say that is a Monge transport map.
In general, we may consider the optimal transport problem (2.3) with replaced by a general cost function denoted by and , are general Polish spaces. The classical example is where and is a power of the underlying metric: (especially and ). For these costs rich and delicate theories have been developed on Euclidean spaces, Riemannian manifolds and geodesic metric measure spaces. However, we consider the cost function defined by (1.7).
Remark 2.2.
The cost function
differs from in a linear term which plays no role in optimal transport. Thus we may consider instead. The advantage of is that it is nonnegative and, by Jensen’s inequality, equals zero if and only if . To be consistent with the notations in [45] we will use the cost function in this paper.
Definition 2.3 (cyclical monotonicity).
A nonempty subset is cyclical monotone if and only if it satisfies the following property. For any finite collection in and any permutation of the set , we have
(2.4) 
It is well known that cyclical monotonicity is, under mild technical conditions, a necessary and sufficient solution criteria of the general optimal transport problem (see [4, Chapter 1]). In particular, a coupling of is optimal if and only if the support of is cyclical monotone.
2.3 Functionally generated portfolio
At this point it is convenient to introduce the concept of functionally generated portfolio. Although it is possible to present the theory without reference to financemotivated concepts, we stress that the portfolio map gives an additional structure to the transport problem not found in other cases. Also, the main examples of the theory as well as the key quantities (such as the induced Riemannian metric) are best expressed in terms of portfolios. Mathematically, the portfolio can be regarded as a normalized gradient of . In Section 5.4 we apply our information geometry to functionally generated portfolios.
Functionally generated portfolio was introduced in [23] and the following refined definition is taken from [45].
Definition 2.4 (Functionally generated portfolio).
By a portfolio map we mean a function . Let be exponentially concave. We say that a portfolio map is generated by if for any we have
(2.5) 
We call the log generating function of and (which is positive and concave) the generating function. It is known that is unique (for a given ) up to an additive constant. If is differentiable, then is necessarily given by (1.4).
Throughout this paper we impose the following regularity conditions on the exponentially concave function .
Assumption 2.5 (Regularity conditions).

The function is smooth (i.e., infinitely differentiable) on .

The (Euclidean) Hessian of is strictly negative definite everywhere on . In particular, is strictly concave. Moreover, it can be shown that the function defined by (1.4) maps into .
Let us discuss these conditions briefly. Differentiability is needed to define differential geometric structures on in terms of the derivatives of the Ldivergence. Our theory requires the Ldivergence to be three times continuously differentiable, and for convenience we simply assume that is smooth. Strict concavity guarantees that the Ldivergence is nondegenerate, i.e., only if , and strict positive definiteness of the Hessian implies that the induced Riemannian metric is nondegenerate.
Henceforth we let be an exponentially concave function satisfying Assumption 2.5 and let given by (1.4) be the portfolio map generated by . The cost function always refers to the one defined in (1.7), and a general cost function is denoted by . Using (1.4), it can be shown that the Ldivergence (1.3) of can be expressed in the form
(2.6) 
Now we give several examples of functionally generated portfolios and their log generating functions. Many more examples can be found in [25, Chapter 3]. In particular, the constantweighted portfolios play a special role and will be taken as the basic example of the theory.
Example 2.6 (Examples of functionally generated portfolios).

(Market portfolio) The identity map is generated by the constant function . (Here Assumption 2.5 does not hold.)

(Constantweighted portfolio) The constant map is generated by the crossentropy . The special case is called the equalweighted portfolio.

(Diversityweighted portfolio) Let be a fixed parameter. Consider the portfolio map defined by
It can be shown that the generating function is .

(Convex combinations) It is known that the set of functionally generated portfolios is convex. Indeed, let be generated by and be generated by . Then for , the portfolio map is generated by . Its generating function is then the geometric mean . This fact was used in [53, 54] to formulate and study nonparametric estimation of functionally generated portfolio.
The following result is taken from [45].
Proposition 2.7.
For any portfolio map the following statements are equivalent.

There exists an exponentially concave function on which generates in the sense of (2.5).

The portfolio map is multiplicatively cyclical monotone (MCM) in the following sense: for any sequence in satisfying , we have

Define a map by
(2.7) Here is regarded as a function of the exponential coordinate. In words, we define in such a way that the exponential coordinate of is . Then the graph of this map is cyclical monotone.
Using this result, we showed in [45] how the optimal transport problem (2.3) can be solved in terms of functionally generated portfolios. Here is a simple but interesting explicit example which is a direct generalization of the onedimensional case treated in [45, Section 4].
Example 2.8 (Product of Gaussian distributions).
In the transport problem (2.3), let be a product of onedimensional Gaussian distributions:
where and . Also let
where and . Then the optimal transport map for the measures and is given by the map (2.7), where the portfolio map is the following variant of the diversityweighted portfolio discussed in Example 2.6(iii):
(2.8) 
where the coefficients are chosen such that for all .
3 Optimal transport and duality
3.1 concavity and duality
Now we make use of the notion of concavity in optimal transport theory. The definitions we use are standard and can be found in [4, Chapter 1]. Again, refers to our cost function (1.7). Also recall that and are the underlying spaces of the variables and respectively. For we define its transform by
Similarly, the transform of a function is defined by
We say that is concave if there exists such that (similar for concave functions on ). A function (on or ) is concave if and only if .
If is concave, its superdifferential is defined by
(3.1) 
For we define . If this set is a singleton , we call the supergradient of at and write . Similar definitions hold for a concave function on .
Let be concave. By definition of , we have
(3.2) 
for every pair , and equality holds in (3.2) if and only if . This is a generalized version of Fenchel’s identity (see [46, Section 12]) and will be used frequently in this paper.
Our first lemma relates exponential concavity on with concavity on and on . Note that the cost function is asymmetric, and concavity on is equivalent to concavity on after a change of variable.
Lemma 3.1 (Exponential concavity and concavity).
For the following statements are equivalent.

is exponentially concave on .

The function defined by
is concave on .

The function defined by
where is the exponential coordinate, is concave on .
Proof.
We prove the implication (i) (ii) and the others can be proved similarly. Suppose (i) holds and consider the nonnegative concave function on . By [46, Theorem 10.3], we can extend continuously up to , the closure of in . We further extend to the affine hull of in by setting for . The extended function is then a closed concave function on . By convex duality (see [46, Theorem 12.1]), there exists a family of affine functions on such that
(3.3) 
Since is nonnegative on , each is nonnegative on . Replacing by the sequence , , we may assume without loss of generality that each is strictly positive on . We parameterize each in the form where are positive constants. (Note that an extra constant term is not required since .) Writing , and switching to exponential coordinates, we have
It follows from (3.3) that
(3.4) 
Define by setting
where the infimum of the empty set is . From (3.4), we have
which shows that is concave on . ∎
The following is the concave analogue of the classical Legendre transformation [46]. Its proof is standard but lengthy and will be given in the Appendix.
Theorem 3.2 (Legendre transformation).
Let be an exponentially concave function satisfying Assumption 2.5, and let , defined by (1.4), be the portfolio map generated by . Given , consider the concave function
(3.5) 
defined on via the exponential coordinate system.

Let be the range of . Then the supergradient of is given on by
In fact, the map is a diffeomorphism from to whose inverse is . Also, the function is smooth on the open set .
Although is in general a strict subset of , by Theorem 3.2 the dual variable defines a global coordinate system of the manifold . In Theorem 5.1 we will use another coordinate system on called the dual Euclidean coordinate system. Thus we have four coordinate systems on : Euclidean, primal, dual and dual Euclidean (see Definition 3.3). In the following we will frequently switch between coordinate systems to facilitate computations. To avoid confusions let us state once for all the conventions used. We let and be given.
Definition 3.3 (Coordinate systems).
For the unit simplex (defined by (1.1)) we call the identity map
the (primal) Euclidean coordinate system with range . We let
be the primal (exponential) coordinate system with range and
be the dual (exponential) coordinate system with range . The dual Euclidean coordinate system is defined by the composition
See Figure 2 for an illustration. From now on , , and always represent the same point of . In particular, unless otherwise specified and are dual to each other in the sense that . By convention we let for any .
Notation 3.4 (Switching coordinate systems).
We identify the spaces , and using the coordinate systems in Definition 3.3. If is a function on any one of these spaces, we write depending on the coordinate system used.
We also record a useful fact. A formula analogous to the first statement is derived in [49].
Lemma 3.5.
For , we have
Proof.
The first statement is derived in the proof of Theorem 3.2. The second statement can be proved by differentiating (Fenchel’s identity). ∎
3.2 divergence
By duality, we show that a pair of natural divergences on can be defined for the concave functions and . Moreover, they coincide with Ldivergence. Clearly we can consider other cost functions other than . When is the squared Euclidean distance, the analogue of Definition 3.6 below gives the classical Bregman divergence. This covers both Ldivergence and Bregman divergence under the same framework. To the best of our knowledge these definitions, which depend crucially on the interplay between transport and divergence, are new. We will use the triple representation for each point in .
Definition 3.6 (divergence).
Consider the concave function defined by (3.5) and its transform .

The divergence of is defined by
(3.7) 
The divergence of is defined by
(3.8)
From Fenchel’s identity (3.2) we see that and are nonnegative and nondegnereate, i.e., they vanish only on the diagonal of . The following is a generalization of the selfdual expression of Bregman divergence (see [2, Theorem 1.1]).
Proposition 3.7 (Selfdual expressions).
We have
(3.9)  
(3.10) 
In particular, for we have .
Proof.
Now we show that Ldivergence is a divergence where .
Theorem 3.8 (Ldivergence as divergence).
The divergence of is the Ldivergence of . Namely, for we have
Proof.
For computations it is convenient to express solely in terms of either the primal or dual coordinates. We omit the details of the computations.
Lemma 3.9 (Coordinate representations).
For we have
3.3 Transport interpretation of the generalized Pythagorean theorem
Using Proposition 3.8 we give an interesting transport interpretation of the expression (1.8) in the generalized Pythagorean theorem (Theorem 1.2). Let be given. Let be the primal and dual coordinates of , and respectively. By Proposition 2.7, the coupling is cyclical monotone. Hence coupling with is optimal.
Consider two (suboptimal) perturbations of the optimal coupling:

(Cyclical perturbation) Couple with , with , and with . The associated cost is

(Transposition) Couple with , with , and keep the coupling . The associated cost is
Now we ask which perturbation has lower cost. The difference (i) (ii) is
By Proposition 3.8, this is nothing but the difference . Thus the generalized Pythagorean theorem gives an information geometric characterization of the relative costs of the two perturbations.
3.4 Examples
We consider the portfolios in Example 2.6.
Example 3.10 (Constantweighted portfolio).
Let be a constantweighted portfolio. Then is the cross entropy and we have
which is an affine function on . Its transform is also affine. Indeed, we have
where is the Shannon entropy of . For this reason we say that the constantweighted portfolios are selfdual. The transport map in this case is given by a translation: . Its Ldivergence (1.6) is given in primal coordinates (see Lemma 3.9) by
which is translation invariant. This property is equivalent to the following numéraire invariance property [44, Lemma 3.2]: for any , we have under the mapping
In fact, it is not difficult to show that this property characterizes the constantweighted portfolios among Ldivergences of exponentially concave functions. Also see [44, Proposition 4.6] for a chain rule analogous to that of relative entropy.
Example 3.11 (Diversityweighted portfolio).
We have . Since
the map is a scaling: . For the generalized diversityweighted portfolio in Example 2.8 the transport map is the composition of a scaling and a translation.
4 Geometric structure induced by Ldivergence
In this section we derive the geometric structure induced by a given Ldivergence . As always we impose the regularity conditions in Assumption 2.5. Using the primal and dual coordinate systems (Definition 3.3), we compute explicitly the Riemannian metric , the primal connection (not to be confused with the Euclidean gradient) and the dual connection . We call the induced geometric structure. An important fact in information geometry is that the LeviCivita connection is not necessarily the right one to use. Nevertheless, by duality we always have .
4.1 Preliminaries
For differential geometric concepts such as Riemannian metric and affine connection we refer the reader to [2, Chapters 5] whose notations are consistent with ours. For computational convenience we define the geometric structure in terms of coordinate representations. The geometric structure is determined by the Ldivergence and is independent of the choice of coordinates; for intrinsic formulations we refer the reader to [13, Chapter 11]. The following definition (which makes sense for a general divergence on a manifold) is taken from [2, Section 6.2].
Definition 4.1 (Induced geometric structure).
Given a coordinate system of , the coefficients of the geometric structure are given as follows.

The Riemannian metric is given by
(4.1) By Assumption 2.5 the matrix is strictly positive definite. The Riemannian inner product and length are denoted by and respectively.

The primal connection is given by
(4.2) 
The dual connection is given by
(4.3)
For a general divergence the above definitions were first introduced in [19, 20]. If we define the dual divergence by , the dual connection of is the primal connection of . The primal and dual connections are dual to each other with respect to the Riemannian metric (see [2, Theorem 6.2]). While any divergence induces a geometric structure, it may not enjoy nice properties. For the geometric structure induced by a Bregman divergence, it can be shown that the RiemannChristoffel curvatures of the primal and dual connections both vanish. Thus we say that the induced geometry is dually flat [2, Chapter 1]. We will show that Ldivergence gives rise to a different geometry with many interesting properties.
4.2 Notations
We begin by clarifying the notations. Following our convention (see Notation 3.4), we write