Schubert polynomials as projections of Minkowski sums of GelfandTsetlin polytopes
Abstract.
GelfandTsetlin polytopes are classical objects in algebraic combinatorics arising in the representation theory of . The integer point transform of the GelfandTsetlin polytope projects to the Schur function . Schur functions form a distinguished basis of the ring of symmetric functions; they are also special cases of Schubert polynomials corresponding to Grassmannian permutations.
For any permutation with columnconvex Rothe diagram, we construct a polytope whose integer point transform projects to the Schubert polynomial . Such a construction has been sought after at least since the construction of twisted cubes by Grossberg and Karshon in 1994, whose integer point transforms project to Schubert polynomials for all . However, twisted cubes are not honest polytopes; rather one can think of them as signed polytopal complexes. Our polytope is a convex polytope. We also show that is a Minkowski sum of GelfandTsetlin polytopes of varying sizes. When the permutation is Grassmannian, the GelfandTsetlin polytope is recovered. We conclude by showing that the GelfandTsetlin polytope is a flow polytope.
1. Introduction
Schubert polynomials, introduced by Lascoux and Schützenberger in 1982 [15], are extensively studied in algebraic combinatorics [4, 6, 2, 7, 14, 23, 16, 19, 12, 11, 3]. They represent cohomology classes of Schubert cycles in flag varieties, and they generalize Schur functions, a distinguished basis of the ring of symmetric functions.
A wellknown property of the Schur function is that it is a projection of the integer point transform of the GelfandTsetlin polytope . This has inspired the following natural question for Schubert polynomials:
Question 1. For , is there a natural polytope and a projection map such that the projection of the integer point transform of under the map equals the Schubert polynomial ?
The construction of twisted cubes by Grossberg and Karshon in 1994 [8] is the first attempt at an answer to the above question. The integer point transforms of twisted cubes project to any Schubert polynomial. Indeed, Grossberg and Karshon show that for both flag and Schubert varieties, their (virtual) characters are projections of integer point transforms of twisted cubes. The one catch with twisted cubes is that they are not always honest polytopes; intuitively one can think of them as signed polytopal complexes. For the Grassmannian case they do not yield the GelfandTsetlin polytope. Kiritchenko’s beautiful work [10] explains how to make certain corrections to the GrossbergKarshon twisted cubes in order to obtain the GelfandTsetlin polytope for Grassmannian permutations.
Recall that given a partition , the GelfandTsetlin polytope is the set of all nonnegative triangular arrays
such that
To state our main result, which is a partial answer to Question 1, we need to consider the Minkowski sums of GelfandTsetlin polytopes of partitions with different lengths.
Fix , and for each , let be a partition with parts (with empty parts allowed). We wish to study the Minkowski sum
To make this Minkowski sum welldefined, we embed into for each . To do this, let be coordinates of and be coordinates of as in the definition of the GelfandTsetlin polytope. The embedding is given by
Given a columnconvex diagram with rows, we associate to it a family of partitions in the following way. The shape , , has parts and is obtained from by ordering the columns of whose lowest box is in the th row in decreasing fashion and reading off according to the French notation. Note that is empty if there is no column of whose lowest box is in the th row.
Theorem 1.1.
The character of the flagged Schur module associated to a columnconvex diagram with rows and is a projection of the integer point transform of
(1) 
with the embedding specified above. We obtain from the integer point transform via the specialization
In the case that is the Rothe diagram of a permutation , the character of the flagged Schur module associated to is the Schubert polynomial . Thus, Theorem 1.1 answers Question 1 for permutations whose Rothe diagram is columnconvex. The necessary background for and the proof of Theorem 1.1 is in Section 2. It is interesting to note that the Newton polytope of a Schubert polynomial is a generalized permutahedron [5, 20]; thus, the affine projection specified in Theorem 1.1 maps to a generalized permutahedron for columnconvex .
Theorem 1.1 recovers GelfandTsetlin polytopes for Grassmannian permutations. We conclude our paper by showing in Theorem 1.2 that GelfandTsetlin polytopes are flow polytopes and by showing how to view in Theorem 1.1 in the context of flow polytopes.
Theorem 1.2.
is integrally equivalent to the flow polytope .
2. Polytopes projecting to Schubert polynomials
This section is devoted to proving Theorem 1.1 and explaining the relevant terminology. We start by defining diagrams, flagged Schur modules, and their characters.
2.1. Background
A diagram is a finite subset of . Its elements are called boxes. We will think of as a grid of boxes in matrix notation, so is the topmost and leftmost box. Canonically associated to each permutation is its Rothe diagram.
Definition 2.1.
The Rothe diagram of a permutation is the collection of boxes
We can visualize as the set of boxes remaining in the grid after crossing out all boxes below or to the right of for each .
Definition 2.2.
A diagram is columnconvex if for each , the set is an interval in .
Note that a Rothe diagram is columnconvex if and only if avoids the patterns and .
Let be a diagram with rows. Denote by the symmetric group on the boxes in . Let be the subgroup of permuting the boxes of within each column, and define similarly for rows. Let denote the vector space with basis indexed by fillings of . Observe that , , and act on on the right by permuting the filled boxes.
Define idempotents , in the group algebra by
where is the sign of the permutation . Given a filling , define to the be the linear combination
Identify with the tensor product , where and is the number of boxes of , in the following manner. First, fix an order on the boxes of . Then read each filling in this order to obtain a word on , and identify this word with the tensor , where is the standard basis of . As acts on , it acts diagonally on by acting on each component. This left action of on commutes with the right action of . Thus, the subspace of spanned by all elements is a submodule, called the Schur module of .
Call a filling of rowflagged if for all . Let be the subgroup of consisting of upper triangular matrices. The subspace of spanned by the elements for rowflagged forms a submodule of , called the flagged Schur module of .
Definition 2.3.
The flagged Schur module of a diagram is the submodule of spanned by
The formal character , denoted by , is the polynomial
where is the diagonal matrix in with diagonal entries .
A particularly important subclass of characters of flagged Schur modules is that of Schubert polynomials as explained in Theorem 2.5 below. Schubert polynomials are associated to permutations, and they admit various combinatorial and algebraic definitions. For a permutation , we will define the Schubert polynomial via divided difference operators on polynomials.
Definition 2.4.
The Schubert polynomial of the long word for is defined as
For , there exists such that . For any such , the Schubert polynomial is defined by
where
and is the transposition swapping and . The operators can be shown to satisfy the braid relations, so the Schubert polynomials are welldefined.
Schubert polynomials appear as the characters of flagged Schur modules of Rothe diagrams.
Theorem 2.5 ([13]).
Let be a permutation, be the Rothe diagram of , and be the character of the associated flagged Schur module . Then,
2.2. Minkowski sums of GelfandTsetlin polytopes
We now move towards proving Theorem 1.1, which for any columnconvex diagram , relates the character with the Minkowski sum
defined in equation (1). To begin, we describe this Minkowski sum in terms of inequalities. We will need the following Lemma 2.6, which is proved in Section 3.
Lemma 2.6.
If has parts, then the GelfandTsetlin polytope decomposes as a Minkowski sum:
Proposition 2.7.
Let be partitions such that has (possibly empty) parts. The Minkowski sum is defined by the following inequalities:

for all , ; and

for any positive integer and nonempty sequence of even length ,
with equality when and .
Remark 2.8.
A simple calculation shows that if, for instance, for some , then neither side of would change if we simply remove and from the sequence. Likewise, if for some , then neither side would change if we remove and from the sequence. Therefore we may equivalently take the inequalities for sequences .
One should observe that the entries occurring on the left side of lie at the corners of a path that zigzags southeast and southwest inside the triangular array.
Example 2.9.
Suppose . We first have inequalities and as with ordinary GelfandTsetlin patterns. Then for , we get equalities
as well as inequalities
Finally, for , there is one more inequality, namely
Proof of Proposition 2.7.
Let , and let be the polytope given by the inequalities above, . We first show that . For any point , choose, for each , points summing to it, so that . In particular, will contribute to a coordinate of the form if and only if .
Inequalities of the form are derived by summing the respective inequalities over all . For inequalities of type , consider a sequence , and suppose first that . Then
for each term in the sum is nonnegative by the defining inequalities of . If instead , then let be the minimum value such that . Then
since again each term in the sum is nonnegative. Summing these inequalities over all then gives the desired inequality. In the case that and , we get equality since
To show , we induct on and then the size of . First suppose . The inequalities involving are , and, when ,
with equality if also and . These imply that for all and impose no additional constraints on the other entries. Removing the diagonal of entries then yields a triangular array that satisfies the inequalities defining . Therefore by induction
If , then let be the number of nonzero parts. We will prove that , where we let for . This will prove the result by induction using Lemma 2.6 since then .
Recall that GelfandTsetlin polytopes are integral polytopes. Given any integer point , set for , while for , set to be the minimum value such that and (if such an index exists, otherwise set ). Then define the point by if , otherwise .
We claim that . Our choice of guarantees that whenever , which ensures that for all . Therefore it suffices to show inequalities of type .
Given any sequence , suppose that for some , but . Consider what happens to the left hand side of if we insert between and , and we insert between and to get a new sequence . (Note that and .) This reduces the left hand side of by
while the right hand side of is unchanged. Thus for the sequence is implied by for the new sequence . Since , by iteratively applying this procedure to the new sequence, we will eventually arrive at a sequence for which such an does not exist.
It therefore suffices to prove inequality in the case that there exists some such that and exactly when . If , then the left hand side of is
while the right hand side is
so this inequality follows from the corresponding inequality for . If , then consider the sequence obtained by inserting before , and after in the sequence. For , this yields the inequality
But , and the right side is strictly greater than (since ). Thus
or equivalently,
which is the inequality for . This completes the proof. ∎
2.3. Demazure operators and parapolytopes
To prove Theorem 1.1, we will need a formula for the character . The following formula is essentially a particular case of one due to Magyar [18]. (See also ReinerShimozono [22].) We first define the isobaric divided difference operator (or Demazure operator) acting on polynomials by
where is the polynomial obtained from by switching and . Note that if is symmetric in and .
Proposition 2.10.
Let be a columnconvex diagram with rows with . Define to be the diagram with rows such that , where . (Here, is obtained from by removing any column with a box in the first row and then shifting all remaining boxes up by one row.) Also let
the partition formed from all columns of with a box in the first row. Then
Proof.
Note that can be obtained from by switching the th and st row for , and then adding columns with boxes in rows for each . The result then follows immediately from [18] (see, for instance, Proposition 15). ∎
We now show that the polytope for can be constructed iteratively in a way that mimics the application of the operator . This geometric operation is the same as the operator given by Kiritchenko in [10] specialized for our current situation.
The key lemma is the following calculation.
Lemma 2.11.
Choose nonnegative integers , and , …, such that . Define the polynomial
Then
where .
Proof.
Note that reversing the order of each of the summations in the expression for gives
Hence
as desired. ∎
Consider with coordinates for . Let be the projection onto the coordinates for all .
Definition 2.12 ([10]).
A parapolytope is a convex polytope such that, for all , every fiber of the projection on is a coordinate parallelepiped.
In other words, for every and every set of constants (), there exist constants and (depending on the ) such that with for if and only if .
We denote this parallelepiped (which depends on and for ) by
Given a polytope , let be its integer point transform
and define to be the image of under the specialization sending
In other words, the point corresponds to the monomial in which the exponent of is , where .
Lemma 2.13.
Fix , and let be parapolytopes. Suppose that for any fixed integer point , the fiber over of the projection on is the (integer) parallelepiped
while the fiber over of on is
where and
Then .
Proof.
For fixed , the contribution to of the fiber over has the form
< 