Monotone Projection Lower Bounds from Extended Formulation Lower Bounds

Monotone Projection Lower Bounds from Extended Formulation Lower Bounds

[    No Authors Defined
Abstract

In this short note, we reduce lower bounds on monotone projections of polynomials to lower bounds on extended formulations of polytopes. Applying our reduction to the seminal extended formulation lower bounds of Fiorini, Massar, Pokutta, Tiwari, & de Wolf (STOC 2012; J. ACM, 2015) and Rothvoss (STOC 2014; J. ACM, 2017), we obtain the following interesting consequences.

  1. The Hamiltonian Cycle polynomial is not a monotone subexponential-size projection of the permanent; this both rules out a natural attempt at a monotone lower bound on the Boolean permanent, and shows that the permanent is not complete for non-negative polynomials in \cclass{VNP}_{\R} under monotone p-projections.

  2. The cut polynomials and the perfect matching polynomial (or “unsigned Pfaffian”) are not monotone p-projections of the permanent. The latter, over the Boolean and-or semi-ring, rules out monotone reductions in one of the natural approaches to reducing perfect matchings in general graphs to perfect matchings in bipartite graphs.

As the permanent is universal for monotone formulas, these results also imply exponential lower bounds on the monotone formula size and monotone circuit size of these polynomials.

grochow]Joshua A. Grochowthanks: The author was supported during this work by an Omidyar Fellowship from the Santa Fe Institute.

Theory of Computing, Volume 13 (18), 2017, pp. 0–0

www.theoryofcomputing.org

  

Monotone Projection Lower Bounds from Extended Formulation Lower Bounds

No Authors Defined

Received  November 10, 2015; Revised  July 27, 2016; Published  December 22, 2017


ACM Classification: F.1.3, F.2.1, G.1.6

AMS Classification: 68Q15, 68Q17, 90C05, 15A15, 05C70

Key words and phrases: lower bounds, algebraic circuit complexity, extended formulations of polytopes, Newton polytope, monotone formula, monotone circuit, projection, permanent, VNP, matching

1 Introduction

The permanent

\operatorname{perm}_{n}(X)=\sum_{\pi\in S_{n}}x_{1,\pi(1)}x_{2,\pi(2)}\cdots x% _{n,\pi(n)}

(where S_{n} denotes the symmetric group of all permutations of \{1,\ldots,n\}) has long fascinated combinatorists [17, 14, 18], more recently physicists [33, 2], and, since Valiant’s seminal paper [29], has also been a key object of study in computational complexity. Despite its beauty, the permanent has some computational quirks: in particular, although the permanent of integer matrices is \cclass{\#P}-complete and the permanent is \cclass{VNP}-complete in characteristic zero, the permanent mod 2 is the same as the determinant, and hence can easily be computed. In fact, computing the permanent mod 2^{k} is easy for any k [29], though the proof is more involved. Modulo any odd number n, the permanent of integer matrices is \cclass{Mod}_{n}\cclass{P}-complete [29].

In contrast, the seemingly similar Hamiltonian Cycle polynomial,

\operatorname{HC}_{n}(X)=\sum_{\text{$n$-cycles }\sigma}x_{1,\sigma(1)}x_{2,% \sigma(2)}\cdots x_{n,\sigma(n)}\,,

where the sum is only over n-cycles rather than over all permutations, does not have these quirks: the Hamiltonian Cycle polynomial is \cclass{VNP}-complete over any ring R [28] and \cclass{Mod}_{n}\cclass{P}-complete for all n (that is, counting Hamiltonian cycles is complete for these Boolean counting classes).

Jukna [12] observed that, over the Boolean semi-ring, if the Hamiltonian Cycle polynomial were a monotone p-projection of the permanent, there would be a 2^{n^{\Omega(1)}} lower bound on monotone circuits computing the permanent, a lower bound that still remains open. (The current record is still Razborov’s n^{\Omega(\log n)} [20].) Even over the real numbers, such a monotone p-projection would give an alternative proof of a 2^{n^{\Omega(1)}} lower bound on the permanent. (Jerrum and Snir [11] already showed the permanent requires monotone circuits of size 2^{\Omega(n)} over \R and over the tropical (\min,+) semi-ring.) Here, by building on Fiorini et al.’s [8] and Rothvoss’s [22] extended formulation lower bound for the TSP polytope, we show that no such monotone reduction exists—over \R, nor over the tropical semi-ring, nor over the Boolean semi-ring—by connecting monotone p-projections to extended formulations of polytopes.

In the past five years, there has been exciting progress on extended formulations of polytopes, which we leverage by using our new connection. Indeed, with this connection in hand, one immediately gets a monotone projection lower bound from essentially any lower bound on extended formulations. An extended formulation of a polytope P is another polytope in a higher-dimensional space that projects down onto P by an affine linear map. Since linear programming can be solved in polynomial time, and optima of linear programs are preserved by affine linear projections, solving the LP on the extended formulation allows one to solve the LP on the original polytope. Thus, if a polytope P has an extended formulation that is in some sense “small,” one can solve LP optimization problems over P by instead solving them over its smaller extended formulation; if the extended formulation is small enough, this would yield a polynomial-time algorithm. To show that such an extended formulation is not small, it suffices to prove a lower bound on its number of facets. In 1988, Yannakakis [34] ruled out a large and natural class of extended formulations of the TSP polytope—so-called symmetric extended formulations—thus showing that a certain natural class of algorithms for an \cclass{NP}-complete problem indeed did not solve it in polynomial time, and ruling out several attempted proofs that \cclass{P}=\cclass{NP}. But for more than 20 years, it was an open question of how to remove the condition of symmetry from Yannakakis’s result. In a landmark result, Fiorini, Massar, Pokutta, Tiwary, and de Wolf [8] achieved this, by showing an exponential lower bound on arbitrary extended formulations of several different polytopes. We will use their lower bound on the cut polytope below. Rothvoss [22] then showed such lower bounds on several other polytopes; we use his lower bound on the TSP polytope, improving that of Fiorini et al. [8], to get the result above.

We use the same connection to extended formulations, now in combination with Rothvoss’s lower bound on extended formulations of the perfect matching polytope [22], to show that the perfect matching polynomial or “unsigned Pfaffian”

\frac{1}{2^{n}n!}\sum_{\pi\in S_{2n}}\prod_{i=1}^{n}x_{\pi(2i-1),\pi(2i)}=\sum% _{\begin{subarray}{c}\pi\in S_{2n}\\ \pi(1)<\pi(3)<\cdots<\pi(2n-1)\\ \pi(2k-1)<\pi(2k)\;\forall k\end{subarray}}\prod_{i=1}^{n}x_{\pi(2i-1),\pi(2i)}

is not a monotone p-projection of the permanent. As the perfect matching polynomial counts perfect matchings in a general graph, and the permanent counts perfect matchings in a bipartite graph, it is interesting to consider this result in the context of the difference in complication between algorithms for finding perfect matchings in bipartite graphs (\eg, [19, 7]) and those for finding perfect matchings in general graphs (\eg, [6, 16, 32, 27]).

{remark}

[On the Boolean semi-ring] Our results also hold for formal polynomials over the Boolean semi-ring \mathbb{B}=(\{0,1\},\vee,\wedge). Over the Boolean semi-ring, the permanent is the indicator function of the existence of a perfect matching in a bipartite graph, and the unsigned Pfaffian is the indicator function of a perfect matching in a general graph. However, over \mathbb{B}, each function is represented by more than one formal polynomial, and we do not know how to extend our results to the setting of functions over \mathbb{B}. See Section 5 for details and specific questions.

We also use the same technique, this time in combination with the lower bound of Fiorini et al. on extended formulations of the cut polytope [8], to show that the cut polynomials

\operatorname{Cut}^{q}=\sum_{A\subseteq[n]}\prod_{i\in A,j\notin A}x_{ij}^{q-1}

are not monotone p-projections of the permanent. Perhaps the main complexity-theoretic interest in the cut polynomials is that \operatorname{Cut}^{q} over the finite field \mathbb{F}_{q} was (until recently [15]) the only known example of a natural polynomial that is neither expected to be in \cclass{VP}_{\mathbb{F}_{q}} nor to be \cclass{VNP}_{\mathbb{F}_{q}}-complete. (Indeed, either its membership in \cclass{VP}_{\mathbb{F}_{q}} or its \cclass{VNP}_{\mathbb{F}_{q}}-completeness would imply the collapse of the polynomial-time hierarchy [4], contradicting a standard complexity-theoretic hypothesis.) There Bürgisser also showed that if \cclass{VP}_{\mathbb{F}_{q}}\neq\cclass{VNP}_{\mathbb{F}_{q}} then such polynomials of intermediate complexity must exist. In that paper, Bürgisser asked whether the cut polynomials, considered as polynomials over the rationals, were \cclass{VNP}_{\Q}-complete.111\operatorname{Cut}^{2} was subsequently shown to be \cclass{VNP}_{\Q}-complete under circuit reductions [23]; its completeness under projections remains open. Although our results don’t touch on this question, these previous results motivate the study of these polynomials over \Q.

Because the permanent is universal for monotone formulas, our lower bounds also imply exponential lower bounds on the monotone algebraic formula size—and, by balancing algebraic circuits, monotone algebraic circuit size—of these polynomials; see Section 4.2.

Finally, we note that our results shed a little more light on the intricacy of the known \cclass{VNP}-completeness proofs for the permanent [29, 3, 1]. Namely, prior to our result, the fact that the permanent is not hard modulo 2 already implied that any completeness result must use 2 in a “bad” way: for example, dividing by 2 somewhere. This is indeed true of Valiant’s original proof [29], Ben-Dor & Halevi’s proof [3], and Aaronson’s quantum linear-optics proof [1].

{remark}

One might hope for a classical analogue of Aaronson’s quantum proof, using the characterization of \cclass{BPP} in terms of stochastic matrices as a replacement for the characterization of \cclass{BQP} using unitary matrices. However, our result indicates that the most straightforward adaptation of Aaronson’s proof from the \cclass{BQP} setting to the \cclass{BPP} setting cannot work, as the use of stochastic matrices in this manner would produce a monotone reduction.

Our results also imply the necessity of the use of negative numbers in Valiant’s 4\times 4 gadget [29, p. 195] and Ben-Dor and Halevi’s 7\times 7 gadget [3, App. A]. In light of these results, Valiant’s 4\times 4 gadget may perhaps seem less mysterious than the fact that such a gadget exists that is only 4\times 4!

To prove these results, we show that a monotone projection between non-negative polynomials essentially implies that the Newton polytope of one polynomial is an extension of the Newton polytope of the other (Lemma 3), and then apply known lower bounds on the extension complexity of certain polytopes. We hope that the connection between Newton polytopes, monotone projections, and extended formulations finds further use.

2 Preliminaries

A polynomial f(x_{1},\ldots,x_{n}) is a (simple) projection of a polynomial g(y_{1},\ldots,y_{m}) if f can be constructed from g by replacing each y_{i} with a constant or with some x_{j}. The polynomial f is an affine projection of g if f can be constructed from g by replacing each y_{i} with an affine linear function \pi_{i}(\vec{x}). When we say “projection” we mean simple projection. Given two families of polynomials, (f_{n}) and (g_{n}), if there is a function p(n) such that f_{n} is a projection of g_{p(n)} for all sufficiently large n, then we say that (f_{n}) is a projection of (g_{n}) with blow-up p(n). If (f_{n}) is a projection of (g_{n}) with polynomial blow-up, we say that (f_{n}) is a p-projection of (g_{n}).

Over any subring of \R—or more generally any totally ordered semi-ring (see below)—a monotone projection is a projection in which all constants appearing in the projection are non-negative. Monotone p-projection is defined analogously.

To each monomial x_{1}^{e_{1}}\cdots x_{n}^{e_{n}} we associate its exponent vector (e_{1},\ldots,e_{n}), as a point in \N^{n}\subseteq\R^{n}. These vectors determine the Newton polytope, defined as follows. {definition} The Newton polytope of a polynomial f(x_{1},\ldots,x_{n}), denoted \operatorname{Newt}(f), is the convex hull in \R^{n} of the exponent vectors of all monomials appearing in f with non-zero coefficient.

A polytope is integral if all its vertices have integer coordinates; note that Newton polytopes are always integral. A face of a polytope P is the intersection of P with a linear space L such that none of the interior points of P lie in L.

For a polytope P, let \operatorname{c}(P) denote the “complexity” of P, as measured by the minimal number of linear inequalities needed to define P (equivalently, the number of faces of P of dimension \dim P-1). A polytope Q\subseteq\R^{m} is an extension or extended formulation of P\subseteq\R^{n} if there is an affine linear map \ell\colon\R^{m}\to\R^{n} such that \ell(Q)=P. The extension complexity of P, denoted \operatorname{xc}(P), is the minimum complexity of any extension of P (of any dimension): \operatorname{xc}(P)=\min\{\operatorname{c}(Q)\mid\text{$Q$ is an extension of% $P$}\}.

The m-th cycle cover polytope (also known as the bipartite perfect matching polytope) is the convex hull in \R^{m^{2}} of the \{0,1\}-indicator functions of the directed cycle covers of the complete directed graph with self-loops on m vertices. The cycle cover polytope is the Newton polytope of the permanent, as each monomial in the permanent corresponds to such a cycle cover.

A totally ordered semi-ring (we only consider commutative ones here) is a totally ordered set together with two operations, denoted (R,\leq,\times,+,1,0) such that (R,\times,1) and (R,+,0) are both commutative monoids, \times distributes over +, 0\times a=0 for all a, a+c\leq b+c whenever a\leq b, and ac\leq bc whenever a\leq b and 0\leq c. An element c of a totally ordered semi-ring is non-negative if 0\leq c, and is positive if furthermore c\neq 0. We will restrict our attention to non-zero totally ordered semi-rings; equivalently, we assume 1\neq 0. Note that in a totally ordered semiring, 1+\cdots+1 is never zero.

The following totally ordered semi-rings are of particular interest.

  • The real numbers with its usual ordering and arithmetic operations, (\R,\leq,\times,+).

  • The so-called “tropical semi-ring” (\R,\leq,+,\min), which is the real numbers with its usual ordering, where the product is taken to be real addition and the addition operation is taken to be the minimum.

  • The Boolean and-or semi-ring \mathbb{B}=(\{0,1\},\leq,\wedge,\vee), where 0\leq 1.

To get a feel for the latter two semi-rings, note that polynomials over the tropical semi-ring generally compute some optimization problem, and over \mathbb{B} generally compute a decision problem. For example, the Hamiltonian Cycle polynomial over the tropical semi-ring computes the Traveling Salesperson Problem, and over \mathbb{B}, the indicator function of the existence of a Hamiltonian cycle. Note that over \R, if two formal polynomials compute the same function then they must be identical, but this is not true over the tropical or Boolean semi-rings.

3 Main lemma

{lemma}

Let R be a totally ordered semi-ring, and let f(x_{1},\ldots,x_{n}) and g(y_{1},\ldots,y_{m}) be polynomials over R with non-negative coefficients. If f is a monotone projection of g, then some face of \operatorname{Newt}(g) is an extension of \operatorname{Newt}(f). In particular, \operatorname{xc}(\operatorname{Newt}(f))\leq\operatorname{c}(\operatorname{% Newt}(g)).

Proof.

Under simple projections, a monomial in the y_{i} maps to some scalar multiple of a monomial in the x_{j} (possibly the empty monomial, resulting in a constant term, or possibly the zero multiple, resulting in zero). Let \pi be a monotone projection map, defined on the variables y_{i}, and extended naturally to monomials and terms in the y_{i}. (Recall that a term of a polynomial is a monomial together with its coefficient.) Since each term t of g is a monomial multiplied by a positive coefficient, and since \pi is non-negative, \pi(t) is either zero or a single monomial in the x_{j} with nonzero coefficient. The former situation can happen only if t contains some variable y_{i} such that \pi(y_{i})=0. Let \ker(\pi) denote the set \{y_{i}\mid\pi(y_{i})=0\}. Thus, for every term t of g that is disjoint from \ker(\pi), \pi(t) actually appears in f—possibly with a different coefficient, but still non-zero—since no terms can cancel under projection by \pi.

Let e_{1},\ldots,e_{m} be the coordinate functions on \R^{m}, the ambient space of \operatorname{Newt}(g); that is, e_{i}\colon\R^{m}\to\R is projection onto the i-th coordinate. Let K denote the subspace of \R^{m} defined by the equations e_{i}=0 for each i such that y_{i}\in\ker(\pi). Let P be the intersection of \operatorname{Newt}(g) with K, considered as a polytope in K; since all vertices of \operatorname{Newt}(g) are non-negative, intersecting \operatorname{Newt}(g) with a coordinate hyperplane, e_{i}=0, results in a face of \operatorname{Newt}(g), and thus P is a face of \operatorname{Newt}(g). Note that P is exactly the convex hull of the exponent vectors of monomials in g that are disjoint from \ker(\pi). In particular, since \pi is multiplicative on monomials, it induces a linear map \ell_{\pi} from K to \R^{n} (the ambient space of \operatorname{Newt}(f)). By the previous paragraph, the exponent vectors of f are exactly \ell_{\pi} applied to the exponent vectors of monomials in g that are disjoint from \ker(\pi). By the linearity of \ell_{\pi} and the convexity of P and \operatorname{Newt}(f), we have that \operatorname{Newt}(f)=\ell_{\pi}(P), so P is an extension of \operatorname{Newt}(f). Since P is defined by intersecting \operatorname{Newt}(g) with additional linear equations, the lemma follows. ∎

Several partial converses to our Main Lemma also hold. Perhaps the most natural and interesting of these is the following.

Observation \thetheorem.

Let R be a totally ordered semi-ring. Given any sequence of non-negative integral polytopes P_{n}\subseteq\R^{n} such that the \operatorname{poly}(n)-th cycle cover polytope is an extension of P_{n} along an affine linear map \ell_{n}\colon\R^{\operatorname{poly}(n)}\to\R^{n} with integer coefficients of polynomial bit-length, there is a sequence of polynomials (f_{n})\in\cclass{VNP}_{R} such that \operatorname{Newt}(f_{n})=P_{n} and f is a monotone p-projection of the permanent.

Proof.

Let C_{m} denote the m-th cycle cover polytope, let m(n) be a polynomial such that C_{m(n)} is an extended formulation of P_{n}, and let b(n) be a polynomial upper bound on the bit-length of the coefficients of \ell_{n}. Let V_{m} denote the vertex set of the cycle cover polytope, \ie, the incidence vectors of cycle covers. Define f_{n} as

\sum_{\vec{e}\in V_{m}}\vec{y}^{\ell_{n}(\vec{e})}\,,

where \vec{y}=(y_{1},\ldots,y_{n}), and the vector notation \vec{y}^{\vec{e}^{\prime}} is defined as y_{1}^{e_{1}^{\prime}}y_{2}^{e_{2}^{\prime}}\cdots y_{n}^{e_{n}^{\prime}}. Note that \ell_{n} has only integer coefficients by assumption, and each \vec{e}\in V_{m} is integral, so the vector \ell_{n}(\vec{e}) is integral, and the above expression is a well-defined Laurent polynomial. To see that all the exponents are non-negative, note that by assumption each \ell_{n}(\vec{e}) lies in P_{n}, which is itself a non-negative polytope, so the above expression is in fact a well-defined polynomial. By construction, every exponent vector of f_{n} is in \ell_{n}(C_{m(n)})=P_{n}. Conversely, every vertex of P_{n} is an exponent vector of f_{n}, since its coefficient is simply 1+1+\cdots+1, which is never zero in a totally ordered semi-ring. (Without noting this, it would be possible that k distinct vertices in V_{m} would get mapped to the same point under \ell_{n}, and then the corresponding monomials \vec{y}^{\ell_{n}(\vec{e})} might add up to 0 in f_{n}.) Thus \operatorname{Newt}(f_{n})=P_{n}. Furthermore, f_{n} is a monotone nonlinear projection of the permanent using the map x_{ij}\mapsto\vec{y}^{\ell((0,0,\ldots,1,\ldots,0))}, where the 1 is in the (i,j) position. Using the universality of the permanent and repeated squaring, this can easily be turned into a monotone simple projection of the permanent of size \operatorname{poly}(m(n),b(n)). ∎

This can be generalized from the cycle cover polytopes and the permanent to arbitrary integral polytopes and the natural associated polynomial (the sum over all monomials whose exponent vectors are vertices of the polytope), but at the price of using “monomial projections”—in which each variable is replaced by a monomial—rather than simple projections. There ought to be a version of this observation over sufficiently large fields and allowing rational coefficients in \ell, using Strassen’s division trick [26], but the only such versions the author could come up with had so many hypotheses as to seem uninteresting.

4 Applications

4.1 Projection lower bounds

{remark}

The following theorems hold over any totally ordered semi-ring, including the Boolean and-or semi-ring, the non-negative real numbers under multiplication and addition, and the tropical semi-ring of real numbers under addition and \min. To see that this introduces no additional difficulty, note that over any totally ordered semi-ring R, the Newton polytope of a polynomial over R is still a polytope in a vector space over the real numbers, so standard results on polytopes and the cited results on extension complexity still apply.

{theorem}

[Main Lemma + Rothvoss’s TSP polytope lower bound] Over any totally ordered semi-ring, the Hamiltonian Cycle polynomial is not a monotone affine p-projection of the permanent; in fact, any monotone affine projection from the permanent to the Hamiltonian Cycle polynomial has blow-up at least 2^{\Omega(n)}.

We will need the following folklore lemma; as we could not find a proof in the literature, we a sketch its well-known proof here for completeness, and so that it can be verified that the standard proof preserves monotonicity.

{lemma}

[Folklore] If an n-variable polynomial is an affine projection of the m\times m permanent, then it is a simple projection of the N\times N permanent for N=m+(n+1)m^{2}. The same holds with “affine projection” replaced by “monotone affine projection” in both places.

Proof sketch.

Let \pi_{ij}(\vec{x}) be the affine linear function corresponding to the variable y_{ij} of the m\times m permanent, and write \pi_{ij}=a_{0}+a_{1}x_{1}+\cdots+a_{n}x_{n}. Let G be the complete directed graph with loops on m vertices and edge weights y_{ij}. Replace the edge (i,j) by n+1 parallel edges with weights a_{0},a_{1}x_{1},\cdots,a_{n}x_{n}. Add a new vertex on each of these parallel edges, splitting each parallel edge into two. For the edge weighted a_{0}, the two edges have weights 1,a_{0}, and for the remaining edges the new edges get weights a_{i},x_{i}. On each of the added vertices, add a self-loop of weight 1. Now consider the permanent of the weighted adjacency matrix of this edge-weighted directed graph. It is a simple exercise to see that this has the desired effect. Note also that if the original affine projection \pi was monotone, then so is the constructed simple projection. ∎

Proof of Theorem 4.1.

By Lemma 4.1, it suffices to show the result for simple projections. If the Hamiltonian Cycle polynomial were a monotone projection of the permanent, then by the Main Lemma, some face of \operatorname{Newt}(\operatorname{perm}) would be an extension of \operatorname{Newt}(\operatorname{HC}).

The Newton polytope of the permanent is the cycle cover polytope (see Section 2). The cycle cover polytope can easily be described by the m^{2} inequalities asserting that all variables x_{i,j} are non-negative, together with the equalities asserting that each vertex has in-degree and out-degree exactly 1, namely \sum_{i}x_{i,j}=1 for all j and \sum_{j}x_{i,j}=1 for all i. (It is easy to see that these are necessary; for sufficiency, see, \eg, [25, Theorem 18.1].) Since equalities do not count towards the complexity of a polytope, we have \operatorname{c}(\operatorname{Newt}(\operatorname{perm}_{m}))\leq m^{2}.

But the Newton polytope of the n-th Hamiltonian Cycle polynomial is exactly the TSP polytope, which, by a recent result by Rothvoss [22, Corollary 2], requires extension complexity 2^{\Omega(n)}. ∎

{theorem}

[Main Lemma + Rothvoss’s perfect matching polytope lower bound] Over any totally ordered semi-ring, the perfect matching polynomial (or “unsigned Pfaffian”) is not a monotone affine p-projection of the permanent; in fact, any monotone affine projection from the permanent to the perfect matching polynomial has blow-up at least 2^{\Omega(n)}.

Proof.

The proof is the same as for the Hamiltonian Cycle polynomial, using [22, Theorem 1] by Rothvoss, which gives a lower bound of 2^{\Omega(n)} on the extension complexity of the perfect matching polytope, which is the Newton polytope of the perfect matching polynomial. ∎

{theorem}

[Main Lemma + Fiorini et al.’s cut polytope lower bound] Over any totally ordered semi-ring, for any q, the q-th cut polynomial is not a monotone affine p-projection of the permanent; in fact, any monotone affine projection from the permanent to the q-th cut polynomial has blow-up at least 2^{\Omega(n)}.

Proof.

Use [8, Theorem 7] by Fiorini et al. which says that \operatorname{xc}(\operatorname{Newt}(\operatorname{Cut}^{2}))\geq 2^{\Omega(n)}, as \operatorname{Newt}(\operatorname{Cut}^{2}) is the cut polytope. The one additional observation we need is that \operatorname{Newt}(\operatorname{Cut}^{q}) is just the (q-1)-scaled version of \operatorname{Newt}(\operatorname{Cut}^{2}), and this rescaling does not affect the extension complexity. ∎

4.2 Monotone formula and circuit lower bounds

As pointed out by an anonymous reviewer, the universality of the permanent for formula size also holds in the monotone setting, so lower bounds on monotone projections from the permanent imply the same lower bounds on monotone formula size, and therefore quasi-polynomially related lower bounds on monotone circuit size. We assume circuits only have gates of bounded fan-in; with unbounded fan-in, rather than losing a factor of a half in the exponent of the exponent, we lose a factor of a third.

{proposition}

Any polynomial computable by a monotone formula of size s is a monotone projection of \operatorname{perm}_{s+1}.

Proof.

The proof of the universality of the permanent given in [5, Proposition 2.16] works mutatis mutandis in the monotone setting. ∎

As a consequence of this, Theorems 4.14.1 are nearly tight, since every monotone polynomial in n variables of \operatorname{poly}(n) degree can be written as a monotone formula of size 2^{O(n\log n)} (write it as a sum of monomials).

{corollary}

Over any totally ordered semi-ring, any monotone formula computing the Hamiltonian Cycle polynomial, the perfect matching polynomial, or the q-th cut polynomial has size at least 2^{\Omega(n)}. Consequently, any monotone circuit computing these polynomials has size at least 2^{\Omega(\sqrt{n})}.

For the cut polynomials, we believe this result to be new. For the other polynomials, this provides a new proof of (slightly weaker versions of) previously known lower bounds. Namely, Jerrum and Snir gave a lower bound of (n-1)((n-2)2^{n-3}+1)=2^{n+\Omega(\log n)} on the monotone circuit size of \operatorname{HC} [11, Section 4.4], and a lower bound of n(2^{n-1}-1) on the monotone circuit size of the permanent [11, Section 4.3]. As the permanent is a monotone projection of the perfect matching polynomial—namely, restrict the perfect matching polynomial to a bipartite graph, \eg, by setting x_{ij}=0 whenever i and j have the same parity—the same lower bound holds for the perfect matching polynomial.

Proof.

The first part follows by combining Proposition 4.2 with Theorems 4.14.1. The second part follows from the fact that monotone circuits of size s can be balanced to have size \operatorname{poly}(s) and depth O(\log^{2}s) (the proof in [31] works mutatis mutandis in the monotone setting), which can then be converted to monotone formulas of size s^{O(\log s)}=2^{O(\log^{2}s)} by the usual conversion from bounded fan-in circuits to formulas. If there is a monotone circuit of size s computing any of these polynomials, there is thus a monotone formula of size 2^{O(\log^{2}s)}, which must be at least 2^{\Omega(n)}, so s\geq 2^{\Omega(n^{1/2})}. ∎

5 Open questions

Despite the common feeling that Razborov’s super-polynomial lower bound [20] on monotone Boolean circuits for CLIQUE “finished off” monotone Boolean circuit lower bounds, several natural and interesting question remain. For example, does Directed s-t Connectivity require monotone Boolean circuits of size \Omega(n^{3})? (A matching upper bound is given by the Bellman–Ford algorithm.) Is there a monotone Boolean reduction from general perfect matching to bipartite perfect matching? A positive answer to the following question would rule out such monotone (projection) reductions.

Open Question \thetheorem.

Extend Theorem 4.1 from formal polynomials over the Boolean semi-ring to Boolean functions.

However, there are even easier questions, intermediate between the Boolean function case and the algebraic case considered in this paper; Jukna [13] discusses the notion of one polynomial “counting” another, which means that they agree on all \{0,1\} inputs.

Open Question \thetheorem.

Prove that no monotone polynomial-size projection of the permanent agrees with the perfect matching polynomial on all \{0,1\} inputs (“counts the perfect matching polynomial”). Similarly, prove that no monotone polynomial-size projection of the permanent counts the Hamiltonian cycle polynomial.

S. Jukna points out (personal communication) that projections of the s-t connectivity polynomial correspond, even in the Boolean setting, to switching-and-rectifier networks, so the known lower bounds on monotone switching-and-rectifier networks (see, \eg, the survey [21]) imply that the Hamiltonian path polynomial and the permanent are not monotone p-projections of the s-t connectivity polynomial, even over the Boolean semi-ring. This helps explain why the only known monotone lower bound on the s-t connectivity polynomial that we are aware of [13] goes by a somewhat roundabout proof: Razborov’s lower bound on CLIQUE [20], followed by Valiant’s reduction from the clique polynomial to the Hamiltonian path polynomial [28], followed by a standard reduction from Hamiltonian path to counting s-t paths. In the course of discussing this, we were led to the following question; although the motivation for the question has since disappeared, it still seems like an interesting question about polytopes, whose answer may require new methods.

Open Question \thetheorem (S. Jukna, personal communication).

Is the m-th s-t path polytope an extension of the n-th TSP polytope (or n-th cycle cover polytope) with m\leq\operatorname{poly}(n)?

Since the separation problem for the s-t path polytope is \cclass{NP}-hard (see, \eg, [25, §13.1])—and the cycle cover polytope has low (extension) complexity—answering this question negatively seems to require more subtle understanding of these polytopes than “simply” an extended formulation lower bound.

Another example of a natural polytope question with a similar flavor comes from the cut polynomials. In combination with Bürgisser’s results and questions on the cut polynomials [4] (discussed in Section 1), we are led to the following question.

Open Question \thetheorem.

Is the m-th cut polytope an extension of the n-th TSP polytope, for m\leq\operatorname{poly}(n)?

A negative answer would show that \operatorname{Cut}^{q} is not complete for non-negative polynomials in \cclass{VNP}_{\Q} under monotone p-projections, though as with the example of the permanent, this is not necessarily an obstacle to being \cclass{VNP}-complete under general p-projections. Yet even the monotone completeness of the cut polynomials remains open. In fact, even more basic questions remain open:

Open Question \thetheorem.

Is every non-negative polynomial in \cclass{VNP} a monotone projection of the Hamiltonian Cycle polynomial? Is there any polynomial that is “positive \cclass{VNP}-complete” in this sense?

To relate this to the current proofs of \cclass{VNP}-completeness of \operatorname{HC}_{n}, we need to draw a distinction. Let \cclass{VP}_{\R}^{\geq 0} denote the polynomial families in \cclass{VP}_{\R} all of whose coefficients are non-negative, and let \cclass{mVP}_{\R} (“monotone \cclass{VP}”) denote the class of families of polynomials with polynomially many variables, of polynomial degree, and computable by polynomial-size monotone circuits over \R. Similarly, define \cclass{VNP}_{\R}^{\geq 0} to be the non-negative polynomials in \cclass{VNP}_{\R}, and \cclass{mVNP}_{\R} to be the function families of the form

f_{n}=\sum_{\vec{e}\in\{0,1\}}^{\operatorname{poly}(n)}g_{m}(\vec{e},\vec{x})\,,

where m\leq\operatorname{poly}(n) and (g_{m})\in\cclass{mVP}_{\R}.

Valiant’s original completeness proof for the Hamiltonian Cycle polynomial [28] is “mostly” monotone: it uses polynomial-size formulas for the coefficients of the monomials (coming from the definition of \cclass{VNP}), but otherwise is entirely monotone. In other words, the proof shows that \operatorname{HC} is \cclass{mVNP}-hard under monotone projections. However, we note that it is not clear whether \operatorname{HC} is even in \cclass{mVNP}! Question 5 asks whether \operatorname{HC}, or indeed any polynomial, is \cclass{VNP}^{\geq 0}-complete under monotone projections; the question of whether there exist polynomials that are \cclass{mVNP}-complete under monotone projections also seems potentially interesting.

Finally, we ask about stronger notions of monotone reduction, which seem to require a different kind of proof technique. Recall that a c-reduction from f to g is a family of polynomial-size algebraic circuits for f with oracle gates for g.

Open Question \thetheorem.

Do the analogues of Theorems 4.14.1 hold for monotone bounded-depth c-reductions in place of affine p-projections? What about weakly-skew or even general monotone c-reductions?

6 Subsequent developments

Since the appearance of the preliminary version of this paper [9], our Main Lemma 3 has been used by Mahajan and Saurabh [15] to prove that several other polynomials of combinatorial and complexity-theoretic interest are not subexponential-size projections of the permanent.

  1. The n-th satisfiability polynomial over \mathbb{F}_{q} is a polynomial in n+8\binom{n}{3} variables denoted X_{1},\ldots,X_{n} and \{Y_{c}:c\in C_{n}\} where C_{n} denote the set of clauses on 3 literals in n variables. It is defined as

    \operatorname{Sat}^{q}_{n}(X,Y)=\sum_{a\in\{0,1\}^{n}}\left(\prod_{i\in[n]}X_{% i}^{q-1}\right)\left(\prod_{c\in C_{n}:c(a)=1}Y_{c}^{q-1}\right)\,.
  2. A clow in an n-vertex graph is a closed walk of length exactly n, in which the minimum-numbered vertex appears exactly once. The n-th clow polynomial over \mathbb{F}_{q} is a polynomial in \binom{n}{2}+n variables X_{e} for each edge e in the complete undirected graph K_{n} on n vertices and Y_{v} for each v\in[n]. It is defined as

    \operatorname{Clow}^{q}_{n}(X,Y)=\sum_{w:\text{clow of length $n$}}\left(\prod% _{e:\text{edges in $w$}}X_{e}^{q-1}\right)\left(\prod_{v:\text{distinct % vertices in $w$}}Y_{v}^{q-1}\right),

    or more precisely,

    \operatorname{Clow}^{q}_{n}(X,Y)=\sum_{w=[v_{0},\ldots,v_{n-1}]}\left(\prod_{i% \in[n]}X_{(v_{i-1},v_{i\text{ mod }n})}^{q-1}\right)\left(\prod_{v\in\{v_{0},% \ldots,v_{n-1}\}}Y_{v}^{q-1}\right),

    where the sum is over clows w and v_{0} denotes the minimum-numbered vertex in w.

  3. The clique polynomial is a polynomial in \binom{n}{2} variables X_{e}:

    \operatorname{Clique}_{n}(X)=\sum_{\begin{subarray}{c}T\subseteq\binom{[n]}{2}% \\ \text{$T$ is a clique in $K_{n}$}\end{subarray}}\prod_{e\in T}X_{e}\,.
Theorem (Mahajan and Saurabh [15, Theorems 2 and 6]).

Over any totally ordered semi-ring, any monotone affine projection from the permanent to \operatorname{Sat}^{q}_{n} or to the clique polynomial requires blow-up at least 2^{\Omega(\sqrt{n})}. Any monotone affine projection from the permanent to \operatorname{Clow}^{q}_{n} requires blow-up at least 2^{\Omega(n)}.

As in Section 4.2, we get the following corollary. Again, we note that the lower bound on the clique polynomial over the Boolean semi-ring only works for the formal clique polynomial (in contrast to Razborov’s result [20], which works for any monotone Boolean circuit computing the CLIQUE function).

{corollary}

Over any totally ordered semi-ring, any monotone formula computing \operatorname{Clow}^{q}_{n} has size at least 2^{\Omega(n)} and any monotone circuit computing \operatorname{Clow}^{q}_{n} has size at least 2^{\Omega(\sqrt{n})}. Any monotone formula computing \operatorname{Sat}^{q}_{n} or \operatorname{Clique}_{n} has size at least 2^{\Omega(\sqrt{n})} and any monotone circuit computing these polynomials has size at least 2^{\Omega(n^{1/4})}.

For the clow and satisfiability polynomials, we believe this result to be new. For the clique polynomials, this provides a new proof of a weaker version of the exponential monotone circuit lower bound due to Schnorr [24].222Schnorr showed a \binom{n}{k}-1 lower bound on the monotone circuit size of the the k-th clique polynomial \operatorname{Clique}^{k}_{n}, the sum over all cliques of size k, rather than all cliques. For k=n/2, this lower bound is asymptotically equal to 2^{n}/\sqrt{\pi n/2}. The k-th clique polynomial \operatorname{Clique}_{n}^{k} is the degree k homogeneous component of the clique polynomial \operatorname{Clique}_{n}; by homogenization (implicit in Strassen’s work, explicit in Valiant [30, Lemma 2]), any monotone circuit of size s for \operatorname{Clique}_{n} can be converted into a monotone circuit of size s(n/2+1)^{2} computing \operatorname{Clique}^{n/2}_{n}. Thus Schnorr’s result implies a lower bound of \Omega(2^{n}/n^{5/2}) on the monotone circuit complexity of \operatorname{Clique}_{n}.


Acknowledgment. We would like to thank Stasys Jukna for the question that motivated this paper [12], and cstheory.stackexchange.com for providing a forum for the question. We also thank Stasys for comments on a draft, pointing out the paper by Schnorr [24], and interesting discussions leading to Questions 5 and 5. We thank Leslie Valiant for an interesting conversation that led to Question 5. We thank Ketan Mulmuley and Youming Qiao for collaborating on [10], which is why the author had Newton polytopes on the mind. We thank an anonymous reviewer for pointing out the monotone universality of the permanent and therefore the implications for monotone formula and circuit size (Section 4.2 and Corollary 6). We thank Laci Babai for detailed comments on the journal submission.

References

  • [1] Scott Aaronson: A linear-optical proof that the permanent is \mathsf{\#P}-hard. Proc. Royal Soc. London A, 467(2136):3393–3405, 2011. [doi:10.1098/rspa.2011.0232, arXiv:1109.1674]
  • [2] Scott Aaronson and Alex Arkhipov: The computational complexity of linear optics. Theory of Computing, 9(4):143–252, 2013. Preliminary version in STOC’11. [doi:10.4086/toc.2013.v009a004, arXiv:1011.3245]
  • [3] Amir Ben-Dor and Shai Halevi: Zero-one permanent is \mathsf{\#P}-complete, a simpler proof. In Proc. 2nd Israeli Symp. on Theory and Computing Systems. IEEE Comp. Soc. Press, 1993. [doi:10.1109/ISTCS.1993.253457]
  • [4] Peter Bürgisser: On the structure of Valiant’s complexity classes. Discr. Math. & Theoret. Comput. Sci., 3(3):73–94, 1999. HAL. Preliminary version in STACS’98.
  • [5] Peter Bürgisser: Completeness and Reduction in Algebraic Complexity Theory. Volume 7 of Algorithms and Computation in Mathematics. Springer, 2000. [doi:10.1007/978-3-662-04179-6]
  • [6] Jack Edmonds: Paths, trees, and flowers. Canad. J. Math., 17:449–467, 1965. [doi:10.4153/CJM-1965-045-4]
  • [7] Stephen A. Fenner, Rohit Gurjar, and Thomas Thierauf: Bipartite perfect matching is in quasi-NC. In Proc. 48th STOC, pp. 754–763. ACM Press, 2016. [doi:10.1145/2897518.2897564, arXiv:1601.06319]
  • [8] Samuel Fiorini, Serge Massar, Sebastian Pokutta, Hans Raj Tiwary, and Ronald de Wolf: Exponential lower bounds for polytopes in combinatorial optimization. J. ACM, 62(2):17:1–23, 2015. Preliminary version in STOC’12. [doi:10.1145/2716307, arXiv:1111.0837]
  • [9] Joshua A. Grochow: Monotone projection lower bounds from extended formulation lower bounds, 2015. ECCC TR15-171. [arXiv:1510.08417]
  • [10] Joshua A. Grochow, Ketan D. Mulmuley, and Youming Qiao: Boundaries of \mathsf{VP} and \mathsf{VNP}. In Proc. 43rd Internat. Colloq. on Automata, Languages and Programming (ICALP’16), pp. 34:1–34:14. Springer, 2016. [doi:10.4230/LIPIcs.ICALP.2016.34, arXiv:1605.02815]
  • [11] Mark Jerrum and Marc Snir: Some exact complexity results for straight-line computations over semirings. J. ACM, 29(3):874–897, 1982. [doi:10.1145/322326.322341]
  • [12] Stasys Jukna: Why is Hamilton cycle so different from permanent? StackExchange, 2014.
  • [13] Stasys Jukna: Lower bounds for monotone counting circuits. Discr. Appl. Math., 213:139–152, 2016. Preliminary version in ECCC TR14-169. [doi:10.1016/j.dam.2016.04.024, arXiv:1502.01865]
  • [14] Jacobus H. van Lint and Richard M. Wilson: A Course in Combinatorics. Cambridge Univ. Press, 2001.
  • [15] Meena Mahajan and Nitin Saurabh: Some complete and intermediate polynomials in algebraic complexity theory. In Proc. 11th Comput. Sci. Symp. in Russia (CSR’16), pp. 251–265. Springer, 2016. Full version available at ECCC TR16-038. [doi:10.1007/978-3-319-34171-2_18, arXiv:1603.04606]
  • [16] Silvio Micali and Vijay V. Vazirani: An O(sqrt(|V|) |E|) algorithm for finding maximum matching in general graphs. In Proc. 12th STOC, pp. 17–27. ACM Press, 1980. [doi:10.1109/SFCS.1980.12]
  • [17] Henryk Minc: Permanents. Cambridge Univ. Press, 1984.
  • [18] Thomas Muir and William H. Metzler: A Treatise on the Theory of Determinants. Dover, 1960.
  • [19] Ketan Mulmuley, Umesh V. Vazirani, and Vijay V. Vazirani: Matching is as easy as matrix inversion. Combinatorica, 7(1):105–113, 1987. Preliminary version in STOC’87. [doi:10.1007/BF02579206]
  • [20] Alexander A. Razborov: Lower bounds on monotone complexity of the logical permanent function. Math. Notes, 37(6):485–493, 1985. [doi:10.1007/BF01157687]
  • [21] Alexander A. Razborov: Lower bounds for deterministic and nondeterministic branching programs. In Fundamentals of Computation Theory (FCT’91), volume 529 of LNCS, pp. 47–60. Springer, 1991. [doi:10.1007/3-540-54458-5_49]
  • [22] Thomas Rothvoß: The matching polytope has exponential extension complexity. J. ACM, 64(6):41:1–19, 2017. Preliminary version in STOC’14. [doi:10.1145/3127497, arXiv:1311.2369]
  • [23] Nicolas de Rugy-Altherre: A dichotomy theorem for homomorphism polynomials. In Proc. 37th Internat. Symp. Math. Found. Comput. Sci. (MFCS’12), pp. 308–322. Springer, 2012. [doi:10.1007/978-3-642-32589-2_29, arXiv:1210.7641]
  • [24] Claus-Peter Schnorr: A lower bound on the number of additions in monotone computations. Theoret. Comput. Sci., 2(3):305–315, 1976. [doi:10.1016/0304-3975(76)90083-9]
  • [25] Alexander Schrijver: Combinatorial optimization. Polyhedra and efficiency. Vol. A. Volume 24 of Algorithms and Combinatorics. Springer, 2003. Chapters 1–38.
  • [26] Volker Strassen: Vermeidung von Divisionen. J. Reine Angew. Math., 1973(264):184–202, 1973. [doi:10.1515/crll.1973.264.184]
  • [27] Ola Svensson and Jakub Tarnawski: The matching problem in general graphs is in quasi-NC. In Proc. 58th FOCS, pp. 696–707. IEEE Comp. Soc. Press, 2017. [doi:10.1109/FOCS.2017.70, arXiv:1704.01929]
  • [28] Leslie G. Valiant: Completeness classes in algebra. In Proc. 11th STOC, pp. 249–261. ACM Press, 1979. [doi:10.1145/800135.804419]
  • [29] Leslie G. Valiant: The complexity of computing the permanent. Theoret. Comput. Sci., 8(2):189–201, 1979. [doi:10.1016/0304-3975(79)90044-6]
  • [30] Leslie G. Valiant: Negation can be exponentially powerful. Theoret. Comput. Sci., 12(3):303–314, 1980. Preliminary version in STOC’79. [doi:10.1016/0304-3975(80)90060-2]
  • [31] Leslie G. Valiant, Sven Skyum, Stuart Berkowitz, and Charles Rackoff: Fast parallel computation of polynomials using few processors. SIAM J. Comput., 12(4):641–644, 1983. Preliminary version in MFCS’81. [doi:10.1137/0212043]
  • [32] Vijay V. Vazirani: A simplification of the MV matching algorithm and its proof, 2013. [arXiv:1210.4594]
  • [33] Tzu-Chieh Wei and Simone Severini: Matrix permanent and quantum entanglement of permutation invariant states. J. Math. Phys., 51(9), 2010. [doi:10.1063/1.3464263, arXiv:0905.0012]
  • [34] Mihalis Yannakakis: Expressing combinatorial optimization problems by linear programs. J. Comput. System Sci., 43(3):441–466, 1991. Preliminary version in STOC’88. [doi:10.1016/0022-0000(91)90024-Y]

AUTHOR

Joshua A. Grochow
Assistant professor
Departments of Computer Science and Mathematics
University of Colorado, Boulder, CO, USA
jgrochowedu
http://www.cs.colorado.edu/~jgrochow


ABOUT THE AUTHOR

Joshua A. Grochow is an Assistant Professor in the Departments of Computer Science and Mathematics and the University of Colorado, Boulder. Prior to that he was an Omidyar Postdoctoral Fellow at the Santa Fe Institute, and a postdoc in the theory group at University of Toronto. He graduated from The University of Chicago in 2012; his advisors were Lance Fortnow and Ketan Mulmuley. In addition to his interests in algebraic and geometric complexity theory, he is also interested in broader issues in complex networks and complex adaptive systems, sometimes referred to in our community as “the other” complexity theory.

Comments 0
Request Comment
You are adding the first comment!
How to quickly get a good reply:
  • Give credit where it’s due by listing out the positive aspects of a paper before getting into which changes should be made.
  • Be specific in your critique, and provide supporting evidence with appropriate references to substantiate general statements.
  • Your comment should inspire ideas to flow and help the author improves the paper.

The better we are at sharing our knowledge with each other, the faster we move forward.
""
The feedback must be of minimum 40 characters and the title a minimum of 5 characters
   
Add comment
Cancel
Loading ...
375784
This is a comment super asjknd jkasnjk adsnkj
Upvote
Downvote
""
The feedback must be of minumum 40 characters
The feedback must be of minumum 40 characters
Submit
Cancel

You are asking your first question!
How to quickly get a good answer:
  • Keep your question short and to the point
  • Check for grammar or spelling errors.
  • Phrase it like a question
Test
Test description