Logics of Finite Hankel Rank
(For Yuri Gurevich at his 75th Birthday)
We discuss the Feferman-Vaught Theorem in the setting of abstract model theory for finite structures. We look at sum-like and product-like binary operations on finite structures and their Hankel matrices. We show the connection between Hankel matrices and the Feferman-Vaught Theorem. The largest logic known to satisfy a Feferman-Vaught Theorem for product-like operations is , first order logic with modular counting quantifiers. For sum-like operations it is , the corresponding monadic second order logic. We discuss whether there are maximal logics satisfying Feferman-Vaught Theorems for finite structures.
1.1 Yuri’s Quest for Logics for Computer Science
The second author (JAM) first met Yuri Gurevich in spring 1976, while being a Lady Davis fellow at the Hebrew University, on leave from the Free University, Berlin. Yuri had just recently emigrated to Israel. Yuri was puzzled by the supposed leftist views of JAM, perceiving them as antagonizing. This lead to heated political discussions. In the following time, JAM spent more visiting periods in Israel, culminating in the Logic Year of 1980/81 at the Einstein Institute of the Hebrew University, after which he finally joined the Computer Science Department at the Technion in Haifa.
At this time both Yuri and JAM worked on chapters to be published in , Yuri on Monadic Second Order Logic, and JAM on abstract model theory. Abstract model theory deals with meta-mathematical characterizations of logic. Pioneered by P. Lindström, G. Kreisel and J. Barwise, in [1, 2],,[30, 31], First Order Logic and admissible fragments of infinitary logic were characterized. Inspired by H. Scholz’s problem, , R. Fagin initiated similar characterizations when models are restricted to finite models, connecting finite model theory to complexity theory.
At about the same time Yuri and JAM both underwent a transition in research orientation, slowly refocusing on questions in theoretical Computer Science. Two papers document their evolving views at the time, ,. Yuri was vividly interested in  and frequent discussions between Yuri and JAM between 1980 and 1982 shaped both papers. In  the use for theoretical computer science of classical model theoretic methods, in particular, the role of the classical preservation theorems (see below), was explored, see also ,. Yuri grasped early on that these preservation theorems do not hold when one restricts First Order Logic to finite models.
Under the influence of JAM’s work in abstract model theory, the foundations of database theory and logic programming, [5, 6],,,,, and the work of N. Immerman and M. Vardi, ,, Yuri stressed the difference between classical model theory and finite model theory. In , he formulated what he calls the Fundamental Problem of finite model theory. This problem is, even after 30 years, still open (): Is there a logic such that any class of finite structures is definable in iff is recognizable in polynomial time. For ordered finite structures there are several such logics, ,,,[41, 42],. We give a precise statement of the Fundamental Problem in section 2, Problem 1.
1.2 Preservation Theorems
Let be two syntactically defined fragments of a logic , and let be a binary relation between structures. Preservation theorems are of the form:
Let . The following are equivalent:
For all structures with , we have that if satisfies , then also satisfies .
There is which is logically equivalent to .
A typical example is Tarski’s Theorem for first order logic, with all of first order logic, its universal formulas, and holds if is a substructure of . Many other preservation theorems can be found in . In response to ,, Yuri pointed out in  that most of the preservation theorems for first order logic fail when one restricts models to be finite.
1.3 Reduction Theorems
Let denote the finite sequences of formulas in , and let be a binary operation on finite structures. Reduction theorems are of the form:
There is a function with and a Boolean function such that for all structures and all , the structure satisfies iff
where for we have iff and iff . There are also versions for -ary operations .
The most famous examples of such reduction theorems are the Feferman-Vaught-type theorems, [12, 13, 14, 15],,. A simple case is Monadic Second Order Logic (), where and is the disjoint union of and . Additionally it is required that the quantifier ranks of the formulas in do not exceed the quantifier rank of . In [38, Chapter 4] such reduction theorems are discussed in the context of abstract model theory. However, in [38, Chapter 4] the quantifier rank has no role.
In contrast to preservation theorems, reduction theorems still hold when restricted to finite structures.
1.4 Purpose of this Paper
In  JAM discussed Feferman-Vaught-type theorems in finite model theory and their algorithmic uses. In Section 7 of that paper, it was asked whether one can characterize logics over finite structures which satisfy the Feferman-Vaught Theorem for the disjoint union . The purpose of this paper is to outline new directions to attack this problem. The novelty in our approach is in relating the Feferman-Vaught Theorem to Hankel matrices of sum-like and connection-like operations on finite structures. Hankel matrices for connection-like operations, aka connection matrices, have many algorithmic applications, cf. ,.
In section 2 we set up the necessary background on Lindström logics, quantifier rank, translation schemes, and sum-like operations. A Hankel matrix involves a binary operation on finite -structures which results in a -structure, and a class of -structures closed under isomorphisms (aka a -property). In section 3 we give the necessary definitions of Hankel matrices and their rank. We then study -properties where has finite rank. We show that there are uncountably many such properties and state that the class of all properties that have finite rank for every sum-like operation forms a Lindström logic, Theorems 2 and 5. In section 4 we define various forms of Feferman-Vaught-type properties of Lindström logics equipped with a quantifier rank, and discuss their connection to Hankel matrices. Theorem 11 describes their exact relationship. A logic has finite S-rank, if all its definable -properties have Hankel matrices of finite rank for every sum-like operation. In section 5 we sketch how to construct a logic satisfying the Feferman-Vaught Theorem for sum-like operations from a logic which has finite S-rank. Finally, in section 6, we discuss our conclusions and state open problems. A full version of this paper is in preparation, .
2.1 Logics with Quantifier Rank
We assume the reader is familiar with the basic definitions of generalized logics, see ,. We denote by finite relational vocabularies, possibly with constant symbols for named elements. -structures are always finite unless otherwise stated. A finite structure of size is always assumed to have as its universe the set . A class of finite -structures closed under -isomorphisms is called a -property.
A Lindström Logic is a triple
where is the set of -sentences of , are the finite -structures, is the satisfaction relation. The satisfaction relation is a ternary relation between -structures, assignments and formulas. An assignment for variables in a -structure is a function which assigns to each variable an element of the universe of . We always assume that the logic contains all the atomic formulas with free variables, and is closed under Boolean operations and first order quantifications. A logic is a sublogic of a logic iff for all and the satisfaction relation of is the satisfaction relation induced by .
A Gurevich logic is a Lindström logic where additionally the sets are uniformly computable.
A Lindström logic with a quantifier rank is a quadruple
where additionally is a quantifier rank function. A quantifier rank (q-rank) is a function such that
For atomic formulas the q-rank .
Boolean operations and translations induced by translation schemes (see subsection 2.2) with formulas of q-rank preserve maximal q-rank.
A quantifier rank is nice if additionally it satisfies the following:
For finite , there are, up to logical equivalence, only finitely many -formulas of fixed q-rank with a fixed set of free variables.
In the presence of (iii) we define Hintikka formulas as maximally consistent -formulas of fixed q-rank. A nice logic is Lindström logic with a nice quantifier rank . We note that in a nice logic, the only formulas of q-rank are Boolean combinations of atomic formulas.
We denote by , , , first order, monadic second order, and full second order logic, respectively. All these logics are nice Gurevich logics with their natural quantifier rank, and they are sublogics of .
We denote by , , first order and monadic second order logic augmented by the modular counting quantifiers which say that there are modulo , exactly many elements satisfying . In the presence of the quantifier there are two definitions of the quantifier rank: and . Given any finite set of variables, for we have, up to logical equivalence, infinitely many formulas with , whereas for there are only finitely many such formulas. and with the quantifier rank are nice Gurevich logics. In the sequel we always use as the quantifier rank for and .
, fixed point logic, is also a Gurevich logic and a sublogic of . However, order invariant is a sublogic of which is not a Lindström logic. The definable -properties in order invariant are exactly the -properties recognizable in polynomial time. For and order invariant see ,,,[41, 42],.
Problem 1 (Y. Gurevich, ).
Is there a Gurevich logic such that the -definable -properties are exactly the -properties recognizable in polynomial time.
2.2 Sum-Like and Product-Like Operations on
The following definitions are taken from . Let be two relational vocabularies with , and denote by the arity of . A translation scheme is a sequence of -formulas where has free variables, and each has free variables. In this paper we do not allow redefining equality, nor do we allow name changing of constants.
We associate with two mappings and , the transduction and translation induced by . The transduction of a -structure is the -structure where the vocabulary is interpreted by the formulas given in the translation scheme. The translation of a -formula is obtained by substituting atomic -formulas with their definition through -formulas given by the translation scheme. A translation scheme (induced transduction, induced translation) is scalar if , otherwise it is -vectorized. It is quantifier-free if so are the formulas .
If has no constant symbols, the disjoint union of two -structures is the -structure obtained by taking the disjoint union of the universes and of the corresponding relation interpretations in and . On the other hand, if has finitely many constant symbols the disjoint union of two -structures is a -structure with twice as many constant symbols, . Connection operations are similar to disjoint unions with constants, where equally named elements are identified. We call the disjoint union followed by the pairwise identification of constant pairs the -sum, cf. .
A binary operation is sum-like (product-like) if it is obtained from the disjoint union of -structures by applying a quantifier-free scalar (vectorized) -transduction. A binary operation is connection-like if it is obtained from a connection operation on -structures by applying a quantifier-free scalar -transduction. If , we say is an operation on -structures.
Connection-like operations are not sum-like according to the definitions in this paper111They are nevertheless called sum-like in .. Although connection operations are frequently used in the literature, cf. ,, we do not deal with them in this paper. Most of our results here can be carried over to connection-like operations, but the formalism required to deal with the identification of constants is tedious and needs more place than available here.
Let be a fixed finite relational vocabulary.
There are only finitely many sum-like binary operations on -structures.
There is a function such that for each there are only many -vectorized product-like binary operations on -structures.
2.3 Abstract Lindström Logics
In  a syntax-free definition of a logic is given. An abstract Lindström logic consists of a family of -properties closed under certain operations between properties of possibly different vocabularies. One thinks of as the family of -definable -properties. We do not need all the details here, the reader may consult ,[30, 31]. The main point we need is that every abstract Lindström logic can be given a canonical syntax using generalized quantifiers.
3 Hankel matrices of -properties
3.1 Hankel Matrices
In linear algebra, a Hankel matrix, named after Hermann Hankel, is a real or complex square matrix with constant skew-diagonals. In automata theory, a Hankel matrix is an infinite matrix where the rows and columns are labeled with words over a fixed alphabet , and the entry is given by . Here is a real-valued word function and denotes concatenation. A classical result of G.W. Carlyle and A. Paz  in automata theory characterizes real-valued word functions recognizable by weighted (aka multiplicity) automata in algebraic terms.
Hankel matrices for graph parameters (aka connection matrices) were introduced by L. Lovász  and used in , to study real-valued partition functions of graphs. In , the role of concatenation is played by -connections of -graphs, i.e., graphs with distinguished vertices .
In this paper we study -matrices which are Hankel matrices of properties of general relational -structures and the role of -connections is played by more general binary operations, the sum-like and product-like operations introduced in  and further studied in .
Let be a binary operation on finite -structures returning a -structure, and let be a -property.
The Boolean Hankel matrix is the infinite -matrix where the rows and columns are labeled by all the finite -structures, and iff .
The rank of over is denoted by , and is referred to as the Boolean rank.
We say that has finite -rank iff is finite.
Two -structures are -equivalent, , if for all finite -structures we have
For a -structure , we denote by the -equivalence class of .
We say that has finite -index222 K. Compton and I. Gessel, ,, already considered -properties of finite -index for the disjoint union of -structures. In  this is called Gessel index. C. Blatter and E. Specker, in ,, consider a substitution operation on pointed -structures, , where the structure is inserted into at a point . is sum-like, and the -index is called in  Specker index. iff there are only finitely many -equivalence classes.
Let be a -property.
has finite -rank iff has finite -index.
Sketch of proof.
We first note that two -structures are in the same equivalence class of iff they have identical rows in . As the rank is over , finite rank implies there are only finitely many different rows in . The converse is obvious. ∎
3.2 -Properties of Finite -rank
We next show that there are uncountably many -properties of finite -rank. We also study the relationship between the -rank and -rank of -properties for different operations and .
We first need a lemma.
Let and let be the infinite -matrix whose columns and rows are labeled by the natural numbers , and iff . Then has finite rank over iff is ultimately periodic.
Let be the vocabulary with one binary edge-relation, and be augmented by one vertex label. Let and be the graph properties defined by , , and , where is the complement graph of the clique of size , and is a path graph of size .
has finite rank for all .
For two graphs , let be the sum-like operation defined as the loopless complement graph of .
has infinite rank for all which are not ultimately periodic.
Equivalently, for the -property , the Hankel matrix has infinite rank for all which are not ultimately periodic.
has finite rank for all sum-like operations on -structures and all .
For two graphs with one vertex label, i.e. -structures, let be the sum-like operation defined as the graph resulting from by adding an edge between the two labeled vertices and then removing the labels. has infinite rank for all which are not ultimately periodic.
has finite rank for all .
Theorem 2 needs an interpretation: (i) says that there is a specific sum-like operation such that there uncountably many classes of -structures with finite -rank333 A similar construction was first suggested by E. Specker in conversations with the second author in 2000, cf. [40, Section 7].. (ii) says that if a class has finite -rank for one sum-like operation, it does not have to hold for all sum-like operations444 This observation was suggested by T. Kotek in conversations with the second author in summer 2014.. (iii) produces uncountably many classes of -structures which have finite -rank for all sum-like operations on -structures. (iv) finally shows that such classes can still have infinite -rank for sum-like operations which take as inputs -structures (labeled paths) and output a -structure (unlabeled paths). This leads us to the following definition:
Let be a vocabulary and be a -property.
has finite S-rank (P-rank, C-rank) if for every sum-like (product-like, connection-like) operation the Boolean rank of is finite.
A nice logic has finite S-rank (P-rank, C-rank) iff all its definable properties have finite S-rank (P-rank, C-rank).
3.3 Proof of Theorem 2
(i) The disjoint union of two graphs is never connected. Therefore all the entries of are zero,
unless we consider the empty graph to be structure. In this case we have exactly one row and one column representing .
In any case, the rank is .
(ii) Consider the submatrix of consisting of rows and columns labeled with the edgeless graphs and use subsection 3.2.
(iii) We first observe that
(*) for any sum-like operation on -structures (i.e., graphs), and , if for , either or must be the empty graph.
This is due to the fact that has no constant symbols.
Therefore, a row or column containing non-zero entries must be labeled by the empty graph.
(iv) Here we consider -translation schemes for sum-like operations, with . Hence (*) from the proof of (iii) is not true anymore because now can be obtained from and with the being an end vertex, using . So we apply subsection 3.2.
(v) Connection operations of two large enough cliques still produce connected graphs, but never form a clique. ∎
3.4 Properties of Finite S-rank and Finite P-rank
Let and denote the collection of all -properties of finite S-rank and finite P-rank respectively, and let and .
and and are abstract Lindström logics which have finite S-rank and finite P-rank, respectively.
Sketch of proof:.
It is unclear whether the abstract Lindström logic goes beyond . As of now, we were unable to find a -property which has finite S-rank, but is not definable in .
Is every -property with finite S-rank definable in ?
Is every -property with finite P-rank definable in ?
It seems to us that the same can be shown for connection-like operations, but we have not yet checked the details.
4 Hankel matrices and the Feferman-Vaught theorem
4.1 The FV-property
In this section we look at nice Lindström logics with a fixed quantifier rank. We use it to derive from the classical Feferman-Vaught theorem an abstract version involving the quantifier rank. This differs from the treatment in [1, Chapter xviii]. Our purpose is to investigate the connection between Hankel matrices of finite rank and the Feferman-Vaught Theorem on finite structures in an abstract setting.
Let be a nice logic with quantifier rank .
We denote by the set of -sentences (without free variables) with .
Two -structures are equivalent, , if for every we have iff .
has the FV-property for with respect to if for every there are , and such that for all -structures we have that
where for we have iff and iff .
is -smooth with respect to if for every two pairs of -structures with and we also have .
If is clear from the context we omit it.
A close inspection of the classical proofs shows that the requirements concerning the quantifier rank are satisfied in the following cases.
4.2 The FV-property and Finite Rank
Let be a nice logic.
Let be a binary operation on -structures. is -closed if all the equivalence classes of are definable in .
is S-closed (P-closed, C-closed) if for every sum-like (product-like, connection-like) binary operation the logic is -closed.
Let have the FV-property for .
Let be a -property definable by a formula . Then each equivalence class of is definable by a formula .
If has the FV-property for all sum-like (product-like) operations then is S-closed (P-closed).
Sketch of proof.
(i) Follows because for , the truth value of depends only on , the Boolean function associated with the FV-property.
(ii) Fix a -structure . We want to show that is definable by some formula .
iff for all ,
We have, using , that
iff for all ,
(iii) Follows from (ii). ∎
By analyzing the proof in , one can prove:
Let be a nice Lindström logic with quantifier rank and be a binary operation on -structures. If is -smooth with respect to , then every -definable -property has finite -rank.
Sketch of proof.
Let be definable by with quantifier rank .
Now let be an enumeration of maximally consistent -sentences (aka Hintikka sentences).
By our assumption is nice, so this is a finite set.
Furthermore is logically equivalent to a disjunction with ,
any every -structure satisfies exactly one .
Now we use the smoothness of . If are two -structures satisfying the same , then their rows (columns) in are identical. Hence the rank of is at most , or when empty -structures are allowed. ∎
Let be a nice Lindström logic which has the FV-property for the binary operation , and let be definable in . Then is finite.
Let be a nice logic with quantifier rank and be a fixed operation on -structure, which is associative. Assume further that for every ,
the rank of is finite, and
all equivalence classes of are definable with formulas of with quantifier rank .
Then has the FV-property for .
We have now shown that having the FV-property for implies that is -smooth, and that smoothness implies finite rank, or equivalently, finite index.
In fact we have:
Let be a nice S-closed logic and let be a sum-like operation. Then the following are equivalent:
has the FV-property for every sum-like operation .
For all and every sum-like , the -rank of is finite.
For all and every sum-like , the index of is finite.
The same holds if we replace S-closed and sum-like by P-closed and product-like.
5 The S-closure of a nice logic
Let be a nice logic of finite S-rank with quantifier rank . We define to be the smallest Lindström logic such that for all sum-like
and all -definable -properties , all the equivalence classes of are also definable in . This gives us a Lindström logic which is S-closed. However, in order to be a nice logic, we have to extend to in such a way that ensures it is still nice.
We proceed inductively. Recall that there are only finitely many sum-like operations for fixed and . Let where is a relation symbol of arity or a constant symbol of arity . Two vocabularies are similar if they have the same number of symbols of the same arity. The effect of a sum-like operation only depends on the similarity type of and . Hence for fixed and , there are only finitely many sum-like operations.
A typical step in the induction is as follows.
Given and and a sum-like , there are only finitely many equivalence classes of . Let with be a list of these equivalence classes.
We form with quantifier rank as follows: If is not definable in then we add it to using a Lindström quantifier with quantifier rank .
is a Lindström logic. We have to show that is nice, i.e., for fixed and fixed number of free variables, is finite up to logical equivalence. This follows from the fact that we only added finitely many Lindström quantifiers and that for all we have that .
For our induction we start with . is obtained by doing the typical step for each and each sum-like . is the union of all quantifier rank functions of the previous steps. We still have iterate this process by defining and and take the limit.
We finally get:
Let be nice with quantifier rank and of finite S-rank. Then with quantifier rank is nice and has the FV-property for all sum-like operations.
The details will be published in .
6 Conclusions and open problems
At the beginning of this paper we asked whether one can characterize logics over finite structures which satisfy the Feferman-Vaught Theorem for the disjoint union, or more generally, for sum-like and product-like operations on -structures. The purpose of this paper was to investigate new directions to attack this problem, specifically by relating the Feferman-Vaught Theorem to Hankel matrices of finite rank. Theorem 11 describes their exact relationship.
We also investigated under which conditions one can construct logics satisfying the Feferman-Vaught Theorem. Theorem 2 shows that there are uncountably many -properties which have finite rank Hankel matrices for specific sum-like operations. Theorem 5 shows the existence of maximal Lindström logics and where all their definable -properties have finite rank for all sum-like, respectively product-like, operations. However, we have no explicit description of these maximal logics.
Is every -property with finite P-rank (or both finite P-rank and finite C-rank) definable in ?
Is every -property with finite S-rank (finite C-rank) definable in ?
In case the answers to the above are negative, we can ask:
How many -properties are there with finite S-rank (P-rank, C-rank)?
Is there a nice Gurevich logic where all the -properties in are definable?
In [40, Section 7, Conjecture 2] it is conjectured that there are continuum many nice Gurevich logics with the FV-property for the disjoint union. Adding or from Theorem 2 for fixed as Lindström quantifiers to together with all the equivalence classes of or gives us a nice Lindström logic. However, the definable -property that the complement of a graph is in has infinite -rank, see Theorem 2(ii).
How many different nice Gurevich logics with the FV-property for the disjoint union are there?
A similar analysis for connection-like operations will be developed in .
We would like to thank T. Kotek for letting us use his example, and for valuable discussions.
-  J. Barwise and S. Feferman, editors. Model-Theoretic Logics. Perspectives in Mathematical Logic. Springer Verlag, 1985.
-  K Jon Barwise. Axioms for abstract model theory. Annals of Mathematical Logic, 7(2):221–265, 1974.
-  C. Blatter and E. Specker. Le nombre de structures finies d’une th’eorie à charactère fin. Sciences Mathématiques, Fonds Nationale de la recherche Scientifique, Bruxelles, pages 41–44, 1981.
-  J.W. Carlyle and A. Paz. Realizations by stochastic finite automata. J. Comp. Syst. Sc., 5:26–40, 1971.
-  A. Chandra, H. Lewis, and J.A. Makowsky. Embedded implicational dependencies and their implication problem. In ACM Symposium on the Theory of Computing 1981, pages 342–354. ACM, 1981.
-  A. K. Chandra, H. R. Lewis, and J. A. Makowsky. Embedded implicational dependencies and their inference problem. In XP1 Workshop on Database Theory, 1980.
-  C.C. Chang and H.J. Keisler. Model Theory. Studies in Logic, vol 73. North–Holland, 3rd edition, 1990.
-  K. J. Compton. Some useful preservation theorems. J. Symb. Log., 48(2):427–440, 1983.
-  B. Courcelle. The monadic second–order logic of graphs I: Recognizable sets of finite graphs. Information and Computation, 85:12–75, 1990.
-  Arnaud Durand, Neil D Jones, Johann A Makowsky, and Malika More. Fifty years of the spectrum problem: survey and new results. Bulletin of Symbolic Logic, 18(04):505–553, 2012.
-  H.-D. Ebbinghaus, J. Flum, and W. Thomas. Mathematical Logic, 2nd edition. Undergraduate Texts in Mathematics. Springer-Verlag, 1994.
-  S. Feferman. Persistent and invariant formulas for outer extensions. Compositio Mathematicae, 20:29–52, 1968.
-  S. Feferman. Two notes on abstract model theory, I: Properties invariant on the range of definable relations between strcutures. Fundamenta Mathematicae, 82:153–165, 1974.
-  S. Feferman and G. Kreisel. Persistent and invariant formulas relative to theories of higher order. Bulletin of the American Mathematical Society, 72:480–485, 1966.
-  S. Feferman and R. Vaught. The first order properties of algebraic systems. Fundamenta Mathematicae, 47:57–103, 1959.
-  S. Feferman and R. Vaught. The first order properties of products of algebraic systems. Fundamenta Mathematicae, 47:57–103, 1959.
-  E. Fischer, T. Kotek, and J.A. Makowsky. Application of logic to combinatorial sequences and their recurrence relations. In M. Grohe and J.A. Makowsky, editors, Model Theoretic Methods in Finite Combinatorics, volume 558 of Contemporary Mathematics, pages 1–42. American Mathematical Society, 2011.
-  M. Freedman, László Lovász, and A. Schrijver. Reflection positivity, rank connectivity, and homomorphisms of graphs. Journal of AMS, 20:37–51, 2007.
-  I. Gessel. Combinatorial proofs of congruences. In D.M. Jackson and S.A. Vanstone, editors, Enumeration and design, pages 157–197. Academic Press, 1984.
-  B. Godlin, T. Kotek, and J.A. Makowsky. Evaluation of graph polynomials. In 34th International Workshop on Graph-Theoretic Concepts in Computer Science, WG08, volume 5344 of Lecture Notes in Computer Science, pages 183–194, 2008.
-  E. Grädel. The expressive power of second order horn logic. In Proceedings of 8th Symposium on Theoretical Aspects of Computer Science STACS ‘91, Hamburg 1991, volume 480 of LNCS, pages 466–477. Springer-Verlag, 1991.
-  Y. Gurevich. Modest theory of short chains, I. Journal of Symbolic Logic, 44:481–490, 1979.
-  Y. Gurevich. Logic and the challenge of computer science. In E. Börger, editor, Trends in Theoretical Computer Science, Principles of Computer Science Series, chapter 1. Computer Science Press, 1988.
-  N. Immerman. Languages that capture complexity classes. SIAM Journal on Computing, 16(4):760–778, Aug 1987.
-  T. Kotek and J.A. Makowsky. Connection matrices and the definability of graph parameters. Logical Methods in Computer Science, 10(4), 2014.
-  G. Kreisel. Choice of infinitary languages by means of definability criteria; generalized recursion theory. In J. Barwise, editor, The Syntax and Semantics of Infinitary Languages, volume 72 of Springer Lecture Notes in Mathematics, pages 139–151. Springer, 1968.
-  N. Labai and J.A. Makowsky. The Feferman-Vaught theorem and finite Hankel rank. In preparation, 2015.
-  N. Labai and J. Makowsky. Tropical graph parameters. DMTCS Proceedings of 26th International Conference on Formal Power Series and Algebraic Combinatorics (FPSAC), (01):357–368, 2014.
-  H. Läuchli. A decision procedure for the weak second order theory of linear order. In Logic Colloquium ’66, pages 189–197. North Holland, 1968.
-  P. Lindström. First order predicate logic with generalized quantifiers. Theoria, 32:186–195, 1966.
-  P. Lindström. On extensions of elementary logic. Theoria, 35:1–11, 1969.
-  L. Lovász. Connection matrics. In G. Grimmet and C. McDiarmid, editors, Combinatorics, Complexity and Chance, A Tribute to Dominic Welsh, pages 179–190. Oxford University Press, 2007.
-  L. Lovász. Large Networks and Graph Limits, volume 60 of Colloquium Publications. AMS, 2012.
-  B. Mahr and J.A. Makowsky. Characterizing specification languages which admit initial semantics. Theoretical Computer Science, 31:49–60, 1984.
-  J. A. Makowsky. -logics and generalized quantifiers. PhD thesis, Department of Mathematics, ETH-Zurich, Switzerland, 1974.
-  J. A. Makowsky. Why Horn formulas matter for computer science: Initial structures and generic examples. Journal of Computer and System Sciences, 34.2/3:266–292, 1987.
-  J.A. Makowsky. Model theoretic issues in theoretical computer science, part I: Relational databases and abstract data types. In G. Lolli et al., editor, Logic Colloquium ’82, Studies in Logic, pages 303–343. North Holland, 1984.
-  J.A. Makowsky. Compactness, embeddings and definability. In J. Barwise and S. Feferman, editors, Model-Theoretic Logics, Perspectives in Mathematical Logic, chapter 18. Springer Verlag, 1985.
-  J.A. Makowsky. Invariant definability. In Computational Logic and Proof Theory, volume 1289 of Lecture Notes in Computer Science, pages 186–202. Springer Verlag, 1997.
-  J.A. Makowsky. Algorithmic uses of the Feferman-Vaught theorem. Annals of Pure and Applied Logic, 126.1-3:159–213, 2004.
-  J.A. Makowsky and Y. Pnueli. Logics capturing oracle complexity classes uniformly. In Logic and Computational Complexity (LCC’94), volume 960 of Lecture Notes in Computer Science, pages 463–479. Springer Verlag, 1995.
-  J.A. Makowsky and Y.B. Pnueli. Oracles and quantifiers. In CSL’93, volume 832 of Lecture Notes in Computer Science, pages 189–222. Springer, 1994.
-  J.A. Makowsky and M. Vardi. On the expressive power of data dependencies. Acta Informatica, 23.3:231–244, 1986.
-  E. Ravve. Model checking for various notions of products. Master’s thesis, Thesis, Department of Computer Science, Technion–Israel Institute of Technology, 1995.
-  S. Shelah. The monadic theory of order. Annals of Mathematics, 102:379–419, 1975.
-  E. Specker. Application of logic and combinatorics to enumeration problems. In E. Börger, editor, Trends in Theoretical Computer Science, pages 141–169. Computer Science Press, 1988. Reprinted in: Ernst Specker, Selecta, Birkhäuser 1990, pp. 324-350.
-  M. Vardi. The complexity of relational query languages. In STOC’82, pages 137–146. ACM, 1982.