Recent from talks
Nothing was collected or created yet.
Quantifier elimination
View on WikipediaQuantifier elimination is a concept of simplification used in mathematical logic, model theory, and theoretical computer science. Informally, a quantified statement " such that ..." can be viewed as a question "When is there an such that ...?", and the statement without quantifiers can be viewed as the answer to that question.[1]
One way of classifying formulas is by the amount of quantification. Formulas with less depth of quantifier alternation are thought of as being simpler, with the quantifier-free formulas as the simplest. A theory has quantifier elimination if for every formula , there exists another formula without quantifiers that is equivalent to it (modulo this theory).
Examples
[edit]An example from mathematics says that a single-variable quadratic polynomial has a real root if and only if its discriminant is non-negative:[1]
Here the sentence on the left-hand side involves a quantifier , whereas the equivalent sentence on the right does not.
Examples of theories that have been shown decidable using quantifier elimination are Presburger arithmetic,[2][3][4][5][6] algebraically closed fields, real closed fields,[7][8] atomless Boolean algebras, term algebras, dense linear orders,[7] abelian groups,[9] Rado graphs, as well as many of their combinations such as Boolean algebra with Presburger arithmetic, and term algebras with queues.
Quantifier elimination for the theory of the real numbers as an ordered additive group is Fourier–Motzkin elimination; for the theory of the field of real numbers it is the Tarski–Seidenberg theorem.[7]
Quantifier elimination can also be used to show that "combining" decidable theories leads to new decidable theories (see Feferman–Vaught theorem).
Algorithms and decidability
[edit]If a theory has quantifier elimination, then a specific question can be addressed: Is there a method of determining for each ? If there is such a method we call it a quantifier elimination algorithm. If there is such an algorithm, then decidability for the theory reduces to deciding the truth of the quantifier-free sentences. Quantifier-free sentences have no variables, so their validity in a given theory can often be computed, which enables the use of quantifier elimination algorithms to decide validity of sentences.
Related concepts
[edit]Various model-theoretic ideas are related to quantifier elimination, and there are various equivalent conditions.
Every first-order theory with quantifier elimination is model complete. Conversely, a model-complete theory, whose theory of universal consequences has the amalgamation property, has quantifier elimination.[10]
The models of the theory of the universal consequences of a theory are precisely the substructures of the models of .[10] The theory of linear orders does not have quantifier elimination. However the theory of its universal consequences has the amalgamation property.
Basic ideas
[edit]To show constructively that a theory has quantifier elimination, it suffices to show that we can eliminate an existential quantifier applied to a conjunction of literals, that is, show that each formula of the form:
where each is a literal, is equivalent to a quantifier-free formula. Indeed, suppose we know how to eliminate quantifiers from conjunctions of literals, then if is a quantifier-free formula, we can write it in disjunctive normal form
and use the fact that
is equivalent to
Finally, to eliminate a universal quantifier
where is quantifier-free, we transform into disjunctive normal form, and use the fact that is equivalent to
Relationship with decidability
[edit]In early model theory, quantifier elimination was used to demonstrate that various theories possess properties like decidability and completeness. A common technique was to show first that a theory admits elimination of quantifiers and thereafter prove decidability or completeness by considering only the quantifier-free formulas. This technique can be used to show that Presburger arithmetic is decidable.
Theories could be decidable yet not admit quantifier elimination. Strictly speaking, the theory of the additive natural numbers did not admit quantifier elimination, but it was an expansion of the additive natural numbers that was shown to be decidable. Whenever a theory is decidable, and the language of its valid formulas is countable, it is possible to extend the theory with countably many relations to have quantifier elimination (for example, one can introduce, for each formula of the theory, a relation symbol that relates the free variables of the formula).[citation needed]
Example: Nullstellensatz for algebraically closed fields and for differentially closed fields.[clarification needed]
See also
[edit]Notes
[edit]- ^ a b Brown 2002.
- ^ Presburger 1929.
- ^ Mind: basic Presburger arithmetic — — does not admit quantifier elimination. Nipkow (2010): "Presburger arithmetic needs a divisibility (or congruence) predicate '|' to allow quantifier elimination".
- ^ Grädel et al. (2007, p. 20) define Presburger arithmetic as . This extension does admit quantifier elimination.
- ^ Monk 2012, p. 240.
- ^ Enderton 2001, p. 188.
- ^ a b c Grädel et al. 2007.
- ^ Fried & Jarden 2008, p. 171.
- ^ Szmielew 1955, Page 229 describes "the method of eliminating quantification"..
- ^ a b Hodges 1993.
References
[edit]- Brown, Christopher W. (July 31, 2002). "What is Quantifier Elimination". Retrieved 30 August 2023.
- Cooper, D.C. (1972). Meltzer, Bernard; Michie, Donald (eds.). "Theorem Proving in Arithmetic without Multiplication" (PDF). Machine Intelligence. 7. Edinburgh: Edinburgh University Press: 91–99. Retrieved 30 August 2023.
- Enderton, Herbert (2001). A mathematical introduction to logic (2nd ed.). Boston, MA: Academic Press. ISBN 978-0-12-238452-3.
- Fried, Michael D.; Jarden, Moshe (2008). Field arithmetic. Ergebnisse der Mathematik und ihrer Grenzgebiete. 3. Folge. Vol. 11 (3rd revised ed.). Springer-Verlag. ISBN 978-3-540-77269-9. Zbl 1145.12001.
- Grädel, Erich; Kolaitis, Phokion G.; Libkin, Leonid; Maarten, Marx; Spencer, Joel; Vardi, Moshe Y.; Venema, Yde; Weinstein, Scott (2007). Finite model theory and its applications. Texts in Theoretical Computer Science. An EATCS Series. Berlin: Springer-Verlag. ISBN 978-3-540-00428-8. Zbl 1133.03001.
- Hodges, Wilfrid (1993). Model Theory. Encyclopedia of Mathematics and its Applications. Vol. 42. Cambridge University Press. doi:10.1017/CBO9780511551574. ISBN 9780521304429.
- Kuncak, Viktor; Rinard, Martin (2003). "Structural subtyping of non-recursive types is decidable" (PDF). 18th Annual IEEE Symposium of Logic in Computer Science, 2003. Proceedings. pp. 96–107. doi:10.1109/LICS.2003.1210049. ISBN 0-7695-1884-2. S2CID 14182674.
- Monk, J. Donald (2012). Mathematical Logic (Graduate Texts in Mathematics (37)) (Softcover reprint of the original 1st ed. 1976 ed.). Springer. ISBN 9781468494549.
- Nipkow, Tobias (2010). "Linear Quantifier Elimination" (PDF). Journal of Automated Reasoning. 45 (2): 189–212. doi:10.1007/s10817-010-9183-0. S2CID 14279141. Retrieved 2022-11-12.
- Presburger, Mojżesz (1929). "Über die Vollständigkeit eines gewissen Systems der Arithmetik ganzer Zahlen, in welchem die Addition als einzige Operation hervortritt". Comptes Rendus du I congrès de Mathématiciens des Pays Slaves, Warszawa: 92–101., see Stansifer (1984) for an English translation
- Stansifer, Ryan (Sep 1984). Presburger's Article on Integer Arithmetic: Remarks and Translation (PDF) (Technical Report). Vol. TR84-639. Ithaca, New York: Dept. of Computer Science, Cornell University.
- Szmielew, Wanda (1955). "Elementary properties of Abelian groups". Fundamenta Mathematicae. 41 (2): 203–271. doi:10.4064/fm-41-2-203-271. MR 0072131.
- Jeannerod, Nicolas; Treinen, Ralf. Deciding the First-Order Theory of an Algebra of Feature Trees with Updates. International Joint Conference on Automated Reasoning (IJCAR). doi:10.1007/978-3-319-94205-6_29.
- Sturm, Thomas (2017). "A Survey of Some Methods for Real Quantifier Elimination, Decision, and Satisfiability and Their Applications". Mathematics in Computer Science. 11 (3–4): 483–502. doi:10.1007/s11786-017-0319-z. hdl:11858/00-001M-0000-002C-A3B5-B.
Quantifier elimination
View on GrokipediaDefinition and Fundamentals
Definition
In first-order logic, the syntax includes atomic formulas, which are expressions of the form where is a predicate symbol and are terms, or equality statements .[4] Quantifiers consist of the existential quantifier and the universal quantifier , which bind variables within their scope to express existence or universality.[4] Quantifier-free formulas are then formed by combining atomic formulas using boolean connectives such as conjunction , disjunction , negation , and implication .[4] A first-order theory in a language has quantifier elimination if, for every formula of , there exists a quantifier-free formula such that, in every model of , and define the same relations on the -parameters.[4] Equivalently, .[5] This property facilitates the transformation of any quantified formula into an equivalent quantifier-free formula relative to .[6] Both existential and universal quantifiers are handled through this equivalence: an existential quantifier can be reduced to a universal one via the logical duality , allowing iterative elimination until no quantifiers remain.[7] Quantifier elimination ensures that the models of are preserved, as every first-order definable relation in those models coincides with a quantifier-free definable one, thereby reducing the expressive power of the theory to its quantifier-free fragment without loss of semantic content.[4] This reduction simplifies analysis and proof within the theory.[6] Quantifier elimination is closely related to model completeness, a property that every formula is equivalent to an existential one over the theory, and implies model completeness.[4]Basic Principles
Quantifier elimination in first-order theories often begins with syntactic manipulations to handle quantifiers systematically. For existential quantifiers, formulas are typically transformed into prenex normal form and then into disjunctive normal form (DNF), allowing the existential quantifier to distribute over disjunctions. This reduces the problem to eliminating the quantifier from a conjunction of literals, where the resulting quantifier-free formula is the disjunction of the eliminated forms from each conjunct.[8] Universal quantifiers are addressed through logical duality, leveraging the equivalence . This transforms universal quantification into an existential one, enabling reduction to the existential case after applying negation twice, thereby preserving the focus on existential elimination procedures.[8] On the model-theoretic side, quantifier elimination is closely tied to the properties of model completeness and the amalgamation property. A theory is model-complete if every formula is equivalent modulo to an existential formula, meaning that for any models of , every formula with parameters from that holds in already holds in .[9] The amalgamation property ensures that for any two models sharing a common submodel, there exists a third model into which both embed over the submodel. Specifically, a theory admits quantifier elimination if and only if it is model-complete and its universal fragment (the set of universal consequences of ) has the amalgamation property.[9] In cases where a theory lacks quantifier elimination in its original language, it may still admit it after expanding the language with definable relations or predicates, such as order relations, which capture additional structure necessary for the equivalence to quantifier-free formulas. This expansion preserves the theory's models while enabling the required elimination.[9]Theories Exhibiting Quantifier Elimination
Presburger Arithmetic
Presburger arithmetic is the first-order theory of the natural numbers with the successor function, addition, and order relation, but without multiplication.[10] Although often studied over the integers (ℤ) with addition and order, the theory over natural numbers (ℕ) with successor, addition, and order is equivalent. The language consists of symbols for variables, logical connectives, quantifiers, equality, the constant 0, the successor function S, addition +, and the order relation <, allowing the expression of linear arithmetic statements over the non-negative integers.[11] This theory captures properties of integer addition but avoids the undecidability introduced by multiplication, as seen in full Peano arithmetic. Quantifier elimination in Presburger arithmetic proceeds by transforming prenex formulas with existential quantifiers into equivalent quantifier-free formulas, leveraging the structure of linear Diophantine equations and inequalities.[12] Specifically, for a formula of the form ∃x φ(x, \bar{y}), where φ involves linear combinations like sums of coefficients times variables plus constants, the elimination reduces to conditions on the coefficients and free variables \bar{y} using greatest common divisors (gcd) and congruence relations.[11] The process often expands the language temporarily with divisibility predicates (e.g., k \mid t for integer k > 0 and term t), which can be eliminated afterward, yielding a purely quantifier-free result in the original language.[12] For a more general case, the formula ∃x_1 \dots ∃x_k \left( \sum_{i=1}^k a_i x_i = b \right), with b a free variable or constant, eliminates to the condition that the gcd of the coefficients {a_1, \dots, a_k} divides b, as the image of the linear map is the ideal generated by this gcd in the integers.[11] In 1929, Mojżesz Presburger established the decidability of this theory through a quantifier elimination procedure, demonstrating that every formula is equivalent to a quantifier-free one and providing an effective bound on the size of the eliminated formula, though modern analyses show the complexity can reach triple-exponential time.[11] This result highlighted Presburger arithmetic as a decidable fragment of arithmetic, foundational for automated theorem proving and verification in linear integer constraints.[12]Real Closed Fields
A real closed field is an ordered field that is elementarily equivalent to the field of real numbers, characterized by the properties that every positive element has a square root and every univariate polynomial of odd degree has at least one root in the field.[13] This definition ensures a unique ordering on the field, where the positive elements are precisely the nonzero squares, and it captures the first-order properties essential for algebraic and analytic reasoning over the reals.[1] The real numbers themselves form the prototypical example of a real closed field, and any ordered field can be extended to a real closed field, known as its real closure.[13] The theory of real closed fields admits quantifier elimination, as established by the Tarski-Seidenberg theorem, a fundamental concept in real algebraic geometry. This theorem states that every first-order formula in the language of ordered fields is equivalent to a quantifier-free formula over any real closed field.[3] Geometrically, it asserts that a set defined by polynomial equations and inequalities in an (n+1)-dimensional space can be projected onto an n-dimensional space, and the resulting set will still be definable by polynomial identities and inequalities; this projection property directly implies quantifier elimination over the reals, effectively providing an algorithm to determine if a given set of polynomial inequalities has a real solution.[2] Alfred Tarski first proved this result in the 1930s, with a complete exposition appearing in his 1951 monograph, where he demonstrated that quantifiers can be systematically eliminated using the field's algebraic properties.[3] Abraham Seidenberg provided an alternative, more algebraic proof in the 1950s, avoiding some of Tarski's model-theoretic machinery and emphasizing elimination via resultants and discriminants.[1] This theorem implies model completeness for the theory, allowing complex existential statements to be reduced to Boolean combinations of polynomial inequalities and equalities. Quantifier elimination in real closed fields is particularly powerful for describing semi-algebraic sets, which are finite unions of sets defined by polynomial inequalities and equalities; the elimination process yields a quantifier-free description of their projections via sign conditions on a finite set of polynomials. For instance, consider the existential formula ∃x , p(x) = 0, where p(x) = ax^2 + bx + c is a quadratic polynomial with a ≠ 0; this is equivalent to the quantifier-free condition that the discriminant b^2 - 4ac ≥ 0.[14] More generally, for an existential formula ∃x \bigwedge_{i=1}^n p_i(x) > 0 \wedge \bigwedge_{j=1}^m q_j(x) = 0 involving polynomials p_i and q_j, quantifier elimination produces an equivalent quantifier-free formula consisting of sign conditions on resultants of the q_j and discriminants derived from the system.[1] These reductions enable precise geometric and analytic characterizations without bound variables, foundational for real algebraic geometry.Algorithms and Methods
Fourier-Motzkin Elimination
Fourier-Motzkin elimination is a classical algorithm for performing quantifier elimination in the theory of linear real arithmetic, specifically for eliminating existential quantifiers from prenex formulas consisting of conjunctions of linear inequalities over the real numbers. The method works by successively eliminating one variable at a time, projecting the feasible region defined by the inequalities onto the remaining variables, resulting in an equivalent quantifier-free formula that is equisatisfiable with the original. This projection preserves the semantics of existential quantification by ensuring that the eliminated variable can take a real value satisfying the constraints if and only if the projected inequalities hold.[15] The algorithm was first described by Joseph Fourier in 1827 as part of his work on solving systems of linear inequalities, and it was independently rediscovered and refined by Theodore Motzkin in his 1936 Ph.D. thesis.[16] To eliminate an existentially quantified variable from a formula of the form , where represents the remaining free variables, are coefficient vectors, and , the inequalities are partitioned into three sets based on the coefficient of :- : inequalities with (providing lower bounds on ),
- : inequalities with (providing upper bounds on ),
- : inequalities with (independent of ).
