Categorization of Semantic Roles for Dictionary Definitions
Understanding the semantic relationships between terms is a fundamental task in natural language processing applications. While structured resources that can express those relationships in a formal way, such as ontologies, are still scarce, a large number of linguistic resources gathering dictionary definitions is becoming available, but understanding the semantic structure of natural language definitions is fundamental to make them useful in semantic interpretation tasks. Based on an analysis of a subset of WordNet’s glosses, we propose a set of semantic roles that compose the semantic structure of a dictionary definition, and show how they are related to the definition’s syntactic configuration, identifying patterns that can be used in the development of information extraction frameworks and semantic models.
This work is licensed under a Creative Commons Attribution 4.0 International Licence. Licence details: http://creativecommons.org/licenses/by/4.0/ Many natural language understanding tasks such as Text Entailment and Question Answering systems are dependent on the interpretation of the semantic relationships between terms. The challenge on the construction of robust semantic interpretation models is to provide a model which is both comprehensive (capture a large set of semantic relations) and fine-grained. While semantic relations (high-level binary predicates which express relationships between words) can serve as a semantic interpretation model, in many cases, the relationship between words cannot be fully articulated as a single semantic relation, depending on a contextualization that involves one or more target words, their corresponding semantic relationships and associated logical operators (e.g. modality, functional operators).
Natural language definitions of terms, such as dictionary definitions, are resources that are still underutilized in the context of semantic interpretation tasks. The high availability of natural language definitions in different domains of discourse, in contrast to the scarcity of comprehensive structured resources such as ontologies, make them a candidate linguistic resource to provide a data source for fine-grained semantic models.
Under this context, understanding the syntactic and semantic “shape” of natural language definitions, i.e., how definitions are usually expressed, is fundamental for the extraction of structured representations and for the construction of semantic models from these data sources. This paper aims at filling this gap by providing a systematic analysis of the syntactic and semantic structure of natural language definitions and proposing a set of semantic roles for them. By semantic role here we mean entity-centered roles, that is, roles representing the part played by an expression in a definition, showing how it relates to the entity being defined. WordNet [\citenameFellbaum1998], one of the most employed linguistic resources in semantic applications, was used as a corpus for this task. The analysis points out the syntactic and semantic regularity of definitions, making explicit an enumerable set of syntactic and semantic patterns which can be used to derive information extraction frameworks and semantic models.
The contributions of this paper are: (i) a systematic preliminary study of syntactic and semantic relationships expressed in a corpus of definitions, (ii) the derivation of semantic categories for the classification of semantic patterns within definitions, and (iii) the description of the main syntactic and semantic shapes present in definitions, along with the quantification of the distribution of these patterns.
The paper is organized as follows: Section 2 presents the basic structural aspects of definitions according to the classic theory of definitions. Section 3 introduces the proposed set of semantic roles for definitions. Section 4 outlines the relationship between semantic and syntactic patterns. Section 5 lists related work, followed by the conclusions and future work in Section 6.
2 Structural Aspects of Definitions
Swartz \shortciteswartz2007definitions describe lexical, or dictionary definitions as reports of common usage (or usages) of a term, and argue that they allow the improvement and refinement of the use of language, because they can be used to increase vocabulary (introducing people to the meaning and use of words new to them), to eliminate certain kinds of ambiguity and to reduce vagueness. A clear and properly structured definition can also provide the necessary identity criteria to correctly allocate an entity in an ontologically well-defined taxonomy [\citenameGuarino and Welty2002].
Some linguistic resources, such as WordNet, organize concepts in a taxonomy, so the genus-differentia definition pattern would be a suitable way to represent the subsumption relationship among them. The genus and differentia concepts date back to Aristotle’s writings concerning the theory of definition [\citenameBerg1982, \citenameGranger1984, \citenameLloyd1962] and are most commonly used to describe entities in the biology domain, but they are general enough to define concepts in any field of knowledge. An example of a genus-differentia based definition is the Aristotelian definition of a human: “a human is a rational animal”. Animal is the genus, and rational is the differentia distinguishing humans from other animals.
Another important aspect of the theory of definition is the distinction between essential and non-essential properties. As pointed by Burek \shortciteburek2004adoption, stating that “a human is an animal” informs an essential property for a human (being an animal), but the sentence “human is civilized” does not communicate a fundamental property, but rather something that happens to be true for humans, that is, an incidental property.
Analyzing a subset of the WordNet definitions to investigate their structure, we noticed that most of them loosely adhere to the classical theory of definition: with the exception of some samples of what could be called ill-formed definitions, in general they are composed by a linguistic structure that resembles the genus-differentia pattern, plus optional and variable incidental properties. Based on this analysis, we derived a set of semantic roles representing the components of a lexical definition, which are described next.
3 Semantic Roles for Lexical Definitions
Definitions in WordNet don’t follow a strict pattern: they can be constructed in terms of the entity’s immediate superclass or rather using a more abstract ancestral class. For this reason, we opted for using the more general term supertype instead of the classical genus. A supertype is either the immediate entity’s superclass, as in “footwear: clothing worn on a person’s feet”, being footwear immediately under clothing in the taxonomy; or an ancestral, as in “illiterate: a person unable to read”, where illiterate is three levels below person in the hierarchy.
Two different types of distinguishing features stood out in the analyzed definitions, so the differentia component was split into two roles: differentia quality and differentia event. A differentia quality is an essential, inherent property that distinguishes the entity from the others under the same supertype, as in “baseball_coach: a coach of baseball players”. A differentia event is an action, state or process in which the entity participates and that is mandatory to distinguish it from the others under the same supertype. It is also essential and is more common for (but not restricted to) entities denoting roles, as in “roadhog: a driver who obstructs others”.
As any expression describing events, a differentia event can have several subcomponents, denoting time, location, mode, etc. Although many roles could be derived, we opted to specify only the ones that were more recurrent and seemed to be more relevant for the definitions’ classification: event time and event location. Event time is the time in which a differentia event happens, as in “master_of_ceremonies: a person who acts as host at formal occasions”; and event location is the location of a differentia event, as in “frontiersman: a man who lives on the frontier”.
A quality modifier can also be considered a subcomponent of a differentia quality: it is a degree, frequency or manner modifier that constrain a differentia quality, as in “dart: run or move very quickly or hastily”, where very narrows down the differentia quality quickly associated to the supertypes run and move.
The origin location role can be seen as a particular type of differentia quality that determines the entity’s location of origin, but in most of the cases it doesn’t seem to be an essential property, that is, the entity only happens to occur or come from a given location, and this fact doesn’t account to its essence, as in “Bartramian_sandpiper: large plover-like sandpiper of North American fields and uplands”, where large and plover-like are essential properties to distinguish Bartramian_sandpiper from other sandpipers, but occurring in North American fields and uplands is only an incidental property.
The purpose role determines the main goal of the entity’s existence or occurrence, as in “redundancy: repetition of messages to reduce the probability of errors in transmission”. A purpose is different from a differentia event in the sense that it is not essential: in the mentioned example, a repetition of messages that fails to reduce the probability of errors in transmission is still a redundancy, but in “water_faucet: a faucet for drawing water from a pipe or caskâ”, for drawing water is a differentia event, because a faucet that fails this condition is not a water faucet.
Another event that is also non-essential, but rather brings only additional information to the definition is the associated fact, a fact whose occurrence is/was linked to the entity’s existence or occurrence, accounting as an incidental attribute, as in “Mohorovicic: Yugoslav geophysicist for whom the Mohorovicic discontinuity was named”.
Other minor, non-essential roles identified in our analysis are: accessory determiner, a determiner expression that doesn’t constrain the supertype-differentia scope, as in “camas: any of several plants of the genus Camassia”, where the expression any of several could be removed without any loss in the definition meaning; accessory quality, a quality that is not essential to characterize the entity, as in “Allium: large genus of perennial and biennial pungent bulbous plants”, where large is only an incidental property; and [role] particle, a particle, such as a phrasal verb complement, non-contiguous to the other role components, as in “unstaple: take the staples off”, where the verb take off is split in the definition, being take the supertype and off a supertype particle.
The conceptual model in Figure 1 shows the relationship among roles, and between roles and the definiendum, that is, the entity being defined.
4 Identifying Semantic Roles in Definitions
Once the relevant semantic roles were identified in the manual analysis, the following question emerged: is it possible to extend this classification to the whole definitions database through automated Semantic Role Labelling? Although most SRL systems rely on efficient machine learning techniques [\citenamePalmer et al.2010], an initial, preferably large, amount of annotated data is necessary for the training phase.
Since manual annotation is expensive, an alternative would be a rule-based mechanism to automatically label the definitions, based on their syntactic structure, followed by a manual curation of the generated data. As shown in an experimental study by Punyakanok et al. \shortcitepunyakanok2005necessity, syntactic parsing provides fundamental information for event-centered SRL, and, in fact, this is also true for entity-centered SRL.
To draw the relationship between syntactic and semantic structure (as well as defining the set of relevant roles described earlier), we randomly selected a sample of 100 glosses from the WordNet nouns+verbs database
Table 1 shows the distribution of the semantic patterns for the analyzed sample. As can be seen, (supertype) (differentia quality) and (supertype) (differentia event) are the most frequent patterns, but many others are composed by a combination of three or more roles, usually the supertype, one or more differentia qualities and/or differentia events, and any of the other roles. Since most of them occurred only once (29 out of 42 identified patterns), it is easier to analyze the roles as independent components, regardless of the pattern where they appear. The context can always give some hint about what a role is, but we would expect the role’s main characteristics not to change when their “companions” in the sentence varies. The conclusions are as follows
|(supertype) (differentia quality)||27|
|(supertype) (differentia event)||13|
|(differentia quality) (supertype)||6|
|(supertype) (differentia event) (event location)||5|
|(supertype) (differentia quality) (purpose)||3|
|(accessory determiner) (supertype) (differentia event)||3|
|(accessory determiner) (supertype) (differentia quality)||2|
|(supertype) OR(differentia quality)+||2|
|(supertype) (origin location)||2|
|(differentia quality) (supertype) (differentia quality)||2|
|OR(supertype)+ (differentia event)||2|
|(differentia quality)+ (supertype)||2|
|(differentia quality)+ (supertype) (differentia event)||2|
Supertype: it’s mandatory in a well-formed definition, and indeed 99 out of the 100 sentences analyzed have a supertype (the gloss for Tertiary_period – “from 63 million to 2 million years ago” â lacks a supertype and could, then, be considered an ill-formed definition). For verbs, it is the leftmost VB and, in some cases, subsequent VBs preceded by a CC (“or” or “and”). This is the case whenever the parser correctly classifies the gloss’ head word as a verb (11 out of 16 sentences). For nouns, in most cases (70 out of 83) the supertype is contained in the innermost and leftmost NP containing at least one NN. It is the whole NP (discarding leading DTs) if it exists as an entry in WN, or the largest rightmost sequence that exists in WN otherwise. In the last case, the remaining leftmost words correspond to one or more differentia qualities. If the NP contains CCs, more than one supertype exist, and can be identified following the same rules just described. The 13 sentences that don’t fit this scenario include some non-frequent grammatical variations, parser errors and the presence of accessory determiners, described later.
Differentia quality: for verbs, this is the most common identifying component in the definition. It occurs in 14 out of the 16 sentences. The other two ones are composed by a single supertype (that would better be seen as a synonym), and by a conjunction of two supertypes. The differentia quality is usually a PP (5 occurrences) or a NP (4 occurrences) coming immediately after the supertype. JJs inside ADJPs (3 occurrences) or RBs inside ADVPs (1 occurrence) are also possible patterns, where the presence of CCs indicates the existence of more than one differentia quality. For nouns, two scenarios outstand: the differentia quality preceding the supertype, where it is composed by the leftmost words in the same NP that contains the supertype but are not part of the supertype itself, as described above; and the differentia quality coming after the supertype, predominantly composed by a PP, where the prevailing introductory preposition is “of”. These two scenarios cover approximately 90% of all analyzed sentences where one or more differentia qualities occur.
Differentia event: differentia events occurs only for nouns, since verbs can’t represent entities that can participate in an event (i.e., endurants in the ontological view). They are predominantly composed by either an SBAR or a VP (under a simple clause or not) coming after the supertype. This is the case in approximately 92% of the analyzed sentences where differentia events occur. In the remaining samples, the differentia event is also composed by a VP, but under a PP and immediately after the introductory preposition.
Event location: event locations only occur in conjunction with a differentia event, so they will usually be composed by a PP appearing inside a SBAR or a VP. Being attached to a differentia event helps to distinguish an event location from other roles also usually composed by a PP, but additional characteristics can also provide some clues, like, for example, the presence of named entities denoting locations, such as “Morocco” and “Lake District”, which appear in some of the analyzed glosses.
Event time: the event time role has the same characteristics of event locations: only occurs in conjunction with a differentia event and is usually composed by a PP inside a SBAR or a VP. Again, additional information such as named entities denoting time intervals, for example, “the 19th century” in one of the analyzed glosses, is necessary to tell it apart from other roles.
Origin location: origin locations are similar to event locations, but occurring in the absence of an event, so it is usually a PP that does not appear inside a SBAR or a VP and that frequently contains named entities denoting locations, like “United States”, “Balkan Peninsula” and “France” in our sample glosses. A special case is the definition of entities denoting instances, where the origin location usually comes before the supertype and is composed by a NP (also frequently containing some named entity), like the definitions for Charlotte_Anna_Perkins_Gilman – “United States feminist” – and Joseph_Hooker – “United States general […]”, for example.
Quality modifier: quality modifiers only occur in conjunction with a differentia quality. Though this role wasn’t very frequent in our analysis, it is easily identifiable, as long as the differentia quality component has already been detected. A syntactic dependency parsing can show whether some modifier (usually an adjective or adverb) references, instead of the supertype, some of the differentia quality’s elements, modifying it.
Purpose: the purpose component is usually composed by a VP beginning with a TO (“to”) or a PP beginning with the preposition “for” and having a VP right after it. In a syntactic parse tree, a purpose can easily be mistaken by a differentia event, since the difference between them is semantic (the differentia event is essential to define the entity, and the purpose only provide additional, non-essential information). Since it provides complementary information, it should always occur in conjunction with an identifying role, that is, a differentia quality and/or event. Previously detecting these identifying roles in the definition, although not sufficient, is necessary to correctly assign the purpose role to a definition’s segment.
Associated fact: an associated fact has characteristics similar to those of a purpose. It is usually composed by a SBAR or by a PP not beginning with “for” with a VP immediately after it (that is, not having the characteristics of a purpose PP). Again, the difference between an associated fact and a differentia event is semantic, and the same conditions and principles for identifying a purpose component also apply.
Accessory determiner: accessory determiners come before the supertype and are easily recognizable when they don’t contain any noun, like “any of several”, for example: it will usually be the whole expression before the supertype, which, in this case, is contained in the innermost and leftmost NP having at least one NN. If it contains a noun, like “a type of”, “a form of”, “any of a class of”, etc., the recognition becomes more difficult, and it can be mistaken by the supertype, since it will be the leftmost NP in the sentence. In this case, a more extensive analysis in the WN database to collect the most common expressions used as accessory determiners is necessary in order to provide further information for the correct role assignment.
Accessory quality: the difference between accessory qualities and differentia qualities is purely semantic. It is usually a single adjective, but the syntactic structure can’t help beyond that in the accessory quality identification. Again, the presence of an identifying element in the definition (preferably a differentia quality) associated with knowledge about most common words used as accessory qualities can provide important evidences for the correct role detection.
[Role] particle: although we believe that particles can occur for any role, in our analysis it was very infrequent, appearing only twice and only for supertypes. It is easily detectable for phrasal verbs, for example, take off in “take the staples off”, since the particle tends to be classified as PRT in the syntactic tree. For other cases, it is necessary a larger number of samples such that some pattern can be identified and a suitable extraction rule can be defined.
|Role||Most common syntactic patterns|
|Supertype||innermost and leftmost NP containing at least one NN|
|Differentia event||SBAR; VP|
|Event location||PP inside a SBAR or VP, possibly having a location named entity|
|Event time||PP inside a SBAR or VP, possibly having a time interval named entity|
|Origin location||PP not inside a SBAR or VP, possibly having a location named entity|
|Quality modifier||NN, JJ or RB referring to an element inside a differentia quality|
|Purpose||VP beginning with TO; PP beginning with “for” with a VP right after|
|Associated fact||SBAR; PP not beginning with “for” with a VP right after|
|Accessory determiner||whole expression before supertype; common accessory expression|
|Accessory quality||JJ, presence of a differentia quality, common accessory word|
5 Related Work
The task described in this work is a form of Semantic Role Labeling (SRL), but centered on entities instead of events. Typically, SRL has as primary goal to identify what semantic relations hold among a predicate (the main verb in a clause) and its associated participants and properties [\citenameMàrquez et al.2008]. Focusing on determining “who” did “what” to “whom”, “where”, “when”, and “how”, the labels defined for this task include agent, theme, force, result and instrument, among others [\citenameJurafsky and Martin2000].
Liu and Ng \shortciteliu2007learning perform SRL focusing on nouns instead of verbs, but most noun predicates in NomBank, which were used in the task, are verb nominalizations. This leads to the same event-centered role labeling, and the same principles and labels used for verbs apply.
Kordjamshidi et al. \shortcitekordjamshidi2010spatial describe a non-event-centered semantic role labeling task. They focus on spatial relations between objects, defining roles such as trajectory, landmark, region, path, motion, direction and frame of reference, and develop an approach to annotate sentences containing spatial descriptions, extracting topological, directional and distance relations from their content.
Regarding the structural aspects of lexical definitions, Bodenreider and Burgun \shortcitebodenreider2002characterizing present an analysis of the structure of biological concept definitions from different sources. They restricted the analysis to anatomical concepts to check to what extent they fit the genus-differentia pattern, the most common method used to classify living organisms, and what the other common structures employed are, in the cases where that pattern doesn’t apply.
Burek \shortciteburek2004adoption also sticks to the Aristotelian classic theory of definition, but instead of analyzing existing, natural language definitions, he investigates a set of ontology modeling languages to examine their ability to adopt the genus-differentia pattern and other fundamental principles, such as the essential and non-essential property differentiation, when defining a new ontology concept by means of axioms, that is, in a structured way rather than in natural language. He concludes that Description Logic (DL), Unified Modeling Language (UML) and Object Role Modeling (ORM) present limitations to deal with some issues, and proposes a set of definitional tags to address those points.
The information extraction from definitions has also been widely explored with the aim of constructing structured knowledge bases from machine readable dictionaries [\citenameVossen1992, \citenameCalzolari1991, \citenameCopestake1991, \citenameVossen1991, \citenameVossen and Copestake1994]. The development of a Lexical Knowledge Base (LKB) also used to take into account both semantic and syntactic information from lexical definitions, which were processed to extract the definiendum’s genus and differentiae. To populate the LKB, typed-feature structures were used to store the information from the differentiae, which were, in turn, transmitted by inheritance based on the genus information. A feature structure can be seen as a set of attributes for a given concept, such as “origin”, “color”, “smell”, “taste” and “temperature” for the concept drink (or for a more general concept, such as substance, from which drink would inherit its features), for example, and the differentiae in a definition for a particular drink would be the values that those features assume for that drink, for example, “red”, “white”, “sweet”, “warm”, etc. As a result, concepts could be queried using the values of features as filters, and words defined in different languages could be related, since they were represented in the same structure. To build the feature structures, restricted domains covering subsets of the vocabulary were considered, since having every relevant attribute for every possible entity defined beforehand is not feasible, being more overall strategies required in order to process definitions in large scale.
We proposed a set of semantic roles that reflect the most common structures of dictionary definitions. Based on an analysis of a random sample composed by 100 WordNet noun and verb glosses, we identified and named the main semantic roles and their compositions present on dictionary definitions. Moreover, we compared the identified semantic patterns with the definitions’ syntactic structure, pointing out the features that can serve as input for automatic role labeling. The proposed semantic roles list is by no means definitive or exhaustive, but a first step at highlighting and formalizing the most relevant aspects of widely used intensional level definitions.
As future work, we intend to implement a rule-based classifier, using the identified syntactic patterns to generate an initial annotated dataset, which can be manually curated and subsequently feed a machine learning model able to annotate definitions in large scale. We expect that, through a systematic classification of their elements, lexical definitions can bring even more valuable information to semantic tasks that require world knowledge.
Vivian S. Silva is a CNPq Fellow – Brazil.
- Adjectives and adverbs are not organized in a taxonomy in WordNet, so are less likely to follow a supertype-differentia pattern, probably requiring a different classification strategy
- POS tags and non-terminal symbols lists can be found at https://goo.gl/8ndYCw and https://goo.gl/kuJEc2, respectively
- Words that are not part of the largest sequence in the NP found as an entry in WN
- Jan Berg. 1982. Aristotle’s theory of definition. ATTI del Convegno Internazionale di Storia della Logica, pages 19–30.
- Olivier Bodenreider and Anita Burgun. 2002. Characterizing the definitions of anatomical concepts in WordNet and specialized sources. In Proceedings of the first global WordNet conference, pages 223–230.
- Patryk Burek. 2004. Adoption of the classical theory of definition to ontology modeling. In International Conference on Artificial Intelligence: Methodology, Systems, and Applications, pages 1–10. Springer.
- Nicoletta Calzolari. 1991. Acquiring and representing semantic information in a lexical knowledge base. In Workshop of SIGLEX (Special Interest Group within ACL on the Lexicon), pages 235–243. Springer.
- Ann Copestake. 1991. The LKB: a system for representing lexical information extracted from machine-readable dictionaries. In Proceedings of the ACQUILEX Workshop on Default Inheritance in the Lexicon, Cambridge.
- Christiane Fellbaum. 1998. WordNet. Wiley Online Library.
- Edgar Herbert Granger. 1984. Aristotle on genus and differentia. Journal of the History of Philosophy, 22(1):1–23.
- Nicola Guarino and Christopher Welty. 2002. Evaluating ontological decisions with OntoClean. Communications of the ACM, 45(2):61–65.
- Daniel Jurafsky and James H Martin. 2000. Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics and Speech Recognition. Prentice-Hall.
- Parisa Kordjamshidi, Marie-Francine Moens, and Martijn van Otterlo. 2010. Spatial role labeling: Task definition and annotation scheme. In Proceedings of the Seventh conference on International Language Resources and Evaluation (LREC’10), pages 413–420. European Language Resources Association (ELRA).
- Chang Liu and Hwee Tou Ng. 2007. Learning predictive structures for semantic role labeling of NomBank. In Annual Meeting-Association for Computational Linguistics, volume 45, pages 208–215.
- Anthony C Lloyd. 1962. Genus, species and ordered series in Aristotle. Phronesis, pages 67–90.
- Christopher D Manning, Mihai Surdeanu, John Bauer, Jenny Rose Finkel, Steven Bethard, and David McClosky. 2014. The Stanford CoreNLP natural language processing toolkit. In ACL (System Demonstrations), pages 55–60.
- Lluís Màrquez, Xavier Carreras, Kenneth C Litkowski, and Suzanne Stevenson. 2008. Semantic role labeling: an introduction to the special issue. Computational linguistics, 34(2):145–159.
- Martha Palmer, Daniel Gildea, and Nianwen Xue. 2010. Semantic role labeling. Synthesis Lectures on Human Language Technologies, 3(1):1–103.
- Vasin Punyakanok, Dan Roth, and Wen-tau Yih. 2005. The necessity of syntactic parsing for semantic role labeling. In IJCAI, volume 5, pages 1117–1123.
- Norman Swartz. 1997. Definitions, dictionaries, and meanings. http://www.sfu.ca/swartz/definitions.htm.
- Piek Vossen and Ann Copestake. 1994. Untangling definition structure into knowledge representation. In Inheritance, defaults and the lexicon, pages 246–274. Cambridge University Press.
- Piek Vossen. 1991. Converting data from a lexical database to a knowledge base. Esprit BRA-3030 ACQUILEX Working Paper No 27.
- Piek Vossen. 1992. The automatic construction of a knowledge base from dictionaries: a combination of techniques. In EURALEX, volume 92, pages 311–326.