What do spaCy's part-of-speech and dependency tags mean?
Question:
spaCy tags up each of the Tokens in a Document with a part of speech (in two different formats, one stored in the pos and pos_ properties of the Token and the other stored in the tag and tag_ properties) and a syntactic dependency to its .head token (stored in the dep and dep_ properties).
Some of these tags are self-explanatory, even to somebody like me without a linguistics background:
>>> import spacy
>>> en_nlp = spacy.load('en')
>>> document = en_nlp("I shot a man in Reno just to watch him die.")
>>> document[1]
shot
>>> document[1].pos_
'VERB'
Others… are not:
>>> document[1].tag_
'VBD'
>>> document[2].pos_
'DET'
>>> document[3].dep_
'dobj'
Worse, the official docs don’t contain even a list of the possible tags for most of these properties, nor the meanings of any of them. They sometimes mention what tokenization standard they use, but these claims aren’t currently entirely accurate and on top of that the standards are tricky to track down.
What are the possible values of the tag_, pos_, and dep_ properties, and what do they mean?
Answers:
tl;dr answer
Just expand the lists at:
- https://spacy.io/api/annotation#pos-tagging (POS tags) and
- https://spacy.io/api/annotation#dependency-parsing (dependency tags)
Longer answer
The docs have greatly improved since I first asked this question, and spaCy now documents this much better.
Part-of-speech tags
The pos and tag attributes are tabulated at https://spacy.io/api/annotation#pos-tagging, and the origin of those lists of values is described. At the time of this (January 2020) edit, the docs say of the pos attribute that:
spaCy maps all language-specific part-of-speech tags to a small, fixed set of word type tags following the Universal Dependencies scheme. The universal tags don’t code for any morphological features and only cover the word type. They’re available as the Token.pos and Token.pos_ attributes.
As for the tag attribute, the docs say:
The English part-of-speech tagger uses the OntoNotes 5 version of the Penn Treebank tag set. We also map the tags to the simpler Universal Dependencies v2 POS tag set.
and
The German part-of-speech tagger uses the TIGER Treebank annotation scheme. We also map the tags to the simpler Universal Dependencies v2 POS tag set.
You thus have a choice between using a coarse-grained tag set that is consistent across languages (.pos), or a fine-grained tag set (.tag) that is specific to a particular treebank, and hence a particular language.
.pos_ tag list
The docs list the following coarse-grained tags used for the pos and pos_ attributes:
ADJ: adjective, e.g. big, old, green, incomprehensible, firstADP: adposition, e.g. in, to, duringADV: adverb, e.g. very, tomorrow, down, where, thereAUX: auxiliary, e.g. is, has (done), will (do), should (do)CONJ: conjunction, e.g. and, or, butCCONJ: coordinating conjunction, e.g. and, or, butDET: determiner, e.g. a, an, theINTJ: interjection, e.g. psst, ouch, bravo, helloNOUN: noun, e.g. girl, cat, tree, air, beautyNUM: numeral, e.g. 1, 2017, one, seventy-seven, IV, MMXIVPART: particle, e.g. ’s, not,PRON: pronoun, e.g I, you, he, she, myself, themselves, somebodyPROPN: proper noun, e.g. Mary, John, London, NATO, HBOPUNCT: punctuation, e.g. ., (, ), ?SCONJ: subordinating conjunction, e.g. if, while, thatSYM: symbol, e.g. $, %, §, ©, +, −, ×, ÷, =, :), VERB: verb, e.g. run, runs, running, eat, ate, eatingX: other, e.g. sfpksdpsxmsaSPACE: space, e.g.
Note that the docs are lying slightly when they say that this list follows the Universal Dependencies Scheme; there are two tags listed above that aren’t part of that scheme.
One of those is CONJ, which used to exist in the Universal POS Tags scheme but has been split into CCONJ and SCONJ since spaCy was first written. Based on the mappings of tag->pos in the docs, it would seem that spaCy’s current models don’t actually use CONJ, but it still exists in spaCy’s code and docs for some reason – perhaps backwards compatibility with old models.
The second is SPACE, which isn’t part of the Universal POS Tags scheme (and never has been, as far as I know) and is used by spaCy for any spacing besides single normal ASCII spaces (which don’t get their own token):
>>> document = en_nlp("Thisnsentencethas some weird spaces innnnntt it.")
>>> for token in document:
... print('%r (%s)' % (str(token), token.pos_))
...
'This' (DET)
'n' (SPACE)
'sentence' (NOUN)
't' (SPACE)
'has' (VERB)
' ' (SPACE)
'some' (DET)
'weird' (ADJ)
'spaces' (NOUN)
'in' (ADP)
'nnnntt ' (SPACE)
'it' (PRON)
'.' (PUNCT)
I’ll omit the full list of .tag_ tags (the finer-grained ones) from this answer, since they’re numerous, well-documented now, different for English and German, and probably more likely to change between releases. Instead, look at the list in the docs (e.g. https://spacy.io/api/annotation#pos-en for English) which lists every possible tag, the .pos_ value it maps to, and a description of what it means.
Dependency tokens
There are now three different schemes that spaCy uses for dependency tagging: one for English, one for German, and one for everything else. Once again, the list of values is huge and I won’t reproduce it in full here. Every dependency has a brief definition next to it, but unfortunately, many of them – like “appositional modifier” or “clausal complement” – are terms of art that are rather alien to an everyday programmer like me. If you’re not a linguist, you’ll simply have to research the meanings of those terms of art to make sense of them.
I can at least provide a starting point for that research for people working with English text, though. If you’d like to see some examples of the CLEAR dependencies (used by the English model) in real sentences, check out the 2012 work of Jinho D. Choi: either his Optimization of Natural Language Processing Components for Robustness and Scalability or his Guidelines for the CLEAR Style
Constituent to Dependency Conversion (which seems to just be a subsection of the former paper). Both list all the CLEAR dependency labels that existed in 2012 along with definitions and example sentences. (Unfortunately, the set of CLEAR dependency labels has changed a little since 2012, so some of the modern labels are not listed or exemplified in Choi’s work – but it remains a useful resource despite being slightly outdated.)
At present, dependency parsing and tagging in SpaCy appears to be implemented only at the word level, and not at the phrase (other than noun phrase) or clause level. This means SpaCy can be used to identify things like nouns (NN, NNS), adjectives (JJ, JJR, JJS), and verbs (VB, VBD, VBG, etc.), but not adjective phrases (ADJP), adverbial phrases (ADVP), or questions (SBARQ, SQ).
For illustration, when you use SpaCy to parse the sentence “Which way is the bus going?”, we get the following tree.
By contrast, if you use the Stanford parser you get a much more deeply structured syntax tree.
Just a quick tip about getting the detail meaning of the short forms. You can use explain method like following:
spacy.explain('pobj')
which will give you output like:
'object of preposition'
The official documentation now provides much more details for all those annotations at https://spacy.io/api/annotation (and the list of other attributes for tokens can be found at https://spacy.io/api/token).
As the documentation shows, their parts-of-speech (POS) and dependency tags have both Universal and specific variations for different languages and the explain() function is a very useful shortcut to get a better description of a tag’s meaning without the documentation, e.g.
spacy.explain("VBD")
which gives “verb, past tense”.
Direct links (if you don’t feel like going through endless spacy documentation to get the full tables):
-
for .pos_ (parts of speech, English): https://universaldependencies.org/docs/en/pos/
-
for .dep_ (dependency relations, English): https://universaldependencies.org/docs/en/dep/
After the recent update of Spacy to v3 the above links do not work.
You may visit this link to get the complete list.
Universal POS Tags
English POS Tags
Retrieve the tags and their meaning directly from pipeline/model programmatically
An alternative to looking up the tags in the documentation is to retrieve these programmatically from nlp.pipe_labels.
This has the advantage that you get the actual labels that your trained pipeline (aka model) provides and you don’t have to copy these manually.
The following example code uses model en_core_web_sm. Link to model card here. See Label Scheme at bottom. Adapt to the model of your choosing.
Note: The Universal Part-of-speech Tags aren’t programmatically available (at least I couldn’t find a way) and can be looked up here in the documentation.
import spacy
nlp = spacy.load("en_core_web_sm")
for component in nlp.pipe_names:
tags = nlp.pipe_labels[component]
if len(tags)!=0:
print(f"Label mapping for component: {component}")
display(dict(list(zip(tags, [spacy.explain(tag) for tag in tags]))))
print()
Output
Label mapping for component: tagger
{'$': 'symbol, currency',
"''": 'closing quotation mark',
',': 'punctuation mark, comma',
'-LRB-': 'left round bracket',
'-RRB-': 'right round bracket',
'.': 'punctuation mark, sentence closer',
':': 'punctuation mark, colon or ellipsis',
'ADD': 'email',
'AFX': 'affix',
'CC': 'conjunction, coordinating',
'CD': 'cardinal number',
'DT': 'determiner',
'EX': 'existential there',
'FW': 'foreign word',
'HYPH': 'punctuation mark, hyphen',
'IN': 'conjunction, subordinating or preposition',
'JJ': 'adjective (English), other noun-modifier (Chinese)',
'JJR': 'adjective, comparative',
'JJS': 'adjective, superlative',
'LS': 'list item marker',
'MD': 'verb, modal auxiliary',
'NFP': 'superfluous punctuation',
'NN': 'noun, singular or mass',
'NNP': 'noun, proper singular',
'NNPS': 'noun, proper plural',
'NNS': 'noun, plural',
'PDT': 'predeterminer',
'POS': 'possessive ending',
'PRP': 'pronoun, personal',
'PRP$': 'pronoun, possessive',
'RB': 'adverb',
'RBR': 'adverb, comparative',
'RBS': 'adverb, superlative',
'RP': 'adverb, particle',
'SYM': 'symbol',
'TO': 'infinitival "to"',
'UH': 'interjection',
'VB': 'verb, base form',
'VBD': 'verb, past tense',
'VBG': 'verb, gerund or present participle',
'VBN': 'verb, past participle',
'VBP': 'verb, non-3rd person singular present',
'VBZ': 'verb, 3rd person singular present',
'WDT': 'wh-determiner',
'WP': 'wh-pronoun, personal',
'WP$': 'wh-pronoun, possessive',
'WRB': 'wh-adverb',
'XX': 'unknown',
'_SP': 'whitespace',
'``': 'opening quotation mark'}
Label mapping for component: parser
{'ROOT': 'root',
'acl': 'clausal modifier of noun (adjectival clause)',
'acomp': 'adjectival complement',
'advcl': 'adverbial clause modifier',
'advmod': 'adverbial modifier',
'agent': 'agent',
'amod': 'adjectival modifier',
'appos': 'appositional modifier',
'attr': 'attribute',
'aux': 'auxiliary',
'auxpass': 'auxiliary (passive)',
'case': 'case marking',
'cc': 'coordinating conjunction',
'ccomp': 'clausal complement',
'compound': 'compound',
'conj': 'conjunct',
'csubj': 'clausal subject',
'csubjpass': 'clausal subject (passive)',
'dative': 'dative',
'dep': 'unclassified dependent',
'det': 'determiner',
'dobj': 'direct object',
'expl': 'expletive',
'intj': 'interjection',
'mark': 'marker',
'meta': 'meta modifier',
'neg': 'negation modifier',
'nmod': 'modifier of nominal',
'npadvmod': 'noun phrase as adverbial modifier',
'nsubj': 'nominal subject',
'nsubjpass': 'nominal subject (passive)',
'nummod': 'numeric modifier',
'oprd': 'object predicate',
'parataxis': 'parataxis',
'pcomp': 'complement of preposition',
'pobj': 'object of preposition',
'poss': 'possession modifier',
'preconj': 'pre-correlative conjunction',
'predet': None,
'prep': 'prepositional modifier',
'prt': 'particle',
'punct': 'punctuation',
'quantmod': 'modifier of quantifier',
'relcl': 'relative clause modifier',
'xcomp': 'open clausal complement'}
Label mapping for component: ner
{'CARDINAL': 'Numerals that do not fall under another type',
'DATE': 'Absolute or relative dates or periods',
'EVENT': 'Named hurricanes, battles, wars, sports events, etc.',
'FAC': 'Buildings, airports, highways, bridges, etc.',
'GPE': 'Countries, cities, states',
'LANGUAGE': 'Any named language',
'LAW': 'Named documents made into laws.',
'LOC': 'Non-GPE locations, mountain ranges, bodies of water',
'MONEY': 'Monetary values, including unit',
'NORP': 'Nationalities or religious or political groups',
'ORDINAL': '"first", "second", etc.',
'ORG': 'Companies, agencies, institutions, etc.',
'PERCENT': 'Percentage, including "%"',
'PERSON': 'People, including fictional',
'PRODUCT': 'Objects, vehicles, foods, etc. (not services)',
'QUANTITY': 'Measurements, as of weight or distance',
'TIME': 'Times smaller than a day',
'WORK_OF_ART': 'Titles of books, songs, etc.'}
spaCy tags up each of the Tokens in a Document with a part of speech (in two different formats, one stored in the pos and pos_ properties of the Token and the other stored in the tag and tag_ properties) and a syntactic dependency to its .head token (stored in the dep and dep_ properties).
Some of these tags are self-explanatory, even to somebody like me without a linguistics background:
>>> import spacy
>>> en_nlp = spacy.load('en')
>>> document = en_nlp("I shot a man in Reno just to watch him die.")
>>> document[1]
shot
>>> document[1].pos_
'VERB'
Others… are not:
>>> document[1].tag_
'VBD'
>>> document[2].pos_
'DET'
>>> document[3].dep_
'dobj'
Worse, the official docs don’t contain even a list of the possible tags for most of these properties, nor the meanings of any of them. They sometimes mention what tokenization standard they use, but these claims aren’t currently entirely accurate and on top of that the standards are tricky to track down.
What are the possible values of the tag_, pos_, and dep_ properties, and what do they mean?
tl;dr answer
Just expand the lists at:
- https://spacy.io/api/annotation#pos-tagging (POS tags) and
- https://spacy.io/api/annotation#dependency-parsing (dependency tags)
Longer answer
The docs have greatly improved since I first asked this question, and spaCy now documents this much better.
Part-of-speech tags
The pos and tag attributes are tabulated at https://spacy.io/api/annotation#pos-tagging, and the origin of those lists of values is described. At the time of this (January 2020) edit, the docs say of the pos attribute that:
spaCy maps all language-specific part-of-speech tags to a small, fixed set of word type tags following the Universal Dependencies scheme. The universal tags don’t code for any morphological features and only cover the word type. They’re available as the
Token.posandToken.pos_attributes.
As for the tag attribute, the docs say:
The English part-of-speech tagger uses the OntoNotes 5 version of the Penn Treebank tag set. We also map the tags to the simpler Universal Dependencies v2 POS tag set.
and
The German part-of-speech tagger uses the TIGER Treebank annotation scheme. We also map the tags to the simpler Universal Dependencies v2 POS tag set.
You thus have a choice between using a coarse-grained tag set that is consistent across languages (.pos), or a fine-grained tag set (.tag) that is specific to a particular treebank, and hence a particular language.
.pos_ tag list
The docs list the following coarse-grained tags used for the pos and pos_ attributes:
ADJ: adjective, e.g. big, old, green, incomprehensible, firstADP: adposition, e.g. in, to, duringADV: adverb, e.g. very, tomorrow, down, where, thereAUX: auxiliary, e.g. is, has (done), will (do), should (do)CONJ: conjunction, e.g. and, or, butCCONJ: coordinating conjunction, e.g. and, or, butDET: determiner, e.g. a, an, theINTJ: interjection, e.g. psst, ouch, bravo, helloNOUN: noun, e.g. girl, cat, tree, air, beautyNUM: numeral, e.g. 1, 2017, one, seventy-seven, IV, MMXIVPART: particle, e.g. ’s, not,PRON: pronoun, e.g I, you, he, she, myself, themselves, somebodyPROPN: proper noun, e.g. Mary, John, London, NATO, HBOPUNCT: punctuation, e.g. ., (, ), ?SCONJ: subordinating conjunction, e.g. if, while, thatSYM: symbol, e.g. $, %, §, ©, +, −, ×, ÷, =, :),VERB: verb, e.g. run, runs, running, eat, ate, eatingX: other, e.g. sfpksdpsxmsaSPACE: space, e.g.
Note that the docs are lying slightly when they say that this list follows the Universal Dependencies Scheme; there are two tags listed above that aren’t part of that scheme.
One of those is CONJ, which used to exist in the Universal POS Tags scheme but has been split into CCONJ and SCONJ since spaCy was first written. Based on the mappings of tag->pos in the docs, it would seem that spaCy’s current models don’t actually use CONJ, but it still exists in spaCy’s code and docs for some reason – perhaps backwards compatibility with old models.
The second is SPACE, which isn’t part of the Universal POS Tags scheme (and never has been, as far as I know) and is used by spaCy for any spacing besides single normal ASCII spaces (which don’t get their own token):
>>> document = en_nlp("Thisnsentencethas some weird spaces innnnntt it.")
>>> for token in document:
... print('%r (%s)' % (str(token), token.pos_))
...
'This' (DET)
'n' (SPACE)
'sentence' (NOUN)
't' (SPACE)
'has' (VERB)
' ' (SPACE)
'some' (DET)
'weird' (ADJ)
'spaces' (NOUN)
'in' (ADP)
'nnnntt ' (SPACE)
'it' (PRON)
'.' (PUNCT)
I’ll omit the full list of .tag_ tags (the finer-grained ones) from this answer, since they’re numerous, well-documented now, different for English and German, and probably more likely to change between releases. Instead, look at the list in the docs (e.g. https://spacy.io/api/annotation#pos-en for English) which lists every possible tag, the .pos_ value it maps to, and a description of what it means.
Dependency tokens
There are now three different schemes that spaCy uses for dependency tagging: one for English, one for German, and one for everything else. Once again, the list of values is huge and I won’t reproduce it in full here. Every dependency has a brief definition next to it, but unfortunately, many of them – like “appositional modifier” or “clausal complement” – are terms of art that are rather alien to an everyday programmer like me. If you’re not a linguist, you’ll simply have to research the meanings of those terms of art to make sense of them.
I can at least provide a starting point for that research for people working with English text, though. If you’d like to see some examples of the CLEAR dependencies (used by the English model) in real sentences, check out the 2012 work of Jinho D. Choi: either his Optimization of Natural Language Processing Components for Robustness and Scalability or his Guidelines for the CLEAR Style
Constituent to Dependency Conversion (which seems to just be a subsection of the former paper). Both list all the CLEAR dependency labels that existed in 2012 along with definitions and example sentences. (Unfortunately, the set of CLEAR dependency labels has changed a little since 2012, so some of the modern labels are not listed or exemplified in Choi’s work – but it remains a useful resource despite being slightly outdated.)
At present, dependency parsing and tagging in SpaCy appears to be implemented only at the word level, and not at the phrase (other than noun phrase) or clause level. This means SpaCy can be used to identify things like nouns (NN, NNS), adjectives (JJ, JJR, JJS), and verbs (VB, VBD, VBG, etc.), but not adjective phrases (ADJP), adverbial phrases (ADVP), or questions (SBARQ, SQ).
For illustration, when you use SpaCy to parse the sentence “Which way is the bus going?”, we get the following tree.
By contrast, if you use the Stanford parser you get a much more deeply structured syntax tree.
Just a quick tip about getting the detail meaning of the short forms. You can use explain method like following:
spacy.explain('pobj')
which will give you output like:
'object of preposition'
The official documentation now provides much more details for all those annotations at https://spacy.io/api/annotation (and the list of other attributes for tokens can be found at https://spacy.io/api/token).
As the documentation shows, their parts-of-speech (POS) and dependency tags have both Universal and specific variations for different languages and the explain() function is a very useful shortcut to get a better description of a tag’s meaning without the documentation, e.g.
spacy.explain("VBD")
which gives “verb, past tense”.
Direct links (if you don’t feel like going through endless spacy documentation to get the full tables):
-
for .pos_ (parts of speech, English): https://universaldependencies.org/docs/en/pos/
-
for .dep_ (dependency relations, English): https://universaldependencies.org/docs/en/dep/
After the recent update of Spacy to v3 the above links do not work.
You may visit this link to get the complete list.
Universal POS Tags
English POS Tags
Retrieve the tags and their meaning directly from pipeline/model programmatically
An alternative to looking up the tags in the documentation is to retrieve these programmatically from nlp.pipe_labels.
This has the advantage that you get the actual labels that your trained pipeline (aka model) provides and you don’t have to copy these manually.
The following example code uses model en_core_web_sm. Link to model card here. See Label Scheme at bottom. Adapt to the model of your choosing.
Note: The Universal Part-of-speech Tags aren’t programmatically available (at least I couldn’t find a way) and can be looked up here in the documentation.
import spacy
nlp = spacy.load("en_core_web_sm")
for component in nlp.pipe_names:
tags = nlp.pipe_labels[component]
if len(tags)!=0:
print(f"Label mapping for component: {component}")
display(dict(list(zip(tags, [spacy.explain(tag) for tag in tags]))))
print()
Output
Label mapping for component: tagger
{'$': 'symbol, currency',
"''": 'closing quotation mark',
',': 'punctuation mark, comma',
'-LRB-': 'left round bracket',
'-RRB-': 'right round bracket',
'.': 'punctuation mark, sentence closer',
':': 'punctuation mark, colon or ellipsis',
'ADD': 'email',
'AFX': 'affix',
'CC': 'conjunction, coordinating',
'CD': 'cardinal number',
'DT': 'determiner',
'EX': 'existential there',
'FW': 'foreign word',
'HYPH': 'punctuation mark, hyphen',
'IN': 'conjunction, subordinating or preposition',
'JJ': 'adjective (English), other noun-modifier (Chinese)',
'JJR': 'adjective, comparative',
'JJS': 'adjective, superlative',
'LS': 'list item marker',
'MD': 'verb, modal auxiliary',
'NFP': 'superfluous punctuation',
'NN': 'noun, singular or mass',
'NNP': 'noun, proper singular',
'NNPS': 'noun, proper plural',
'NNS': 'noun, plural',
'PDT': 'predeterminer',
'POS': 'possessive ending',
'PRP': 'pronoun, personal',
'PRP$': 'pronoun, possessive',
'RB': 'adverb',
'RBR': 'adverb, comparative',
'RBS': 'adverb, superlative',
'RP': 'adverb, particle',
'SYM': 'symbol',
'TO': 'infinitival "to"',
'UH': 'interjection',
'VB': 'verb, base form',
'VBD': 'verb, past tense',
'VBG': 'verb, gerund or present participle',
'VBN': 'verb, past participle',
'VBP': 'verb, non-3rd person singular present',
'VBZ': 'verb, 3rd person singular present',
'WDT': 'wh-determiner',
'WP': 'wh-pronoun, personal',
'WP$': 'wh-pronoun, possessive',
'WRB': 'wh-adverb',
'XX': 'unknown',
'_SP': 'whitespace',
'``': 'opening quotation mark'}
Label mapping for component: parser
{'ROOT': 'root',
'acl': 'clausal modifier of noun (adjectival clause)',
'acomp': 'adjectival complement',
'advcl': 'adverbial clause modifier',
'advmod': 'adverbial modifier',
'agent': 'agent',
'amod': 'adjectival modifier',
'appos': 'appositional modifier',
'attr': 'attribute',
'aux': 'auxiliary',
'auxpass': 'auxiliary (passive)',
'case': 'case marking',
'cc': 'coordinating conjunction',
'ccomp': 'clausal complement',
'compound': 'compound',
'conj': 'conjunct',
'csubj': 'clausal subject',
'csubjpass': 'clausal subject (passive)',
'dative': 'dative',
'dep': 'unclassified dependent',
'det': 'determiner',
'dobj': 'direct object',
'expl': 'expletive',
'intj': 'interjection',
'mark': 'marker',
'meta': 'meta modifier',
'neg': 'negation modifier',
'nmod': 'modifier of nominal',
'npadvmod': 'noun phrase as adverbial modifier',
'nsubj': 'nominal subject',
'nsubjpass': 'nominal subject (passive)',
'nummod': 'numeric modifier',
'oprd': 'object predicate',
'parataxis': 'parataxis',
'pcomp': 'complement of preposition',
'pobj': 'object of preposition',
'poss': 'possession modifier',
'preconj': 'pre-correlative conjunction',
'predet': None,
'prep': 'prepositional modifier',
'prt': 'particle',
'punct': 'punctuation',
'quantmod': 'modifier of quantifier',
'relcl': 'relative clause modifier',
'xcomp': 'open clausal complement'}
Label mapping for component: ner
{'CARDINAL': 'Numerals that do not fall under another type',
'DATE': 'Absolute or relative dates or periods',
'EVENT': 'Named hurricanes, battles, wars, sports events, etc.',
'FAC': 'Buildings, airports, highways, bridges, etc.',
'GPE': 'Countries, cities, states',
'LANGUAGE': 'Any named language',
'LAW': 'Named documents made into laws.',
'LOC': 'Non-GPE locations, mountain ranges, bodies of water',
'MONEY': 'Monetary values, including unit',
'NORP': 'Nationalities or religious or political groups',
'ORDINAL': '"first", "second", etc.',
'ORG': 'Companies, agencies, institutions, etc.',
'PERCENT': 'Percentage, including "%"',
'PERSON': 'People, including fictional',
'PRODUCT': 'Objects, vehicles, foods, etc. (not services)',
'QUANTITY': 'Measurements, as of weight or distance',
'TIME': 'Times smaller than a day',
'WORK_OF_ART': 'Titles of books, songs, etc.'}