Semantic projection recovers rich human knowledge of multiple object features from word embeddings

Gabriel Grand, Idan Asher Blank (), Francisco Pereira and Evelina Fedorenko
Additional contact information
Gabriel Grand: MIT
Idan Asher Blank: UCLA
Francisco Pereira: National Institute of Mental Health
Evelina Fedorenko: MIT

Nature Human Behaviour, 2022, vol. 6, issue 7, 975-987

Abstract: Abstract How is knowledge about word meaning represented in the mental lexicon? Current computational models infer word meanings from lexical co-occurrence patterns. They learn to represent words as vectors in a multidimensional space, wherein words that are used in more similar linguistic contexts—that is, are more semantically related—are located closer together. However, whereas inter-word proximity captures only overall relatedness, human judgements are highly context dependent. For example, dolphins and alligators are similar in size but differ in dangerousness. Here, we use a domain-general method to extract context-dependent relationships from word embeddings: ‘semantic projection’ of word-vectors onto lines that represent features such as size (the line connecting the words ‘small’ and ‘big’) or danger (‘safe’ to ‘dangerous’), analogous to ‘mental scales’. This method recovers human judgements across various object categories and properties. Thus, the geometry of word embeddings explicitly represents a wealth of context-dependent world knowledge.

Date: 2022
References: Add references at CitEc
Citations: View citations in EconPapers (5)

Downloads: (external link)
https://www.nature.com/articles/s41562-022-01316-8 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:nat:nathum:v:6:y:2022:i:7:d:10.1038_s41562-022-01316-8

Ordering information: This journal article can be ordered from
https://www.nature.com/nathumbehav/

DOI: 10.1038/s41562-022-01316-8

Access Statistics for this article

Nature Human Behaviour is currently edited by Stavroula Kousta

More articles in Nature Human Behaviour from Nature
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().