Home
This Title All WIREs
WIREs RSS Feed
How to cite this WIREs title:
WIREs Cogn Sci
Impact Factor: 1.413

Statistical methods in language processing

Full article on Wiley Online Library:   HTML PDF

Can't access this content? Tell your librarian.

The term statistical methods here refers to a methodology that has been dominant in computational linguistics since about 1990. It is characterized by the use of stochastic models, substantial data sets, machine learning, and rigorous experimental evaluation. The shift to statistical methods in computational linguistics parallels a movement in artificial intelligence more broadly. Statistical methods have so thoroughly permeated computational linguistics that almost all work in the field draws on them in some way. There has, however, been little penetration of the methods into general linguistics. The methods themselves are largely borrowed from machine learning and information theory. We limit attention to that which has direct applicability to language processing, though the methods are quite general and have many nonlinguistic applications.

Not every use of statistics in language processing falls under statistical methods as we use the term. Standard hypothesis testing and experimental design, for example, are not covered in this article. WIREs Cogni Sci 2011 2 315–322 DOI: 10.1002/wcs.111

Related Articles

Language and the Mind

Browse by Topic

Linguistics > Computational Models of Language
blog comments powered by Disqus

Access to this WIREs title is by subscription only.

Recommend to Your
Librarian Now!

The latest WIREs articles in your inbox

Sign Up for Article Alerts

In the Spotlight

Stan Klein

Stan Klein

Dr. Stan Klein’s research revolves around understanding self, memory, and consciousness. Klein argues that the unitary self of everyday experience actually is a multiplicity. For example, within memory, there are various, functionally independent systems of self-knowledge, including semantic personal facts, abstract trait self-knowledge, and episodic narratives.  Another aspect of self is its subjectivity. This form of consciousness interacts with the neurally-based aspects of self to produce the human experience of self.

Dr. Klein believes that we need to move beyond studying memory content and focus on how that content is presented to awareness. He argues that it is the manner in which content is apprehended by awareness that determines whether we experience content as episodic or semantic.

Learn More

Twitter: WBPsychology Follow us on Twitter