The Handbook of Computational Linguistics and Natural Language Processing

This comprehensive reference work provides an overview of the concepts, methodologies, and applications in computational linguistics and natural language processing (NLP). Features contributions by the top researchers in the field, reflecting the work that is driving the discipline forward Includes an introduction to the major theoretical issues in these fields, as well as the central engineering applications that the work has produced Presents the major developments in an accessible way, explaining the close connection between scientific understanding of the computational properties of natural language and the creation of effective language technologies Serves as an invaluable state-of-the-art reference source for computational linguists and software engineers developing NLP applications in industrial research and development labs of software companies

Alexander Clark is a Lecturer in the Department of Computer Science at Royal Holloway, University of London. He is the co-author, with Shalom Lappin, of Linguistic Nativism and the Poverty of the Stimulus (Wiley-Blackwell, 2010).

Chris Fox is a Reader in the School of Computer Science and Electronic Engineering at the University of Essex. He has also taught at Goldsmiths College, University of London, and King’s College London. He is co-author, with Shalom Lappin, of Foundations of Intensional Semantics (Wiley-Blackwell, 2005).

Shalom Lappin is Professor of Computational Linguistics at King's College London. He is editor of the Handbook of Contemporary Semantic Theory (1996); co-author, with Chris Fox, of Foundations of Intensional Semantics (2005); and, with Alexander Clark, co-author of Linguistic Nativism and the Poverty of the Stimulus (2010), all published by Wiley-Blackwell.

List of Figures ix

List of Tables xiv

Notes on Contributors xv

Preface xxiii

Introduction 1

Part I Formal Foundations 9

1 Formal Language Theory 11
SHULY WINTNER

2 Computational Complexity in Natural Language 43
IAN PRATT-HARTMANN

3 Statistical Language Modeling 74
CIPRIAN CHELBA

4 Theory of Parsing 105
MARK-JAN NEDERHOF AND GIORGIO SATTA

Part II Current Methods 131

5 Maximum Entropy Models 133
ROBERT MALOUF

6 Memory-Based Learning 154
WALTER DAELEMANS AND ANTAL VAN DEN BOSCH

7 Decision Trees 180
HELMUT SCHMID

8 Unsupervised Learning and Grammar Induction 197
ALEXANDER CLARK AND SHALOM LAPPIN

9 Artificial Neural Networks 221
JAMES B. HENDERSON

10 Linguistic Annotation 238
MARTHA PALMER AND NIANWEN XUE

11 Evaluation of NLP Systems 271
PHILIP RESNIK AND JIMMY LIN

Part III Domains of Application 297

12 Speech Recognition 299
STEVE RENALS AND THOMAS HAIN

13 Statistical Parsing 333
STEPHEN CLARK

14 Segmentation and Morphology 364
JOHN A. GOLDSMITH

15 Computational Semantics 394
CHRIS FOX

16 Computational Models of Dialogue 429
JONATHAN GINZBURG AND RAQUEL FERNÁNDEZ

17 Computational Psycholinguistics 482
MATTHEW W. CROCKER

Part IV Applications 515

18 Information Extraction 517
RALPH GRISHMAN

19 Machine Translation 531
ANDY WAY

20 Natural Language Generation 574
EHUD REITER

21 Discourse Processing 599
RUSLAN MITKOV

22 Question Answering 630
BONNIE WEBBER AND NICK WEBB

References 655

Author Index 742

Subject Index 763