NLP-project
NLP-project copied to clipboard
11411 Natural Language Processing Final Project. Reads wikipedia articles, and then can both answer natural-language questions about the article as well as generate comprehension questions. Built usin...
NLP Term Project
11411 Group 6 Project. See NLP Project Page
Contributors
Timeline
- Thursday February 7, Stub Program (Ryhan) & Initial Plan (Daniel)
- Tuesday February 26, Progress Report 1 (Stephen)
- Thursday March 21, Progress Report 2 (Ryhan)
- Tuesday April 9, Dry run system
- Tuesday April 16, Project code due
- Tuesday April 30, Demos at Google
- Thursday May 2, Final Report
Asking Program
./ask article.txt nquestions
The asking program takes an
article.txtcontaining a Wikipedia article and- an integer
nquestions.
Answering Program
./answer article.txt questions.txt
The answering program takes an
article.txtcontaining a Wikipedia article and- a textfile
questions.txtcontaining one question per line.
Getting Started
Permissions
chmod +x ask
chmod +x answer
Installing NLTK
First download setuptools, http://pypi.python.org/pypi/setuptools
sudo sh Downloads/setuptools-...egg
sudo easy_install pip
sudo pip install -U numpy
sudo pip install -U pyyaml nltk
Download NLTK datasets
python
>>> import nltk
>>> nltk.download()
Once the NLTK Downloader GUI pops up, download all to /Users/USERNAME/nltk_data