John Beieler

Processing bug

9

Seems to be a bug that causes PETR to crash. Traceback is: ``` Traceback (most recent call last): File "/home/data/phoenix_pipeline/pipeline.py", line 133, in run_filter=file_details.oneaday_filter) File "/home/data/phoenix_pipeline/pipeline.py", line 98, in main...

The XML reader needs to be more robust. If an error is thrown it should log the information (line number) and pass.

Global ID

4

Need to add in a global, unique ID for each event record.

Need to have a set of unit tests to make sure things don't break as we make further changes.

Strange output format for phrase extraction.

2

Trying to run some sample data to explore the phrase extraction pieces. I'm using the following data: ``` {'abc123': {'meta': {'date': '20010101'}, 'sents': {0: {'content': u'At least 37 people are...

Don't really want to write every event/sentence to `stdout` all the time. Would be nice to have an arg to control that.