dbl

--------------------------------------------------------------------------- IndexError Traceback (most recent call last) in () 45 texts = features.pop('comment_text').values 46 tokens, vocab = preprocess.tokenize(texts, max_length, n_threads=4, ---> 47 merge=True) 48 del texts 49 /Users/davidlaxer/anaconda/lib/python2.7/site-packages/lda2vec-0.1-py2.7.egg/lda2vec/preprocess.pyc in tokenize(texts,...

Seems to work with merge=False: tokens, vocab = preprocess.tokenize(texts, max_length, n_threads=4, merge=False) preprocess.py: line 46

(virtualenv)David-Laxers-MacBook-Pro:pig davidlaxer$ !v vi test.pig (virtualenv)David-Laxers-MacBook-Pro:pig davidlaxer$ pig -l /tmp -x local -w -v test.pig 2014-10-12 00:19:36,173 INFO [main] pig.ExecTypeProvider (ExecTypeProvider.java:selectExecType(41)) - Trying ExecType : LOCAL 2014-10-12 00:19:36,175 INFO [main]...

## Pig Stack Trace ERROR 2998: Unhandled internal error. Found interface org.apache.hadoop.mapreduce.JobContext, but class was expected java.lang.IncompatibleClassChangeError: Found interface org.apache.hadoop.mapreduce.JobContext, but class was expected at org.apache.pig.piggybank.storage.avro.PigAvroInputFormat.listStatus(PigAvroInputFormat.java:96) at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:340) at org.apache.pig.impl.io.ReadToEndLoader.init(ReadToEndLoader.java:190)...

I downloaded pig 14 source and built it: $ svn co http://svn.apache.org/repos/asf/pig/trunk $ ant $ cd contrib/piggybank/java $ ant $ ./pig -help Apache Pig version 0.14.0-SNAPSHOT (r1630244) compiled Oct 08...

David-Laxers-MacBook-Pro:~ davidlaxer$ !e echo $PATH /opt/local/bin:/opt/local/sbin:/opt/local/bin:/opt/local/sbin:/Users/davidlaxer/anaconda/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/Library/Frameworks/Python.framework/Versions/2.7/bin:/opt/local/bin:/opt/local/sbin:/opt/local/Library/Frameworks/Python.framework/Versions/2.7/bin:/Users/davidlaxer/sbt/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/opt/local/bin:/opt/local/sbin:/opt/local/bin:/opt/local/sbin:/Users/davidlaxer/anaconda/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/Library/Frameworks/Python.framework/Versions/2.7/bin:/opt/local/bin:/opt/local/sbin:/opt/local/Library/Frameworks/Python.framework/Versions/2.7/bin:/Users/davidlaxer/sbt/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/usr/bin:/bin:/usr/sbin:/sbin:/usr/local/bin:/opt/X11/bin:/usr/local/CrossPack-AVR/bin:/usr/local/git/bin:/usr/texbin:/Users/davidlaxer/scala/bin:/usr/local/hadoop/bin:/usr/local/hadoop/sbin::/bin:/sbin:/Users/davidlaxer/.rvm/bin:/Library/Frameworks/JRuby.framework/Versions/Current/bin:/Users/davidlaxer/scala/bin:/usr/local/hadoop/bin:/usr/local/hadoop/sbin:/Users/davidlaxer/Downloads/apache-maven-3.2.1/bin::/bin:/sbin:/Library/Frameworks/JRuby.framework/Versions/Current/bin:/usr/local/mysql/bin:/Users/davidlaxer/pig/trunk/bin: David-Laxers-MacBook-Pro:~ davidlaxer$ pig Cannot locate pig-core-h2.jar. do 'ant -Dhadoopversion=23 jar', and try again David-Laxers-MacBook-Pro:~ davidlaxer$ which pig /usr/local/bin/pig David-Laxers-MacBook-Pro:~ davidlaxer$ ls -l /usr/local/bin/pig lrwxr-xr-x...

David-Laxers-MacBook-Pro:~ davidlaxer$ env | grep HADOOP HADOOP_HOME=/users/davidlaxer/hadoop-2.3.0-src HADOOP_CONF_DIR=/users/davidlaxer/hadoop-2.3.0-src/src/conf On Oct 9, 2014, at 1:37 AM, David Laxer [email protected] wrote: > David-Laxers-MacBook-Pro:~ davidlaxer$ !e > echo $PATH > /opt/local/bin:/opt/local/sbin:/opt/local/bin:/opt/local/sbin:/Users/davidlaxer/anaconda/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/Library/Frameworks/Python.framework/Versions/2.7/bin:/opt/local/bin:/opt/local/sbin:/opt/local/Library/Frameworks/Python.framework/Versions/2.7/bin:/Users/davidlaxer/sbt/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/opt/local/bin:/opt/local/sbin:/opt/local/bin:/opt/local/sbin:/Users/davidlaxer/anaconda/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/Library/Frameworks/Python.framework/Versions/2.7/bin:/opt/local/bin:/opt/local/sbin:/opt/local/Library/Frameworks/Python.framework/Versions/2.7/bin:/Users/davidlaxer/sbt/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/usr/bin:/bin:/usr/sbin:/sbin:/usr/local/bin:/opt/X11/bin:/usr/local/CrossPack-AVR/bin:/usr/local/git/bin:/usr/texbin:/Users/davidlaxer/scala/bin:/usr/local/hadoop/bin:/usr/local/hadoop/sbin::/bin:/sbin:/Users/davidlaxer/.rvm/bin:/Library/Frameworks/JRuby.framework/Versions/Current/bin:/Users/davidlaxer/scala/bin:/usr/local/hadoop/bin:/usr/local/hadoop/sbin:/Users/davidlaxer/Downloads/apache-maven-3.2.1/bin::/bin:/sbin:/Library/Frameworks/JRuby.framework/Versions/Current/bin:/usr/local/mysql/bin:/Users/davidlaxer/pig/trunk/bin: > David-Laxers-MacBook-Pro:~...

The requirements for the virtual environment finally completed: (virtualenv)David-Laxers-MacBook-Pro:hadoop-2.3.0-src davidlaxer$ sudo port install snappy Password: ---> Computing dependencies for snappy ---> Cleaning snappy ---> Scanning binaries for linking errors --->...

Here’s what happened with Pig 0.13 (virtualenv)David-Laxers-MacBook-Pro:pig-0.13.0 davidlaxer$ ./bin/pig -x Apache Pig version 0.13.0 (r1606446) compiled Jun 29 2014, 02:27:58 USAGE: Pig [options] [-] : Run interactively in grunt shell....

Please review this … (virtualenv)David-Laxers-MacBook-Pro:~ davidlaxer$ cd Agile_Data_Code/ (virtualenv)David-Laxers-MacBook-Pro:Agile_Data_Code davidlaxer$ ls Procfile ch02 ch04 ch06 ch08 pigrc src README.md ch03 ch05 ch07 ch09 requirements.txt (virtualenv)David-Laxers-MacBook-Pro:Agile_Data_Code davidlaxer$ pip install -r requirements.txt...