pegasus
pegasus copied to clipboard
VM based deployment for prototyping Big Data tools on Amazon Web Services
Redis executables lie in $REDIS_HOME/src unlike most other tools.
Only can set these throught he Zeppelin UI interface and not in zeppelin-env.sh Should be using SPARK_SUBMIT_OPTIONS="--driver-memory 14000M --executor-memory 14000M" but doesn't seem to carry through to the Zeppelin UI
Add: autopurge.snapRetainCount=3 autopurge.purgeInterval=1 to /usr/local/zookeeper/conf/zoo.cfg as noted here: https://zookeeper.apache.org/doc/trunk/zookeeperAdmin.html#sc_maintenance
Examples would be for the ability to tell the kafka installation where the current zookeeper cluster resides and use those IPs for the configuration