make minicluster - cassandra store creation failing

[trvl3r]

$PELOTON=app make minicluster PELOTON=app ./scripts/minicluster.sh setup tools/minicluster/main.py:60: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details. config = yaml.load(f) removed container peloton-cassandra started container peloton-cassandra failed to create cassandra store, retrying... failed to create cassandra store, retrying... failed to create cassandra store, retrying... failed to create cassandra store, retrying... failed to create cassandra store, retrying... failed to create cassandra store, retrying... failed to create cassandra store, retrying... failed to create cassandra store, retrying... failed to create cassandra store, retrying... failed to create cassandra store, retrying... failed to create cassandra store, retrying... failed to create cassandra store, retrying... failed to create cassandra store, retrying... failed to create cassandra store, retrying... failed to create cassandra store, retrying... failed to create cassandra store, retrying... failed to create cassandra store, retrying... failed to create cassandra store, retrying... failed to create cassandra store, retrying... failed to create cassandra store, retrying... Failed to create cassandra store after 20 attempts, aborting... make: *** [minicluster] Error 1

[bdelmas]

I am not an Uber employee - but I am not sure what is the problem. I just started to try Peloton on a brand new GCE instance with Ubuntu and it works well. Maybe try to give more details of the versions of your dependencies or if you have enough resources to launch it?

For me it was a brand new Ubuntu 8 vCPU, 30 Go of RAM, 100 Go SSD, and with the latest dependencies because I had to basically apt-get install everything.

[trvl3r]

This was run on a MBP w/ Mojave. potentially networking related? Maybe only Linux is supported for these scripts?

On Sat, Apr 27, 2019 at 12:07 PM Benjamin Delmas [email protected] wrote:

I am not a Uber employee - but I am not sure what the problem. I just started to try Peloton on a brand new GCE instance with Ubuntu and it works well. Maybe try to give more details of your dependencies or if you have enough resources to launch it?

For me it was a brand new Ubuntu 8 vCPU, 30 Go of RAM, 100 Go SSD, and with the latest dependencies because I had to basically apt-get install everything.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/uber/peloton/issues/8#issuecomment-487303221, or mute the thread https://github.com/notifications/unsubscribe-auth/AATD545ATE3MMEKVLEWU4RTPSSB6RANCNFSM4HIWGVDQ .

[amittbose]

Minicluster works fine on my MBP. Can you run docker ps when you see the error messages and check if a container named peloton-cassandra is running?

[mabansal]

There may be two reasons for this

You don't have much disk space in your machine to create the cassandra container

As amit said there may be issue in your docker

Can you please check

[talaniz]

I am able to reproduce this as well. I see the container running while the process is failing...

[talaniz]

@amittbose I can create it manually if I exec into the container--

 # cqlsh -e "create keyspace IF NOT EXISTS peloton_test with replication={ 'class' : 'SimpleStrategy', 'replication_factor' : 1 };"
 
 # cqlsh -e "describe peloton_test"

CREATE KEYSPACE peloton_test WITH replication = {'class': 'SimpleStrategy', 'replication_factor': '1'}  AND durable_writes = true;

A few debugging statements and I get the following--

b'Connection error: (\'Unable to connect to any servers\', {\'127.0.0.1\': error(111, "Tried connecting to [(\'127.0.0.1\', 9042)]. Last error: Connection refused")})\n'

I do see the port listening, though-- # telnet localhost 9042 Trying 127.0.0.1... Connected to localhost. Escape character is '^]'.

[talaniz]

cli.exec_start returns bytes in Python 3 so the cluster was actually being created, but the response comparison wasn't catching the response. I've filed a fix

[hszkf]

@talaniz how was the status, I got the same issue? Thanks for contributing

Specs : python3.6 ubuntu 18.04