ipython
ipcluster won't start in a certain directory
There is one directory where when I try to start ipcluster, I get the following:
ipcluster start 2021-04-23 10:06:33.597 [IPClusterStart] Starting ipcluster with [daemon=False] 2021-04-23 10:06:33.597 [IPClusterStart] Creating pid file: /home/zach/.ipython/profile_default/pid/ipcluster.pid 2021-04-23 10:06:33.636 [IPClusterStart] Starting Controller with LocalControllerLauncher 2021-04-23 10:06:34.638 [IPClusterStart] Starting 8 Engines with LocalEngineSetLauncher 2021-04-23 10:07:05.411 [IPClusterStart] Engines appear to have started successfully 2021-04-23 10:07:08.690 [IPClusterStart] ERROR | IPython cluster: stopping 2021-04-23 10:07:08.690 [IPClusterStart] Stopping Engines... 2021-04-23 10:07:11.694 [IPClusterStart] Removing pid file: /home/zach/.ipython/profile_default/pid/ipcluster.pid
This is on both my local and remove Ubuntu machines. Here is some version info:
local machine ipython version 7.22.0 Python 3.8.5 ipyparallel 6.3.0 ipykernel 5.5.3
remote machine Python 3.6.9 ipython 7.16.1 ipyparallel 6.3.0 ipkernel 5.4.2
Things I have tried: copying directory restarting upgrading everything deleting ipython pid and engines.json files ls -al to find files in the problem directory that might cause an issue. deleting pycache
It was working well before today. Last tried several days ago, when it was working. Unfortunately the directory that is not working is the one I always use.
Can you check the engine and/or controller log files? Should be in /home/zach/.ipython/profile_default/log
You might also try launching ipcontroller and ipengine separately to see if you get more information that could be swallowed by ipcluster.
Running ipcontroller and ipengine gives
ipcontroller 2021-04-27 11:58:47.928 [IPControllerApp] Hub listening on tcp://127.0.0.1:49155 for registration. 2021-04-27 11:58:47.930 [IPControllerApp] Hub using DB backend: 'DictDB' 2021-04-27 11:58:48.184 [IPControllerApp] hub::created hub 2021-04-27 11:58:48.185 [IPControllerApp] writing connection info to /home/zach/.ipython/profile_default/security/ipcontroller-client.json 2021-04-27 11:58:48.225 [IPControllerApp] writing connection info to /home/zach/.ipython/profile_default/security/ipcontroller-engine.json 2021-04-27 11:58:48.226 [IPControllerApp] task::using Python leastload Task scheduler 2021-04-27 11:58:48.227 [IPControllerApp] Heartmonitor started 2021-04-27 11:58:48.247 [IPControllerApp] Creating pid file: /home/zach/.ipython/profile_default/pid/ipcontroller.pid 2021-04-27 11:58:48.265 [scheduler] Scheduler started [leastload] 2021-04-27 11:58:48.270 [IPControllerApp] client::client b'\x00k\x8bEg' requested 'connection_request' 2021-04-27 11:58:48.270 [IPControllerApp] client::client [b'\x00k\x8bEg'] connected 2021-04-27 12:16:06.662 [IPControllerApp] client::client b'78acdc12-5e7517d85fd2ba8666d8bb4c' requested 'registration_request' 2021-04-27 12:16:12.230 [IPControllerApp] registration::finished registering engine 0:78acdc12-5e7517d85fd2ba8666d8bb4c 2021-04-27 12:16:12.232 [IPControllerApp] engine::Engine Connected: 0
and
ipengine 2021-04-27 12:16:06.659 [IPEngineApp] Loading url_file '/home/zach/.ipython/profile_default/security/ipcontroller-engine.json' 2021-04-27 12:16:06.661 [IPEngineApp] Registering with controller at tcp://127.0.0.1:49155 2021-04-27 12:16:06.749 [IPEngineApp] Starting to monitor the heartbeat signal from the hub every 3010 ms. 2021-04-27 12:16:06.752 [IPEngineApp] Running file in user namespace: /home/zach/.ipython/profile_default/startup/start.py 2021-04-27 12:16:07.738 [IPEngineApp] Completed registration with id 0 2021-04-27 12:16:07.739 [IPEngineApp] Entering eventloop <function loop_qt5 at 0x7f1a9cce30d0>
The log afer this looks like this: {"engines": {"0": "78acdc12-5e7517d85fd2ba8666d8bb4c"}, "next_id": 1}
Stopping all these precesses, deleting the log, and running ipcluster start then gives:
ipcluster start 2021-04-28 08:17:31.972 [IPClusterStart] Starting ipcluster with [daemon=False] 2021-04-28 08:17:31.972 [IPClusterStart] Creating pid file: /home/zach/.ipython/profile_default/pid/ipcluster.pid 2021-04-28 08:17:31.973 [IPClusterStart] Starting Controller with LocalControllerLauncher 2021-04-28 08:17:32.975 [IPClusterStart] Starting 8 Engines with LocalEngineSetLauncher 2021-04-28 08:18:03.767 [IPClusterStart] Engines appear to have started successfully 2021-04-28 08:18:19.493 [IPClusterStart] ERROR | IPython cluster: stopping 2021-04-28 08:18:19.493 [IPClusterStart] Stopping Engines... 2021-04-28 08:18:22.497 [IPClusterStart] Removing pid file: /home/zach/.ipython/profile_default/pid/ipcluster.pid
and the log file is not created.