Gabor Kovacs

Still happens with 0.11.1 built from source on macOS 11.6.2. Seems to be indeed connected to slow/unresponsive underlying device, in my case it is an external USB HDD with an...

@gaul I'm experimenting with `max_stat_cache_size=5000000,stat_cache_expire=1300000`. Would the idea of pre-filling stat cache with running a `find` command work? Is this a memory only cache ? (I only see entries in...

Latest caching experiment. cache dir empty, s3fs mount: ``` sudo s3fs aind-open-data ./aind-open-data -o rw,allow_other,umask=0002,uid=$(id -u),gid=$(id -g),use_cache=/home/ubuntu/s3cache,ensure_diskfree=200000,multireq_max=32,parallel_count=16,passwd_file=/home/ubuntu/.passwd_open_s3,max_dirty_data=256,nomultipart,max_stat_cache_size=5000000,stat_cache_interval_expire=1300000 ``` ``` find ~/aind-open-data/exaSPIM_653431_2023-05-06_10-23-15/exaSPIM.zarr/ -type f > filelist.txt ``` This proceeds with 100-200...

As of Python 3.6.6 this seems to be resolved in pdb, it _can_ change local variables.