carlilek

No rush. Just wanted to get my hands on that sweet sweet scandir optimization, and thought I'd share.  --Ken On Dec 31, 2017, at 1:30 PM, jbd wrote: Thank you...

Ran into unicode problems. Around line 659, where I changed from wb to w. Clearly something I'm missing here.

I am, but only on a particular file structure that happens to be about 300TB... and only after a random amount of time. I'm messing with encoding the string on...

This would seem to be an incredibly edge case, which probably got skipped over in the python2 version because of the different exception handling in python3. I'm going to work...

This is how the filename appears in Linux (ls):  mEOS_0s8_Int_45?W_0s5-4s_Act_3mW_Exc_20x500.zip Here is the error that I got msrsync to throw:  Cannot write entry Compress_and_move_to_nearline_2016_03_18/data0/palmdata/PALM Data/Image Files/Proline/mEOS_0s8_Int_45\udcb5W_0s5-4s_Act_3mW_Exc_20x500.dat to bucket file /tmp/msrsync-yk3kowib/283./044921875/tmpmampqcd1...

# find . -maxdepth 1 -type f -name "mEOS_0s8_Int_45*zip" -exec sh -c 'printf "%-10s %s\n" "$1" "$(printf "$1" | xxd -pu )"' None {} \; ./mEOS_0s8_Int_45�W_0s5-4s_Act_3mW_Exc_20x500.zip 2e2f6d454f535f3073385f496e745f3435b5575f3073352d34735f416374 5f336d575f4578635f3230783530302e7a6970 or, screenshotted...

Cool. I'll continue trying to work around it, but boy oh boy is this thing pernicious.  On Jan 2, 2018, at 1:25 PM, jbd wrote: Perfect, thank you. I'll try...

The reason it doesn't appear in the python 2 version is that python 2's default encoding is ASCII, while python 3 is utf-8. Discovered this in re-writing the except: code...

Awesome! I would recommend running a regular rsync immediately afterward just to be certain. I have some issues with encoding of Windows files. Been trying to hammer through what's going...

I’m closer, but darned if I can get rsync from-file to read the output files when they’re written in bytes with the proper encoding. It just says the files don’t...