s3sync
s3sync copied to clipboard
s3.ListObjects maybe cause an infinite loop
In some coditions, Using ListObjectsPagesWithContext will cause an infinite loop. But when i change to ListObjectsV2PagesWithContext and it works fine.
ListObjectsPagesWithContext getting next marker always some. There is some logs:
encoding-type=url&marker=equipxxx1692601065139.pdf%255Bminio_cache%253Av2%252Creturn%253A%255D&max-keys=1000&prefix=
encoding-type=url&marker=equipxxx1692601065139.pdf%255Bminio_cache%253Av2%252Creturn%253A%255D&max-keys=1000&prefix=
encoding-type=url&marker=equipxxx1692601065139.pdf%255Bminio_cache%253Av2%252Creturn%253A%255D&max-keys=1000&prefix=
my env:
- minio latest
- about 6k files, 26GB