s3sync icon indicating copy to clipboard operation
s3sync copied to clipboard

s3.ListObjects maybe cause an infinite loop

Open jeessy2 opened this issue 2 years ago • 0 comments

In some coditions, Using ListObjectsPagesWithContext will cause an infinite loop. But when i change to ListObjectsV2PagesWithContext and it works fine.

ListObjectsPagesWithContext getting next marker always some. There is some logs:

encoding-type=url&marker=equipxxx1692601065139.pdf%255Bminio_cache%253Av2%252Creturn%253A%255D&max-keys=1000&prefix=
encoding-type=url&marker=equipxxx1692601065139.pdf%255Bminio_cache%253Av2%252Creturn%253A%255D&max-keys=1000&prefix=
encoding-type=url&marker=equipxxx1692601065139.pdf%255Bminio_cache%253Av2%252Creturn%253A%255D&max-keys=1000&prefix=

my env:

  • minio latest
  • about 6k files, 26GB

jeessy2 avatar Dec 08 '23 07:12 jeessy2