s3cmd icon indicating copy to clipboard operation
s3cmd copied to clipboard

Added marker support to CloudFront.py to retrieve the next page of di…

Open fgroenendijk opened this issue 9 years ago • 3 comments

Added marker support to CloudFront.py to retrieve the next page of distributions for cflist. Will show the current and next marker as well as maximum items and item count before displaying the cloudfront list. This is concerning the s3cmd cflist command.

fgroenendijk avatar Feb 24 '16 08:02 fgroenendijk

Can you do this without the user having to specify a marker (e.g. just make it automatic) please?

On Wed, Feb 24, 2016 at 2:22 AM, weirdall [email protected] wrote:

Added marker support to CloudFront.py to retrieve the next page of distributions for cflist. Will show the current and next marker as well as maximum items and item count before displaying the cloudfront list. This is

concerning the s3cmd cflist command.

You can view, comment on, or merge this pull request online at:

https://github.com/s3tools/s3cmd/pull/707 Commit Summary

  • Added marker support to CloudFront.py to retrieve the next page of distributions for cflist

File Changes

  • M S3/CloudFront.py https://github.com/s3tools/s3cmd/pull/707/files#diff-0 (29)
  • M s3cmd https://github.com/s3tools/s3cmd/pull/707/files#diff-1 (1)

Patch Links:

  • https://github.com/s3tools/s3cmd/pull/707.patch
  • https://github.com/s3tools/s3cmd/pull/707.diff

— Reply to this email directly or view it on GitHub https://github.com/s3tools/s3cmd/pull/707.

mdomsch avatar Apr 05 '16 03:04 mdomsch

@weirdall As mdomsch said, it would be better to have the list cloudfront command list all the entries automatically by following all the markers. Without user interaction. Like what is done for S3 list entries.

fviard avatar Jun 27 '16 23:06 fviard

It still makes sense to have a marker option, so we can tell where the listing should start, see https://github.com/s3tools/s3cmd/pull/1211, we have huge buckets in production and we had to list the whole bucket at some point, a long running s3cmd ls can be killed for some reason, like out of memory, as current impl gathers the whole list in memory before printing, so having the marker option allows to resume the ls command.

zakalibit avatar Sep 23 '21 14:09 zakalibit