helix-cli icon indicating copy to clipboard operation
helix-cli copied to clipboard

hlx admin

Open kptdobe opened this issue 3 years ago • 4 comments

As part of the import process, there is the need to bulk preview / publish a lot of pages. Ideally we could do:

hlx admin --preview urls.xlsx // preview all urls from the URL column of the spreadsheet
hlx admin --preview --publish urls.xlsx // preview and publish all urls from the URL column of the spreadsheet
hlx admin --index 450 --preview --publish urls.xlsx // preview and publish all urls from the URL column of the spreadsheet starting at row 451 (row 1 = heading)

The cli would then deal with the concurrency (run 8 in parallel ?).

kptdobe avatar Apr 04 '22 13:04 kptdobe

Hello, as a follow-up to a Slack thread about issues with https://thinktanked.org/tools/bulk/bulk.html (where too many API requests were done in parallel, causing 503s) I started working on some scripting for bulk preview/live operations and I ended up doing a node.js CLI: franklin-bulk.

Here is a demo:

https://user-images.githubusercontent.com/40354404/224563540-13ccd22a-02a8-47e5-b4fc-efb44f3a0edb.mp4

Would there be an interest to get this feature contributed as new commands of the helix-cli?

Remark:

  • Concurrency is implemented using Node.js native threads

catalan-adobe avatar Mar 12 '23 18:03 catalan-adobe

Concurrency is implemented using Node.js native threads

wow...looks complicated for something that is anyways async ;-) you could use https://github.com/adobe/helix-shared/tree/main/packages/helix-shared-process-queue, which is a bit simpler to use ;-)

tripodsan avatar Mar 12 '23 23:03 tripodsan

What is the meaning of all this I don't really get it

ghost avatar Dec 22 '23 15:12 ghost

in the meantime we have the admin bulk api: https://www.aem.live/docs/admin.html#tag/preview/operation/bulkPreview

@catalan-adobe I suggest you improve your tool to use that api. it drastically reduces the load on sharepoint

tripodsan avatar Jan 10 '24 14:01 tripodsan