benchmark icon indicating copy to clipboard operation
benchmark copied to clipboard

Improve Pulsar AWS deployment (terraform + ansible)

Open melhindi opened this issue 1 year ago • 2 comments

This PR enhances the deployment of Pulsar on AWS using Terraform and Ansible, incorporating several improvements and optimizations:

  1. Prevent redundant benchmark code uploads: Optimized benchmark code deployment by splitting and using creates to avoid unnecessary uploads.

  2. Dynamic discovery of storage devices: Replaced hardcoded disk labels with Ansible-based discovery, ensuring reliable deployment across AWS instances where device labels may change post-reboot.

  3. Replace terraform-inventory with Ansible Provider and support for spot instances Upgraded to Ansible Provider and Terraform Ansible-Collection, retiring outdated terraform-inventory plugin. Introduced support for deploying instances as AWS spot instances via a new configurable variable (default = False).

These changes collectively enhance deployment reliability and introduce flexibility in instance provisioning for Pulsar and Bookkeeper deployments on AWS.

melhindi avatar Jul 03 '24 20:07 melhindi

This issue has been automatically marked as stale because it has not had recent activity. It will be closed after 5 days if no further activity occurs. Thank you for your contributions.

stale[bot] avatar Sep 02 '24 10:09 stale[bot]

Hi @merlimat, could you pls. have a look at this PR and let me know if I need to change anything to get it merged? Thanks!

melhindi avatar Sep 02 '24 12:09 melhindi

This issue has been automatically marked as stale because it has not had recent activity. It will be closed after 5 days if no further activity occurs. Thank you for your contributions.

stale[bot] avatar Nov 09 '24 00:11 stale[bot]