aptly icon indicating copy to clipboard operation
aptly copied to clipboard

feat: Add etcd database support

Open hudeng-go opened this issue 3 years ago • 15 comments

improve concurrent access and high availability of aptly with the help of the characteristics of etcd

Fixes #

Requirements

All new code should be covered with tests, documentation should be updated. CI should pass.

Description of the Change

Checklist

  • [x] unit-test added (if change is algorithm)
  • [x] functional test added/updated (if change is functional)
  • [x] man page updated (if applicable)
  • [x] bash completion updated (if applicable)
  • [x] documentation updated
  • [x] author name in AUTHORS

hudeng-go avatar Feb 08 '22 05:02 hudeng-go

@lbolla Resolve system test errors at #1022

hudeng-go avatar Feb 08 '22 05:02 hudeng-go

@hudeng-go Looking good to me. What do you think of this comment on the other ticket? https://github.com/aptly-dev/aptly/pull/1022#issuecomment-1031567248

lbolla avatar Feb 08 '22 15:02 lbolla

@hudeng-go Tests failed... https://github.com/aptly-dev/aptly/runs/5140408342?check_suite_focus=true They also log a lot and take quite a long time, which will eat our free allowance of GH actions... Can you think of a solution?

lbolla avatar Feb 10 '22 12:02 lbolla

@hudeng-go Tests failed... https://github.com/aptly-dev/aptly/runs/5140408342?check_suite_focus=true They also log a lot and take quite a long time, which will eat our free allowance of GH actions... Can you think of a solution?

Sorry, it took a long time to link etcd when migrating data. We are looking for the reason.

hudeng-go avatar Feb 11 '22 01:02 hudeng-go

@hudeng-go I had to stop the CI once again, as it was stuck... Can we make the script so that it would crash at the first error, so we don't continue a clearly failing test?

lbolla avatar Feb 11 '22 08:02 lbolla

@hudeng-go I had to stop the CI once again, as it was stuck... Can we make the script so that it would crash at the first error, so we don't continue a clearly failing test?

I have modified the migration script to exit with an error. Sorry again.

hudeng-go avatar Feb 11 '22 08:02 hudeng-go

@hudeng-go I had to stop the CI once again, as it was stuck... Can we make the script so that it would crash at the first error, so we don't continue a clearly failing test?

In my environment, data can be migrated to normally. I don't know why I can't connect to etcd database in GH action environment.

hudeng-go avatar Feb 11 '22 10:02 hudeng-go

@hudeng-go I had to stop the CI once again, as it was stuck... Can we make the script so that it would crash at the first error, so we don't continue a clearly failing test?

Once https://github.com/aptly-dev/aptly/pull/1033 is merged, you can rebase to ensure we have stricter timeouts for CI jobs, and avoid tests wasting our GHA allowance.

lbolla avatar Feb 12 '22 19:02 lbolla

@hudeng-go I had to stop the CI once again, as it was stuck... Can we make the script so that it would crash at the first error, so we don't continue a clearly failing test?

Once #1033 is merged, you can rebase to ensure we have stricter timeouts for CI jobs, and avoid tests wasting our GHA allowance.

#1033 is merged. Please rebase this branch before carrying out further tests. Thanks!

lbolla avatar Feb 13 '22 20:02 lbolla

@hudeng-go On my humble LXD image, which I use for development, etcd is using quite a lot of resources. Maybe it crashes on CI because it's too memory/cpu hungry? Screenshot from 2022-02-14 14-09-04

lbolla avatar Feb 14 '22 13:02 lbolla

Is there any update to bring this patch into upstream?

sinuscosinustan avatar Oct 20 '22 09:10 sinuscosinustan

Howdy, any chance to get this back on track?

tonobo avatar Apr 19 '23 12:04 tonobo

@randombenj As you seem to be the most active reviewer/contributor for Aptly, could you please review this?

sinuscosinustan avatar Dec 01 '23 13:12 sinuscosinustan

Hi all,

maybe we should rebase this on master first, which seems to be a bit of work.. any chance someone could help with this ?

neolynx avatar Dec 01 '23 13:12 neolynx