python-docs-samples compute.oslogin.service_account_ssh_test: test

Note: #6894 was also for this test, but it was closed more than 10 days ago. So, I didn't mark it flaky.

commit: 5ceff2520ecced7e1284f5ce0592b93dafcf3817 buildURL: Build Status, Sponge status: failed

Test output

Traceback (most recent call last):
  File "/workspace/compute/oslogin/service_account_ssh_test.py", line 64, in test_main
    machine_type, account_email)
  File "/workspace/compute/oslogin/service_account_ssh_test.py", line 201, in setup_resources
    body=instance_config).execute()
  File "/workspace/compute/oslogin/.nox/py-3-6/lib/python3.6/site-packages/googleapiclient/_helpers.py", line 131, in positional_wrapper
    return wrapped(*args, **kwargs)
  File "/workspace/compute/oslogin/.nox/py-3-6/lib/python3.6/site-packages/googleapiclient/http.py", line 937, in execute
    raise HttpError(resp, content, uri=self.uri)
googleapiclient.errors.HttpError: 
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/workspace/compute/oslogin/service_account_ssh_test.py", line 68, in test_main
raise Exception('Could not set up the necessary test resources.')
Exception: Could not set up the necessary test resources.

Dec 21 '21 10:12 flaky-bot[bot]

This should be resolved now that b/211071739 is resolved

Jan 06 '22 00:01 leahecole

Looks like this issue is flaky. :worried:

I'm going to leave this open and stop commenting.

A human should fix and close this.

commit: 32950b9abd14c7316babd04a0df932828a7657e4 buildURL: Build Status, Sponge status: failed

Test output

Traceback (most recent call last): File "/workspace/compute/oslogin/service_account_ssh_test.py", line 97, in test_main ssh_login() File "/workspace/compute/oslogin/.nox/py-3-10/lib/python3.10/site-packages/retrying.py", line 49, in wrapped_f return Retrying(*dargs, **dkw).call(f, *args, **kw) File "/workspace/compute/oslogin/.nox/py-3-10/lib/python3.10/site-packages/retrying.py", line 212, in call raise attempt.get() File "/workspace/compute/oslogin/.nox/py-3-10/lib/python3.10/site-packages/retrying.py", line 247, in get six.reraise(self.value[0], self.value[1], self.value[2]) File "/workspace/compute/oslogin/.nox/py-3-10/lib/python3.10/site-packages/six.py", line 719, in reraise raise value File "/workspace/compute/oslogin/.nox/py-3-10/lib/python3.10/site-packages/retrying.py", line 200, in call attempt = Attempt(fn(*args, **kwargs), attempt_number, False) File "/workspace/compute/oslogin/service_account_ssh_test.py", line 90, in ssh_login main(cmd, project, test_id, zone, oslogin, account, hostname) File "/workspace/compute/oslogin/service_account_ssh.py", line 116, in main private_key_file = create_ssh_key(oslogin, account) File "/workspace/compute/oslogin/service_account_ssh.py", line 79, in create_ssh_key oslogin.users().importSshPublicKey(parent=account, body=body).execute() File "/workspace/compute/oslogin/.nox/py-3-10/lib/python3.10/site-packages/googleapiclient/_helpers.py", line 131, in positional_wrapper return wrapped(*args, **kwargs) File "/workspace/compute/oslogin/.nox/py-3-10/lib/python3.10/site-packages/googleapiclient/http.py", line 922, in execute resp, content = _retry_request( File "/workspace/compute/oslogin/.nox/py-3-10/lib/python3.10/site-packages/googleapiclient/http.py", line 190, in _retry_request resp, content = http.request(uri, method, *args, **kwargs) File "/workspace/compute/oslogin/.nox/py-3-10/lib/python3.10/site-packages/google_auth_httplib2.py", line 245, in request self.credentials.refresh(self._request) File "/workspace/compute/oslogin/.nox/py-3-10/lib/python3.10/site-packages/google/oauth2/service_account.py", line 410, in refresh access_token, expiry, _ = _client.jwt_grant( File "/workspace/compute/oslogin/.nox/py-3-10/lib/python3.10/site-packages/google/oauth2/_client.py", line 193, in jwt_grant response_data = _token_endpoint_request(request, token_uri, body) File "/workspace/compute/oslogin/.nox/py-3-10/lib/python3.10/site-packages/google/oauth2/_client.py", line 165, in _token_endpoint_request _handle_error_response(response_data) File "/workspace/compute/oslogin/.nox/py-3-10/lib/python3.10/site-packages/google/oauth2/_client.py", line 60, in _handle_error_response raise exceptions.RefreshError(error_details, response_data) google.auth.exceptions.RefreshError: ('invalid_grant: Invalid grant: account not found', {'error': 'invalid_grant', 'error_description': 'Invalid grant: account not found'})

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/workspace/compute/oslogin/service_account_ssh_test.py", line 99, in test_main raise Exception('SSH to the test instance failed.') Exception: SSH to the test instance failed.

Jan 07 '22 13:01 flaky-bot[bot]

Hi @m-strzelczyk - I need some help debugging this. Please reach out if you need any help - it may have to do with the default network being recreated. I'll ping you with a way to request more permissions if needed

Jan 11 '22 17:01 leahecole

Seems like the Jenkins account is missing the roles/iam.serviceAccountKeyAdmin and roles/iam.serviceAccountUser roles in the Python 3.10 project. Let's discuss this in DMs.

Jan 12 '22 14:01 m-strzelczyk

I have made pull request, to play around with the test a bit (#7370 ), but it turns out it works quite fine there...

I have noticed that the error we got ({'error': 'invalid_grant', 'error_description': 'Invalid grant: account not found'}) is rather generic and can happen for a lot of different reasons.

I'm starting to think there's not much I could do here, as the test seems to work and the reason it failed has just went away :thinking:

Jan 14 '22 13:01 m-strzelczyk

Oops! Looks like this issue is still flaky. It failed again. :grimacing:

I reopened the issue, but a human will need to close it again.

commit: e7379a8b33ab29b354292d370c3655f481bf3be5 buildURL: Build Status, Sponge status: failed

Test output

Traceback (most recent call last):
  File "/workspace/compute/oslogin/service_account_ssh_test.py", line 62, in test_main
    service_account_key = setup_resources(
  File "/workspace/compute/oslogin/service_account_ssh_test.py", line 211, in setup_resources
    compute.instances().setIamPolicy(
  File "/workspace/compute/oslogin/.nox/py-3-9/lib/python3.9/site-packages/googleapiclient/_helpers.py", line 131, in positional_wrapper
    return wrapped(*args, **kwargs)
  File "/workspace/compute/oslogin/.nox/py-3-9/lib/python3.9/site-packages/googleapiclient/http.py", line 937, in execute
    raise HttpError(resp, content, uri=self.uri)
googleapiclient.errors.HttpError: 
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/workspace/compute/oslogin/service_account_ssh_test.py", line 68, in test_main
raise Exception('Could not set up the necessary test resources.')
Exception: Could not set up the necessary test resources.

Apr 17 '22 12:04 flaky-bot[bot]

The failure from flaky was due to missing service account but the issue no longer seems to be happening. Closing this issue.

Jun 19 '22 07:06 dandhlee

Oops! Looks like this issue is still flaky. It failed again. :grimacing:

I reopened the issue, but a human will need to close it again.

commit: de38ec12d7be018b26def99a22fcb758f818deb8 buildURL: Build Status, Sponge status: failed

Test output

Traceback (most recent call last): File "/workspace/compute/oslogin/service_account_ssh_test.py", line 97, in test_main ssh_login() File "/workspace/compute/oslogin/.nox/py-3-9/lib/python3.9/site-packages/retrying.py", line 49, in wrapped_f return Retrying(*dargs, **dkw).call(f, *args, **kw) File "/workspace/compute/oslogin/.nox/py-3-9/lib/python3.9/site-packages/retrying.py", line 212, in call raise attempt.get() File "/workspace/compute/oslogin/.nox/py-3-9/lib/python3.9/site-packages/retrying.py", line 247, in get six.reraise(self.value[0], self.value[1], self.value[2]) File "/workspace/compute/oslogin/.nox/py-3-9/lib/python3.9/site-packages/six.py", line 719, in reraise raise value File "/workspace/compute/oslogin/.nox/py-3-9/lib/python3.9/site-packages/retrying.py", line 200, in call attempt = Attempt(fn(*args, **kwargs), attempt_number, False) File "/workspace/compute/oslogin/service_account_ssh_test.py", line 90, in ssh_login main(cmd, project, test_id, zone, oslogin, account, hostname) File "/workspace/compute/oslogin/service_account_ssh.py", line 116, in main private_key_file = create_ssh_key(oslogin, account) File "/workspace/compute/oslogin/service_account_ssh.py", line 79, in create_ssh_key oslogin.users().importSshPublicKey(parent=account, body=body).execute() File "/workspace/compute/oslogin/.nox/py-3-9/lib/python3.9/site-packages/googleapiclient/_helpers.py", line 131, in positional_wrapper return wrapped(*args, **kwargs) File "/workspace/compute/oslogin/.nox/py-3-9/lib/python3.9/site-packages/googleapiclient/http.py", line 922, in execute resp, content = _retry_request( File "/workspace/compute/oslogin/.nox/py-3-9/lib/python3.9/site-packages/googleapiclient/http.py", line 190, in _retry_request resp, content = http.request(uri, method, *args, **kwargs) File "/workspace/compute/oslogin/.nox/py-3-9/lib/python3.9/site-packages/google_auth_httplib2.py", line 245, in request self.credentials.refresh(self._request) File "/workspace/compute/oslogin/.nox/py-3-9/lib/python3.9/site-packages/google/oauth2/service_account.py", line 410, in refresh access_token, expiry, _ = _client.jwt_grant( File "/workspace/compute/oslogin/.nox/py-3-9/lib/python3.9/site-packages/google/oauth2/_client.py", line 193, in jwt_grant response_data = _token_endpoint_request(request, token_uri, body) File "/workspace/compute/oslogin/.nox/py-3-9/lib/python3.9/site-packages/google/oauth2/_client.py", line 165, in _token_endpoint_request _handle_error_response(response_data) File "/workspace/compute/oslogin/.nox/py-3-9/lib/python3.9/site-packages/google/oauth2/_client.py", line 60, in _handle_error_response raise exceptions.RefreshError(error_details, response_data) google.auth.exceptions.RefreshError: ('invalid_grant: Invalid grant: account not found', {'error': 'invalid_grant', 'error_description': 'Invalid grant: account not found'})

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/workspace/compute/oslogin/service_account_ssh_test.py", line 99, in test_main raise Exception('SSH to the test instance failed.') Exception: SSH to the test instance failed.

Jun 19 '22 12:06 flaky-bot[bot]

Oops! Looks like this issue is still flaky. It failed again. :grimacing:

I reopened the issue, but a human will need to close it again.

commit: 884d81daed20974f5d42d2ab3e3ac83af515bcef buildURL: Build Status, Sponge status: failed

Test output

Traceback (most recent call last): File "/workspace/compute/oslogin/service_account_ssh_test.py", line 97, in test_main ssh_login() File "/workspace/compute/oslogin/.nox/py-3-9/lib/python3.9/site-packages/retrying.py", line 49, in wrapped_f return Retrying(*dargs, **dkw).call(f, *args, **kw) File "/workspace/compute/oslogin/.nox/py-3-9/lib/python3.9/site-packages/retrying.py", line 212, in call raise attempt.get() File "/workspace/compute/oslogin/.nox/py-3-9/lib/python3.9/site-packages/retrying.py", line 247, in get six.reraise(self.value[0], self.value[1], self.value[2]) File "/workspace/compute/oslogin/.nox/py-3-9/lib/python3.9/site-packages/six.py", line 719, in reraise raise value File "/workspace/compute/oslogin/.nox/py-3-9/lib/python3.9/site-packages/retrying.py", line 200, in call attempt = Attempt(fn(*args, **kwargs), attempt_number, False) File "/workspace/compute/oslogin/service_account_ssh_test.py", line 90, in ssh_login main(cmd, project, test_id, zone, oslogin, account, hostname) File "/workspace/compute/oslogin/service_account_ssh.py", line 131, in main profile = oslogin.users().getLoginProfile(name=account).execute() File "/workspace/compute/oslogin/.nox/py-3-9/lib/python3.9/site-packages/googleapiclient/_helpers.py", line 131, in positional_wrapper return wrapped(*args, **kwargs) File "/workspace/compute/oslogin/.nox/py-3-9/lib/python3.9/site-packages/googleapiclient/http.py", line 922, in execute resp, content = _retry_request( File "/workspace/compute/oslogin/.nox/py-3-9/lib/python3.9/site-packages/googleapiclient/http.py", line 190, in _retry_request resp, content = http.request(uri, method, *args, **kwargs) File "/workspace/compute/oslogin/.nox/py-3-9/lib/python3.9/site-packages/google_auth_httplib2.py", line 245, in request self.credentials.refresh(self._request) File "/workspace/compute/oslogin/.nox/py-3-9/lib/python3.9/site-packages/google/oauth2/service_account.py", line 410, in refresh access_token, expiry, _ = _client.jwt_grant( File "/workspace/compute/oslogin/.nox/py-3-9/lib/python3.9/site-packages/google/oauth2/_client.py", line 193, in jwt_grant response_data = _token_endpoint_request(request, token_uri, body) File "/workspace/compute/oslogin/.nox/py-3-9/lib/python3.9/site-packages/google/oauth2/_client.py", line 165, in _token_endpoint_request _handle_error_response(response_data) File "/workspace/compute/oslogin/.nox/py-3-9/lib/python3.9/site-packages/google/oauth2/_client.py", line 60, in _handle_error_response raise exceptions.RefreshError(error_details, response_data) google.auth.exceptions.RefreshError: ('invalid_grant: Invalid grant: account not found', {'error': 'invalid_grant', 'error_description': 'Invalid grant: account not found'})

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/workspace/compute/oslogin/service_account_ssh_test.py", line 99, in test_main raise Exception('SSH to the test instance failed.') Exception: SSH to the test instance failed.

Jul 23 '22 12:07 flaky-bot[bot]

Oops! Looks like this issue is still flaky. It failed again. :grimacing:

I reopened the issue, but a human will need to close it again.

commit: b868f401554107d00df9f8eaa3a8e7af27509ff4 buildURL: Build Status, Sponge status: failed

Test output

Traceback (most recent call last):
  File "/workspace/compute/oslogin/service_account_ssh_test.py", line 62, in test_main
    service_account_key = setup_resources(
  File "/workspace/compute/oslogin/service_account_ssh_test.py", line 198, in setup_resources
    operation = compute.instances().insert(
  File "/workspace/compute/oslogin/.nox/py-3-9/lib/python3.9/site-packages/googleapiclient/_helpers.py", line 131, in positional_wrapper
    return wrapped(*args, **kwargs)
  File "/workspace/compute/oslogin/.nox/py-3-9/lib/python3.9/site-packages/googleapiclient/http.py", line 937, in execute
    raise HttpError(resp, content, uri=self.uri)
googleapiclient.errors.HttpError: 
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/workspace/compute/oslogin/service_account_ssh_test.py", line 68, in test_main
raise Exception('Could not set up the necessary test resources.')
Exception: Could not set up the necessary test resources.

Aug 04 '22 12:08 flaky-bot[bot]

Oops! Looks like this issue is still flaky. It failed again. :grimacing:

I reopened the issue, but a human will need to close it again.

commit: 1cd2422551b2ab7937a83cbc9928f7c403f3aa41 buildURL: Build Status, Sponge status: failed

Test output

Traceback (most recent call last): File "/workspace/compute/oslogin/service_account_ssh_test.py", line 97, in test_main ssh_login() File "/workspace/compute/oslogin/.nox/py-3-8/lib/python3.8/site-packages/retrying.py", line 49, in wrapped_f return Retrying(*dargs, **dkw).call(f, *args, **kw) File "/workspace/compute/oslogin/.nox/py-3-8/lib/python3.8/site-packages/retrying.py", line 212, in call raise attempt.get() File "/workspace/compute/oslogin/.nox/py-3-8/lib/python3.8/site-packages/retrying.py", line 247, in get six.reraise(self.value[0], self.value[1], self.value[2]) File "/workspace/compute/oslogin/.nox/py-3-8/lib/python3.8/site-packages/six.py", line 719, in reraise raise value File "/workspace/compute/oslogin/.nox/py-3-8/lib/python3.8/site-packages/retrying.py", line 200, in call attempt = Attempt(fn(*args, **kwargs), attempt_number, False) File "/workspace/compute/oslogin/service_account_ssh_test.py", line 93, in ssh_login assert assert_value in out AssertionError: assert 'Linux oslogin-test-525107' in "Creating key users/oslogin-test-525107@python-docs-samples-tests.iam.gserviceaccount.com and {'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCaw2VfkFEi5lx/dV123SeFcLpTosbkFqFY+UOTCGi0qf+VOqP6b7QnmTmS+LQzDUsfpliShu3K6f+deifnRK1vEhS5m9h0rKwdjpWupRGQWjIelmen4GOQ8EKIXKdgOrNAcdzLHllfIvOi21lKennhdqirdTYgg5pOfdnyP5FcWPnVYbjuntgvBs6TTWs4FL+qRhAZNvaZjUecJ5d387aBUAJFAeHLmTP9rfakYRP3w0aJ93BvqdQ0SGz9vPbH0TePd8e7LmU696O5/4VkqEf9Jrs0CpRzDYhQSuhhsNab2zYdLPqAVk4fOFvlWaCP7KjuRRYs5aA7Fpn/Oh7e2kX7Q58NGdxhZyb3AZxMlryLI6vYxGgl2R6y60ZrqbZl10gTo+ir79RTczi2mBrWGmA/yS2NhFCNHcvwTUurT9MoRdyt6nhjsKDdEHACfmpiLPoOUokeWjhcJmZSDZtiBb1K5oFpWiuR/a1y8K6rQf+ldlec7NJ8GS67P9a9QEZmw80= kbuilder@kokoro-gcp-ubuntu-prod-750669605', 'expirationTimeUsec': 1660131791927780}\nssh: connect to host 34.138.210.107 port 22: Connection timed out\n"

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/workspace/compute/oslogin/service_account_ssh_test.py", line 99, in test_main raise Exception('SSH to the test instance failed.') Exception: SSH to the test instance failed.

Aug 10 '22 11:08 flaky-bot[bot]

Oops! Looks like this issue is still flaky. It failed again. :grimacing:

I reopened the issue, but a human will need to close it again.

commit: 54c72b8862dcd811c7f1e3c108c4c2b6b50590cd buildURL: Build Status, Sponge status: failed

Test output

Traceback (most recent call last): File "/workspace/compute/oslogin/service_account_ssh_test.py", line 97, in test_main ssh_login() File "/workspace/compute/oslogin/.nox/py-3-7/lib/python3.7/site-packages/retrying.py", line 49, in wrapped_f return Retrying(*dargs, **dkw).call(f, *args, **kw) File "/workspace/compute/oslogin/.nox/py-3-7/lib/python3.7/site-packages/retrying.py", line 212, in call raise attempt.get() File "/workspace/compute/oslogin/.nox/py-3-7/lib/python3.7/site-packages/retrying.py", line 247, in get six.reraise(self.value[0], self.value[1], self.value[2]) File "/workspace/compute/oslogin/.nox/py-3-7/lib/python3.7/site-packages/six.py", line 719, in reraise raise value File "/workspace/compute/oslogin/.nox/py-3-7/lib/python3.7/site-packages/retrying.py", line 200, in call attempt = Attempt(fn(*args, **kwargs), attempt_number, False) File "/workspace/compute/oslogin/service_account_ssh_test.py", line 93, in ssh_login assert assert_value in out AssertionError: assert 'Linux oslogin-test-115031' in "Creating key users/oslogin-test-115031@python-docs-samples-tests.iam.gserviceaccount.com and {'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDbJRHSGBlt3CRWbQy97a/HFURfT8nKOlr+xrQccJR2ULgCaTN5eUPXXFEAxlWI1HC6EP9m02hUrmjpanHINbhsWcxPKscsDjpt4bdBk44mkTVBEST6jx3OIpjIMRHweVqA59WIjLkrYfSQkVJdE/5YDljrYAtv3FLVJzBZwiQtvEr6y9zIgxrOu2q80+dcxyzhMtqtbJKtlfta6lZbJIrUcb3MUtoGoVSyanaQ0dZaUTepNrm9TlGEoxLbT8L0xPampher1A47V2D2rMFj1DVCsXytyXPUlCMBH9vPgSCSbrVwAo8p47kiSTsw79nE0GjTYERWayZMY3mKtb4sr64IZ5W5FuwpD4BNvlB0X9QyvnU0/A0XedssSiz+T1P/nafeF2D4Sp+gEa0Ck/XBfWgxi1Z8UdSdussJJ0RHkCqNrGsgEzrrBHJbgQVJeSHa/oH352TeTmx1fJYKVw0AG5QHQsLSMM6WgJzZTP3msjUM+GYtR+m69ZdBN29tbElTl3k= kbuilder@kokoro-gcp-ubuntu-prod-431126807', 'expirationTimeUsec': 1660246238189151}\nssh: connect to host 34.148.5.215 port 22: Connection timed out\n"

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/workspace/compute/oslogin/service_account_ssh_test.py", line 99, in test_main raise Exception('SSH to the test instance failed.') Exception: SSH to the test instance failed.

Aug 11 '22 19:08 flaky-bot[bot]

Oops! Looks like this issue is still flaky. It failed again. :grimacing:

I reopened the issue, but a human will need to close it again.

commit: 476270001a9b68f4446e6b3c07ed33566a7396bd buildURL: Build Status, Sponge status: failed

Test output

Traceback (most recent call last):
  File "/workspace/compute/oslogin/service_account_ssh_test.py", line 66, in test_main
    machine_type, account_email)
  File "/workspace/compute/oslogin/service_account_ssh_test.py", line 225, in setup_resources
    'role': 'roles/compute.osLogin'
  File "/workspace/compute/oslogin/.nox/py-3-7/lib/python3.7/site-packages/googleapiclient/_helpers.py", line 131, in positional_wrapper
    return wrapped(*args, **kwargs)
  File "/workspace/compute/oslogin/.nox/py-3-7/lib/python3.7/site-packages/googleapiclient/http.py", line 937, in execute
    raise HttpError(resp, content, uri=self.uri)
googleapiclient.errors.HttpError: 
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/workspace/compute/oslogin/service_account_ssh_test.py", line 70, in test_main
raise Exception('Could not set up the necessary test resources.')
Exception: Could not set up the necessary test resources.

Aug 30 '22 10:08 flaky-bot[bot]

Fwiw this test is also leaving leftovers - I just cleaned a bunch up in the test project because we had VM leftovers giving us quota issues

Sep 27 '22 17:09 leahecole

Hi @leahecole, do you happen to have any more details on which resources are left over?

cleanup_resources() looks like it deletes several types of resources. It's possible that these leftovers are caused when an exception is thrown, or the cleanup code is missing resource types.

Oct 12 '22 14:10 kweinmeister

compute.oslogin.service_account_ssh_test: test_main failed