nodejs-bigtable icon indicating copy to clipboard operation
nodejs-bigtable copied to clipboard

deletes: "before all" hook for "should delete column from a row" failed

Open flaky-bot[bot] opened this issue 3 years ago • 5 comments

This test failed!

To configure my behavior, see the Flaky Bot documentation.

If I'm commenting on this issue too often, add the flakybot: quiet label and I will stop commenting.


commit: 75c1a301cd3ec91c7b251b384307687d081525b9 buildURL: Build Status, Sponge status: failed

Test output
8 RESOURCE_EXHAUSTED: Quota exceeded for quota metric 'Instance and cluster write requests' and limit 'Instance and cluster write requests per day' of service 'bigtableadmin.googleapis.com' for consumer 'project_number:1046198160504'.
Error: 8 RESOURCE_EXHAUSTED: Quota exceeded for quota metric 'Instance and cluster write requests' and limit 'Instance and cluster write requests per day' of service 'bigtableadmin.googleapis.com' for consumer 'project_number:1046198160504'.
    at Object.callErrorFromStatus (/workspace/node_modules/@grpc/grpc-js/build/src/call.js:31:26)
        -> /workspace/node_modules/@grpc/grpc-js/src/call.ts:81:24
    at Object.onReceiveStatus (/workspace/node_modules/@grpc/grpc-js/build/src/client.js:189:52)
        -> /workspace/node_modules/@grpc/grpc-js/src/client.ts:351:36
    at Object.onReceiveStatus (/workspace/node_modules/@grpc/grpc-js/build/src/client-interceptors.js:365:141)
        -> /workspace/node_modules/@grpc/grpc-js/src/client-interceptors.ts:462:34
    at Object.onReceiveStatus (/workspace/node_modules/@grpc/grpc-js/build/src/client-interceptors.js:328:181)
        -> /workspace/node_modules/@grpc/grpc-js/src/client-interceptors.ts:424:48
    at /workspace/node_modules/@grpc/grpc-js/build/src/call-stream.js:187:78
        -> /workspace/node_modules/@grpc/grpc-js/src/call-stream.ts:330:24
    at processTicksAndRejections (internal/process/task_queues.js:79:11)

flaky-bot[bot] avatar Jun 20 '22 22:06 flaky-bot[bot]

commit: b997a6b7be9f58a2d2d4884527260a643ae84252 buildURL: Build Status, Sponge status: failed

Test output
8 RESOURCE_EXHAUSTED: Quota exceeded for quota metric 'Instance and cluster metadata write requests' and limit 'Instance and cluster metadata write requests per day' of service 'bigtableadmin.googleapis.com' for consumer 'project_number:1046198160504'.
Error: 8 RESOURCE_EXHAUSTED: Quota exceeded for quota metric 'Instance and cluster metadata write requests' and limit 'Instance and cluster metadata write requests per day' of service 'bigtableadmin.googleapis.com' for consumer 'project_number:1046198160504'.
    at Object.callErrorFromStatus (/workspace/node_modules/@grpc/grpc-js/build/src/call.js:31:26)
        -> /workspace/node_modules/@grpc/grpc-js/src/call.ts:81:24
    at Object.onReceiveStatus (/workspace/node_modules/@grpc/grpc-js/build/src/client.js:189:52)
        -> /workspace/node_modules/@grpc/grpc-js/src/client.ts:351:36
    at Object.onReceiveStatus (/workspace/node_modules/@grpc/grpc-js/build/src/client-interceptors.js:365:141)
        -> /workspace/node_modules/@grpc/grpc-js/src/client-interceptors.ts:462:34
    at Object.onReceiveStatus (/workspace/node_modules/@grpc/grpc-js/build/src/client-interceptors.js:328:181)
        -> /workspace/node_modules/@grpc/grpc-js/src/client-interceptors.ts:424:48
    at /workspace/node_modules/@grpc/grpc-js/build/src/call-stream.js:187:78
        -> /workspace/node_modules/@grpc/grpc-js/src/call-stream.ts:330:24
    at processTicksAndRejections (internal/process/task_queues.js:79:11)

flaky-bot[bot] avatar Jun 22 '22 19:06 flaky-bot[bot]

commit: ecae5f3bc00210c44513a40895a3c128938383bf buildURL: Build Status, Sponge status: failed

Test output
Timeout of 60000ms exceeded. For async tests and hooks, ensure "done()" is called; if returning a Promise, ensure it resolves. (/workspace/samples/test/deletes.js)
Error: Timeout of 60000ms exceeded. For async tests and hooks, ensure "done()" is called; if returning a Promise, ensure it resolves. (/workspace/samples/test/deletes.js)
    at listOnTimeout (internal/timers.js:554:17)
    at processTimers (internal/timers.js:497:7)

flaky-bot[bot] avatar Jul 04 '22 19:07 flaky-bot[bot]

Quota exceeded and timeout. Closing and grouping under https://github.com/googleapis/nodejs-bigtable/issues/1134.

danieljbruce avatar Aug 12 '22 20:08 danieljbruce

Looks like this issue is flaky. :worried:

I'm going to leave this open and stop commenting.

A human should fix and close this.


commit: c88801a8cd872a6bb837e8880f8e7294b6255fb7 buildURL: Build Status, Sponge status: failed

Test output
Timeout of 60000ms exceeded. For async tests and hooks, ensure "done()" is called; if returning a Promise, ensure it resolves. (/workspace/samples/test/deletes.js)
Error: Timeout of 60000ms exceeded. For async tests and hooks, ensure "done()" is called; if returning a Promise, ensure it resolves. (/workspace/samples/test/deletes.js)
    at listOnTimeout (internal/timers.js:554:17)
    at processTimers (internal/timers.js:497:7)

flaky-bot[bot] avatar Aug 19 '22 07:08 flaky-bot[bot]

Dropping priority due to related issue identified, but flaky-bot will keep reopening until it's no longer flaky.

meredithslota avatar Aug 24 '22 16:08 meredithslota

https://github.com/googleapis/nodejs-bigtable/pull/1143/files at least solved the direct issue in question due to the short timeout. If the timeout still is not long enough then we will see a new flakybot message.

danieljbruce avatar Feb 09 '23 21:02 danieljbruce

Oops! Looks like this issue is still flaky. It failed again. :grimacing:

I reopened the issue, but a human will need to close it again.


commit: 000a353f05fa65bc0a7dc551c777ac55c6c08875 buildURL: Build Status, Sponge status: failed

Test output
Operation successfully rolled back : Insufficient node quota. You requested a node count of 3 nodes for your cluster, but this request would exceed your project's node quota of 200 nodes total across all clusters in this zone. Contact us to request a quota increase: https://cloud.google.com/bigtable/quotas#quota-increase
Error: Operation successfully rolled back : Insufficient node quota. You requested a node count of 3 nodes for your cluster, but this request would exceed your project's node quota of 200 nodes total across all clusters in this zone. Contact us to request a quota increase: https://cloud.google.com/bigtable/quotas#quota-increase
    at Operation._unpackResponse (/workspace/node_modules/google-gax/build/src/longRunningCalls/longrunning.js:142:31)
        -> /workspace/node_modules/google-gax/src/longRunningCalls/longrunning.ts:220:23
    at /workspace/node_modules/google-gax/build/src/longRunningCalls/longrunning.js:122:18
        -> /workspace/node_modules/google-gax/src/longRunningCalls/longrunning.ts:195:14

flaky-bot[bot] avatar Feb 14 '23 08:02 flaky-bot[bot]

See internal regarding the fix for the insufficient node quota

danieljbruce avatar Mar 06 '23 22:03 danieljbruce

Oops! Looks like this issue is still flaky. It failed again. :grimacing:

I reopened the issue, but a human will need to close it again.


commit: 44fab5cdbb6289f08be17c55f5d7402f89b5d46f buildURL: Build Status, Sponge status: failed

Test output
Operation successfully rolled back : Insufficient node quota. You requested a node count of 3 nodes for your cluster, but this request would exceed your project's node quota of 200 nodes total across all clusters in this zone. Contact us to request a quota increase: https://cloud.google.com/bigtable/quotas#quota-increase
Error: Operation successfully rolled back : Insufficient node quota. You requested a node count of 3 nodes for your cluster, but this request would exceed your project's node quota of 200 nodes total across all clusters in this zone. Contact us to request a quota increase: https://cloud.google.com/bigtable/quotas#quota-increase
    at Operation._unpackResponse (/workspace/node_modules/google-gax/build/src/longRunningCalls/longrunning.js:142:31)
        -> /workspace/node_modules/google-gax/src/longRunningCalls/longrunning.ts:220:23
    at /workspace/node_modules/google-gax/build/src/longRunningCalls/longrunning.js:122:18
        -> /workspace/node_modules/google-gax/src/longRunningCalls/longrunning.ts:195:14

flaky-bot[bot] avatar Mar 15 '23 07:03 flaky-bot[bot]

https://github.com/googleapis/nodejs-bigtable/pull/1265 is a fix that will make the insufficient node quota issue go away and this is the only type of error we see recently so this can be closed.

danieljbruce avatar May 01 '23 18:05 danieljbruce