sentry-cli icon indicating copy to clipboard operation
sentry-cli copied to clipboard

Dsym upload not working anymore

Open PhilippSaminger opened this issue 1 year ago • 11 comments

CLI Version

2.32.1

Operating System and Architecture

  • [ ] macOS (arm64)
  • [X] macOS (x86_64)
  • [ ] Linux (i686)
  • [ ] Linux (x86_64)
  • [ ] Linux (armv7)
  • [ ] Linux (aarch64)
  • [ ] Windows (i686)
  • [ ] Windows (x86_64)

Operating System Version

Sonoma 14.2.1

Link to reproduction repository

No response

CLI Command

sentry_upload_dsym --log-level=debug

Exact Reproduction Steps

  1. Build and test target
  2. Archive and create ipa files
  3. Upload dsym to sentry

Note: It has always been like this and worked, since the 25.4.2024 it does not work anymore.

Expected Results

Dsym upload works correctly like it always has been.

Actual Results

Error shown (API request failed)

Logs

14:15:54: [32m--- Step: sentry_upload_dsym ---[0m 14:15:54: [32m--------------------------------[0m 14:15:54: [34m[1mThis action is deprecated. Please use the sentry_debug_files_upload action.[0m 14:15:54: [32mUsing sentry-cli 2.31.0[0m 14:15:54: Starting sentry-cli... 14:15:54: DEBUG 2024-04-29 14:15:54.659788 +02:00 sentry-cli version: 2.31.0, platform: "darwin", architecture: "x86_64" 14:15:54: INFO 2024-04-29 14:15:54.661544 +02:00 Issuing a command for Organization: test Project: test [14:16:11]: DEBUG 2024-04-29 14:16:11.397593 +02:00 request GET https://sentry.io/api/0/organizations/test/chunk-upload/ [14:16:11]: DEBUG 2024-04-29 14:16:11.397632 +02:00 using token authentication [14:16:11]: DEBUG 2024-04-29 14:16:11.397910 +02:00 retry number 0, max retries: 0 [14:16:11]: DEBUG 2024-04-29 14:16:11.409485 +02:00 > CONNECT sentry.io:443 HTTP/1.1 [14:16:11]: DEBUG 2024-04-29 14:16:11.409505 +02:00 > Host: sentry.io:443 [14:16:11]: DEBUG 2024-04-29 14:16:11.409509 +02:00 > Proxy-Connection: Keep-Alive [14:16:11]: DEBUG 2024-04-29 14:16:11.439380 +02:00 < HTTP/1.0 200 Connection Established [14:16:11]: DEBUG 2024-04-29 14:16:11.439441 +02:00 < Proxy-agent: Apache [14:16:11]: DEBUG 2024-04-29 14:16:11.468932 +02:00 > GET /api/0/organizations/test/chunk-upload/ HTTP/1.1 [14:16:11]: DEBUG 2024-04-29 14:16:11.468956 +02:00 > Host: sentry.io [14:16:11]: DEBUG 2024-04-29 14:16:11.468962 +02:00 > Accept: / [14:16:11]: DEBUG 2024-04-29 14:16:11.468969 +02:00 > Connection: TE [14:16:11]: DEBUG 2024-04-29 14:16:11.468974 +02:00 > TE: gzip [14:16:11]: DEBUG 2024-04-29 14:16:11.469001 +02:00 > User-Agent: sentry-cli/2.31.0 [14:16:11]: DEBUG 2024-04-29 14:16:11.469793 +02:00 > Authorization: Bearer sntrys_e*** [14:16:11]: DEBUG 2024-04-29 14:16:11.715339 +02:00 < HTTP/1.1 200 OK [14:16:11]: DEBUG 2024-04-29 14:16:11.715363 +02:00 < server: nginx [14:16:11]: DEBUG 2024-04-29 14:16:11.715373 +02:00 < date: Mon, 29 Apr 2024 12:16:11 GMT [14:16:11]: DEBUG 2024-04-29 14:16:11.715382 +02:00 < content-type: application/json [14:16:11]: DEBUG 2024-04-29 14:16:11.715386 +02:00 < vary: Accept-Encoding,Accept-Language, Cookie [14:16:11]: DEBUG 2024-04-29 14:16:11.715390 +02:00 < allow: GET, POST, HEAD, OPTIONS [14:16:11]: DEBUG 2024-04-29 14:16:11.715395 +02:00 < access-control-allow-methods: GET, POST, HEAD, OPTIONS [14:16:11]: DEBUG 2024-04-29 14:16:11.715407 +02:00 < access-control-allow-headers: X-Sentry-Auth, X-Requested-With, Origin, Accept, Content-Type, Authentication, Authorization, Content-Encoding, sentry-trace, baggage, X-CSRFToken [14:16:11]: DEBUG 2024-04-29 14:16:11.715414 +02:00 < access-control-expose-headers: X-Sentry-Error, X-Sentry-Direct-Hit, X-Hits, X-Max-Hits, Endpoint, Retry-After, Link [14:16:11]: DEBUG 2024-04-29 14:16:11.715421 +02:00 < access-control-allow-origin: * [14:16:11]: DEBUG 2024-04-29 14:16:11.715425 +02:00 < x-sentry-rate-limit-remaining: 39 [14:16:11]: DEBUG 2024-04-29 14:16:11.715429 +02:00 < x-sentry-rate-limit-limit: 40 [14:16:11]: DEBUG 2024-04-29 14:16:11.715434 +02:00 < x-sentry-rate-limit-reset: 1714392972 [14:16:11]: DEBUG 2024-04-29 14:16:11.715439 +02:00 < x-sentry-rate-limit-concurrentremaining: 24 [14:16:11]: DEBUG 2024-04-29 14:16:11.715443 +02:00 < x-sentry-rate-limit-concurrentlimit: 25 [14:16:11]: DEBUG 2024-04-29 14:16:11.715447 +02:00 < content-language: en [14:16:11]: DEBUG 2024-04-29 14:16:11.715451 +02:00 < x-frame-options: deny [14:16:11]: DEBUG 2024-04-29 14:16:11.715455 +02:00 < x-content-type-options: nosniff [14:16:11]: DEBUG 2024-04-29 14:16:11.715459 +02:00 < x-xss-protection: 1; mode=block [14:16:11]: DEBUG 2024-04-29 14:16:11.715472 +02:00 < x-envoy-attempt-count: 1 [14:16:11]: DEBUG 2024-04-29 14:16:11.715476 +02:00 < x-envoy-upstream-service-time: 118 [14:16:11]: DEBUG 2024-04-29 14:16:11.715484 +02:00 < x-sentry-proxy-url: http://10.2.0.67:8999/api/0/organizations/test/chunk-upload/ [14:16:11]: DEBUG 2024-04-29 14:16:11.715488 +02:00 < x-served-by: getsentry-control-web-default-common-production-fddc5dbcc-p4cpb [14:16:11]: DEBUG 2024-04-29 14:16:11.715492 +02:00 < x-served-by: frontend-default-7f6997465c-mz8kc [14:16:11]: DEBUG 2024-04-29 14:16:11.715495 +02:00 < strict-transport-security: max-age=31536000; includeSubDomains; preload [14:16:11]: DEBUG 2024-04-29 14:16:11.715499 +02:00 < via: 1.1 google [14:16:11]: DEBUG 2024-04-29 14:16:11.715503 +02:00 < Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000 [14:16:11]: DEBUG 2024-04-29 14:16:11.715511 +02:00 < Transfer-Encoding: chunked [14:16:11]: DEBUG 2024-04-29 14:16:11.718518 +02:00 response status: 200 [14:16:11]: DEBUG 2024-04-29 14:16:11.718537 +02:00 body: {"url":"https://us.sentry.io/api/0/organizations/test/chunk-upload/","chunkSize":8388608,"chunksPerRequest":64,"maxFileSize":2147483648,"maxRequestSize":33554432,"concurrency":8,"hashAlgorithm":"sha1","compression":["gzip"],"accept":["debug_files","release_files","pdbs","sources","bcsymbolmaps","il2cpp","portablepdbs","artifact_bundles","artifact_bundles_v2"]} [14:16:14]: > Found 3 debug information files [14:16:17]: > Prepared debug information files for upload [14:16:17]: DEBUG 2024-04-29 14:16:17.488054 +02:00 request POST https://sentry.io/api/0/projects/test/test/files/difs/assemble/ [14:16:17]: DEBUG 2024-04-29 14:16:17.488104 +02:00 using token authentication [14:16:17]: DEBUG 2024-04-29 14:16:17.488900 +02:00 retry number 0, max retries: 5 [14:16:17]: DEBUG 2024-04-29 14:16:17.489085 +02:00 > POST /api/0/projects/test/test/files/difs/assemble/ HTTP/1.1 [14:16:17]: DEBUG 2024-04-29 14:16:17.489099 +02:00 > Host: sentry.io [14:16:17]: DEBUG 2024-04-29 14:16:17.489104 +02:00 > Accept: / [14:16:17]: DEBUG 2024-04-29 14:16:17.489108 +02:00 > Connection: TE [14:16:17]: DEBUG 2024-04-29 14:16:17.489113 +02:00 > TE: gzip [14:16:17]: DEBUG 2024-04-29 14:16:17.489118 +02:00 > User-Agent: sentry-cli/2.31.0 [14:16:17]: DEBUG 2024-04-29 14:16:17.489146 +02:00 > Authorization: Bearer sntrys_e*** [14:16:17]: DEBUG 2024-04-29 14:16:17.489151 +02:00 > Content-Type: application/json [14:16:17]: DEBUG 2024-04-29 14:16:17.489156 +02:00 > Content-Length: 1401 [14:16:17]: DEBUG 2024-04-29 14:16:17.730144 +02:00 < HTTP/1.1 200 OK [14:16:17]: DEBUG 2024-04-29 14:16:17.730172 +02:00 < server: nginx [14:16:17]: DEBUG 2024-04-29 14:16:17.730181 +02:00 < date: Mon, 29 Apr 2024 12:16:17 GMT [14:16:17]: DEBUG 2024-04-29 14:16:17.730189 +02:00 < content-type: application/json [14:16:17]: DEBUG 2024-04-29 14:16:17.730196 +02:00 < vary: Accept-Encoding,Accept-Language, Cookie [14:16:17]: DEBUG 2024-04-29 14:16:17.730212 +02:00 < allow: POST, OPTIONS [14:16:17]: DEBUG 2024-04-29 14:16:17.730218 +02:00 < access-control-allow-methods: POST, OPTIONS [14:16:17]: DEBUG 2024-04-29 14:16:17.730227 +02:00 < access-control-allow-headers: X-Sentry-Auth, X-Requested-With, Origin, Accept, Content-Type, Authentication, Authorization, Content-Encoding, sentry-trace, baggage, X-CSRFToken [14:16:17]: DEBUG 2024-04-29 14:16:17.730237 +02:00 < access-control-expose-headers: X-Sentry-Error, X-Sentry-Direct-Hit, X-Hits, X-Max-Hits, Endpoint, Retry-After, Link [14:16:17]: DEBUG 2024-04-29 14:16:17.730248 +02:00 < access-control-allow-origin: * [14:16:17]: DEBUG 2024-04-29 14:16:17.730255 +02:00 < x-sentry-rate-limit-remaining: 39 [14:16:17]: DEBUG 2024-04-29 14:16:17.730261 +02:00 < x-sentry-rate-limit-limit: 40 [14:16:17]: DEBUG 2024-04-29 14:16:17.730268 +02:00 < x-sentry-rate-limit-reset: 1714392978 [14:16:17]: DEBUG 2024-04-29 14:16:17.730274 +02:00 < x-sentry-rate-limit-concurrentremaining: 24 [14:16:17]: DEBUG 2024-04-29 14:16:17.730280 +02:00 < x-sentry-rate-limit-concurrentlimit: 25 [14:16:17]: DEBUG 2024-04-29 14:16:17.730286 +02:00 < content-language: en [14:16:17]: DEBUG 2024-04-29 14:16:17.730293 +02:00 < x-frame-options: deny [14:16:17]: DEBUG 2024-04-29 14:16:17.730300 +02:00 < x-content-type-options: nosniff [14:16:17]: DEBUG 2024-04-29 14:16:17.730306 +02:00 < x-xss-protection: 1; mode=block [14:16:17]: DEBUG 2024-04-29 14:16:17.730313 +02:00 < content-security-policy: media-src *; connect-src 'self' *.algolia.net *.algolianet.com *.algolia.io sentry.io *.sentry.io s1.sentry-cdn.com o1.ingest.sentry.io api2.amplitude.com app.pendo.io data.pendo.io reload.getsentry.net t687h3m0nh65.statuspage.io sentry.zendesk.com ekr.zdassets.com maps.googleapis.com; font-src * data:; base-uri 'none'; worker-src blob:; frame-src app.pendo.io demo.arcade.software js.stripe.com sentry.io; frame-ancestors 'self' *.sentry.io; default-src 'none'; script-src 'self' 'unsafe-inline' 'report-sample' s1.sentry-cdn.com js.sentry-cdn.com browser.sentry-cdn.com statuspage-production.s3.amazonaws.com static.zdassets.com aui-cdn.atlassian.com connect-cdn.atl-paas.net js.stripe.com 'strict-dynamic' cdn.pendo.io data.pendo.io pendo-io-static.storage.googleapis.com pendo-static-5634074999128064.storage.googleapis.com; style-src * 'unsafe-inline'; object-src 'none'; img-src * blob: data:; report-uri https://o1.ingest.sentry.io/api/54785/security/?sentry_key=f724a8a027db45f5b21507e7142ff78e&sentry_release=807967c7d41fc4d8bd4c648c9b3d18466f8cbfb4 [14:16:17]: DEBUG 2024-04-29 14:16:17.730321 +02:00 < x-envoy-attempt-count: 1 [14:16:17]: DEBUG 2024-04-29 14:16:17.730327 +02:00 < x-envoy-upstream-service-time: 116 [14:16:17]: DEBUG 2024-04-29 14:16:17.730333 +02:00 < x-served-by: getsentry-web-rpc-production-7956b7d59d-nl48f [14:16:17]: DEBUG 2024-04-29 14:16:17.730339 +02:00 < x-sentry-proxy-url: http://10.2.0.67:8999/api/0/projects/test/test/files/difs/assemble/ [14:16:17]: DEBUG 2024-04-29 14:16:17.730346 +02:00 < x-served-by: getsentry-control-web-default-common-production-canary-687hvg2q [14:16:17]: DEBUG 2024-04-29 14:16:17.730352 +02:00 < x-served-by: frontend-default-7f6997465c-ftb2w [14:16:17]: DEBUG 2024-04-29 14:16:17.730358 +02:00 < strict-transport-security: max-age=31536000; includeSubDomains; preload [14:16:17]: DEBUG 2024-04-29 14:16:17.730364 +02:00 < via: 1.1 google [14:16:17]: DEBUG 2024-04-29 14:16:17.730371 +02:00 < Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000 [14:16:17]: DEBUG 2024-04-29 14:16:17.730378 +02:00 < Transfer-Encoding: chunked [14:16:17]: DEBUG 2024-04-29 14:16:17.731497 +02:00 response status: 200 [14:16:20]: error: API request failed [14:16:20]: caused by: [56] Failure when receiving data from the peer (Received HTTP code 403 from proxy after CONNECT) [14:16:20]: DEBUG 2024-04-29 14:16:20.559603 +02:00 skipping update nagger because session is not attended +--------------------------------------------+ [!] Error while calling Sentry CLI[0m

PhilippSaminger avatar May 02 '24 05:05 PhilippSaminger

Hi @PhilippSaminger, based on your issue report, I am not exactly sure what the problem is/how to reproduce it. Specifically, I will need you to clarify all of the following before I can help you effectively:

CLI Version

2.32.1

As of now, there is no Sentry CLI version 2.32.1. Do you mean 2.31.1?

CLI Command

sentry_upload_dsym --log-level=debug

This is not a sentry-cli command. A sentry-cli command would look like sentry-cli .... Are you running the sentry-cli directly, or using some other tool which calls the sentry-cli internally?

Exact Reproduction Steps

  1. Build and test target
  2. Archive and create ipa files
  3. Upload dsym to sentry

How are you building and testing your target? How are you archiving and creating ipa files? How are you uploading dsyms to Sentry? As stated in the issue form, I need the exact steps in order to help you. This means exact commands that you are running, and/or exact description of what buttons you are clicking in what tool.


One more question that would help me to resolve your problem: If you downgrade to Sentry CLI version 2.31.0, does this solve your problem? It appears that version 2.31.1 introduces some regressions (see getsentry/sentry-cli#2052 and getsentry/sentry-cli#2053), and I suspect this issue could have the same cause.

szokeasaurusrex avatar May 02 '24 13:05 szokeasaurusrex

@PhilippSaminger before answering my previous questions, could you please check whether your problem has been solved by Sentry CLI version 2.31.2, which we just released? Your issue might have been caused by the bug we fixed in that release

szokeasaurusrex avatar May 02 '24 16:05 szokeasaurusrex

Hello @szokeasaurusrex I will try, but we used 2.21.2 when it was successful and since 25.4 it fails also with this version.

PhilippSaminger avatar May 03 '24 07:05 PhilippSaminger

Hello @szokeasaurusrex I will try, but we used 2.21.2 when it was successful and since 25.4 it fails also with this version.

I do not understand – which version is it failing with since 25.4?

szokeasaurusrex avatar May 03 '24 08:05 szokeasaurusrex

I think this has to be opened in the https://github.com/getsentry/sentry-fastlane-plugin/issues, I got the wrong space from sentry support. So this ticket can be deleted and I will open it there.

PhilippSaminger avatar May 03 '24 08:05 PhilippSaminger

@PhilippSaminger, I can just transfer the issue over to that repository. Please just make sure to add any additional detail specific to the Fastlane plugin

szokeasaurusrex avatar May 03 '24 11:05 szokeasaurusrex

We just released a new version of the Sentry Fastlane plugin 1.22.1 with Sentry CLI 2.31.2. Maybe worth giving this new version a shot.

philipphofmann avatar May 03 '24 12:05 philipphofmann

I tried it with the 1.22.1 version and we still get the 403 error.

PhilippSaminger avatar May 07 '24 08:05 PhilippSaminger

@szokeasaurusrex, as sentry-fastlane-plugin version 1.22.1 with Sentry CLI 2.31.2 doesn't fix this issue, should we move it to the sentry-cli repository as you suggested in https://github.com/getsentry/sentry-cli/issues/2061?

philipphofmann avatar May 07 '24 11:05 philipphofmann

Yeah, you can move it back to the CLI @philipphofmann

szokeasaurusrex avatar May 07 '24 11:05 szokeasaurusrex

@PhilippSaminger are you using some kind of proxy during your upload? Since your logs contain the following line, I suspect your issue might be caused by some proxy misconfiguration on your end.

[14:16:20]: caused by: [56] Failure when receiving data from the peer (Received HTTP code 403 from proxy after CONNECT)

szokeasaurusrex avatar May 07 '24 11:05 szokeasaurusrex

Could be solved internally.

PhilippSaminger avatar May 21 '24 13:05 PhilippSaminger