Mike Place

Flakiness in Jenkins tiles

3

Hello! First, nice work on this project. It's extremely well-designed and very easy to work with. I'm experiencing a bit of a strange problem. I have a number of tiles...

[main branch] unexplained long hang/pauses in CI runners causing build timeouts

13

We detected what appears to be a hang in the test suite when running `.ci/scripts/test.sh -b "release" -t "apollo-server-express" "8" `: https://apm-ci.elastic.co/blue/organizations/jenkins/apm-agent-nodejs%2Fapm-agent-nodejs-mbp/detail/main/95/pipeline/1406 Relevant log entries: ``` [](https://apm-ci.elastic.co/blue/organizations/jenkins/apm-agent-nodejs%2Fapm-agent-nodejs-mbp/detail/main/95/pipeline/1406#step-4196-log-926)[](https://apm-ci.elastic.co/blue/organizations/jenkins/apm-agent-nodejs%2Fapm-agent-nodejs-mbp/detail/main/95/pipeline/1406#step-4196-log-927)[](https://apm-ci.elastic.co/blue/organizations/jenkins/apm-agent-nodejs%2Fapm-agent-nodejs-mbp/detail/main/95/pipeline/1406#step-4196-log-928)[](https://apm-ci.elastic.co/blue/organizations/jenkins/apm-agent-nodejs%2Fapm-agent-nodejs-mbp/detail/main/95/pipeline/1406#step-4196-log-929)[](https://apm-ci.elastic.co/blue/organizations/jenkins/apm-agent-nodejs%2Fapm-agent-nodejs-mbp/detail/main/95/pipeline/1406#step-4196-log-930)[](https://apm-ci.elastic.co/blue/organizations/jenkins/apm-agent-nodejs%2Fapm-agent-nodejs-mbp/detail/main/95/pipeline/1406#step-4196-log-931)[](https://apm-ci.elastic.co/blue/organizations/jenkins/apm-agent-nodejs%2Fapm-agent-nodejs-mbp/detail/main/95/pipeline/1406#step-4196-log-932)[](https://apm-ci.elastic.co/blue/organizations/jenkins/apm-agent-nodejs%2Fapm-agent-nodejs-mbp/detail/main/95/pipeline/1406#step-4196-log-933)[](https://apm-ci.elastic.co/blue/organizations/jenkins/apm-agent-nodejs%2Fapm-agent-nodejs-mbp/detail/main/95/pipeline/1406#step-4196-log-934)[](https://apm-ci.elastic.co/blue/organizations/jenkins/apm-agent-nodejs%2Fapm-agent-nodejs-mbp/detail/main/95/pipeline/1406#step-4196-log-935)[](https://apm-ci.elastic.co/blue/organizations/jenkins/apm-agent-nodejs%2Fapm-agent-nodejs-mbp/detail/main/95/pipeline/1406#step-4196-log-936)[](https://apm-ci.elastic.co/blue/organizations/jenkins/apm-agent-nodejs%2Fapm-agent-nodejs-mbp/detail/main/95/pipeline/1406#step-4196-log-937)[](https://apm-ci.elastic.co/blue/organizations/jenkins/apm-agent-nodejs%2Fapm-agent-nodejs-mbp/detail/main/95/pipeline/1406#step-4196-log-938)[](https://apm-ci.elastic.co/blue/organizations/jenkins/apm-agent-nodejs%2Fapm-agent-nodejs-mbp/detail/main/95/pipeline/1406#step-4196-log-939)[](https://apm-ci.elastic.co/blue/organizations/jenkins/apm-agent-nodejs%2Fapm-agent-nodejs-mbp/detail/main/95/pipeline/1406#step-4196-log-940)[](https://apm-ci.elastic.co/blue/organizations/jenkins/apm-agent-nodejs%2Fapm-agent-nodejs-mbp/detail/main/95/pipeline/1406#step-4196-log-941)[](https://apm-ci.elastic.co/blue/organizations/jenkins/apm-agent-nodejs%2Fapm-agent-nodejs-mbp/detail/main/95/pipeline/1406#step-4196-log-942)[](https://apm-ci.elastic.co/blue/organizations/jenkins/apm-agent-nodejs%2Fapm-agent-nodejs-mbp/detail/main/95/pipeline/1406#step-4196-log-943)[](https://apm-ci.elastic.co/blue/organizations/jenkins/apm-agent-nodejs%2Fapm-agent-nodejs-mbp/detail/main/95/pipeline/1406#step-4196-log-944)[](https://apm-ci.elastic.co/blue/organizations/jenkins/apm-agent-nodejs%2Fapm-agent-nodejs-mbp/detail/main/95/pipeline/1406#step-4196-log-945)[](https://apm-ci.elastic.co/blue/organizations/jenkins/apm-agent-nodejs%2Fapm-agent-nodejs-mbp/detail/main/95/pipeline/1406#step-4196-log-946)[](https://apm-ci.elastic.co/blue/organizations/jenkins/apm-agent-nodejs%2Fapm-agent-nodejs-mbp/detail/main/95/pipeline/1406#step-4196-log-947)[](https://apm-ci.elastic.co/blue/organizations/jenkins/apm-agent-nodejs%2Fapm-agent-nodejs-mbp/detail/main/95/pipeline/1406#step-4196-log-948)[](https://apm-ci.elastic.co/blue/organizations/jenkins/apm-agent-nodejs%2Fapm-agent-nodejs-mbp/detail/main/95/pipeline/1406#step-4196-log-949)[](https://apm-ci.elastic.co/blue/organizations/jenkins/apm-agent-nodejs%2Fapm-agent-nodejs-mbp/detail/main/95/pipeline/1406#step-4196-log-950)[](https://apm-ci.elastic.co/blue/organizations/jenkins/apm-agent-nodejs%2Fapm-agent-nodejs-mbp/detail/main/95/pipeline/1406#step-4196-log-951)[](https://apm-ci.elastic.co/blue/organizations/jenkins/apm-agent-nodejs%2Fapm-agent-nodejs-mbp/detail/main/95/pipeline/1406#step-4196-log-952)[](https://apm-ci.elastic.co/blue/organizations/jenkins/apm-agent-nodejs%2Fapm-agent-nodejs-mbp/detail/main/95/pipeline/1406#step-4196-log-953)[](https://apm-ci.elastic.co/blue/organizations/jenkins/apm-agent-nodejs%2Fapm-agent-nodejs-mbp/detail/main/95/pipeline/1406#step-4196-log-954)[](https://apm-ci.elastic.co/blue/organizations/jenkins/apm-agent-nodejs%2Fapm-agent-nodejs-mbp/detail/main/95/pipeline/1406#step-4196-log-955)[](https://apm-ci.elastic.co/blue/organizations/jenkins/apm-agent-nodejs%2Fapm-agent-nodejs-mbp/detail/main/95/pipeline/1406#step-4196-log-956)[](https://apm-ci.elastic.co/blue/organizations/jenkins/apm-agent-nodejs%2Fapm-agent-nodejs-mbp/detail/main/95/pipeline/1406#step-4196-log-957)[2022-03-28T07:11:49.510Z] node_tests_1 | --...

## Test method co.elastic.apm.agent.tracemethods.TraceMethodInstrumentationTest.testNotTracedAnnotatedClass ## Test logs Click to expand ``` org.mockito.exceptions.misusing.WrongTypeOfReturnValue: ArrayList cannot be returned by getHostname() getHostname() should return String *** If you're unsure why you're getting above...

## Test method co.elastic.apm.agent.impl.DiscardSpanTest.testDiscardSpanLimitNesting2 ## Test logs Click to expand ``` https://apm-ci.elastic.co/job/apm-agent-java/job/apm-agent-java-mbp/job/main/132/testReport/junit/co.elastic.apm.agent.impl/DiscardSpanTest/Builds___Tests___Build___Test_Windows___testDiscardSpanLimitNesting2/ ``` ## Additional context Detected in main branch: https://apm-ci.elastic.co/job/apm-agent-java/job/apm-agent-java-mbp/job/main/132/

## Test method co.elastic.apm.agent.grpc.latest.testapp.GrpcAppTest ## Test logs ``` [2021-11-09T13:55:12.318Z] [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.22.2:test (default-test) on project apm-grpc-test-latest: There are test failures. [2021-11-09T13:55:12.318Z] [ERROR] [2021-11-09T13:55:12.318Z] [ERROR] Please refer to...

Off-by-one errors in Java APM Integration Tests

2

Over the past year, we have seen an ongoing pattern of cases wherein we see [APM Integration tests](https://github.com/elastic/apm-integration-testing) fail because a single event which we believe to have sent was...

Duplicated smoke tests

19

### Credit Credit goes to @eyalkoren for the discovery of this issue ### Overview It appears that certain tests are duplicated across sets of smoke tests. For example, take the...

gh project view should return status updates

1

### Describe the feature or problem you’d like to solve GitHub Projects [now contain status updates](https://docs.github.com/en/issues/planning-and-tracking-with-projects/learning-about-projects/sharing-project-updates). This information should be accessible by `gh project view`. ### Proposed solution Would allow...

Deprecate E2E suite

1

## Background This software has been [unmaintained for over a year](https://github.com/elastic/ingest-dev/issues/3620). According to [this comment](https://github.com/elastic/ingest-dev/issues/3620), the last remaining user seems to be @gizas via [this workflow](https://github.com/elastic/e2e-testing/blob/main/.github/workflows/k8s-autodiscovery-test.yml). I'd like to first...

Determine fate of remaining Jenkins pipelines

6

This issue concerns the following pipelines: https://beats-ci.elastic.co/job/e2e-tests/job/e2e-testing-mbp/ https://beats-ci.elastic.co/job/e2e-tests/job/e2e-testing-pr-mbp/ We need to come to a decision about the fate of these pipelines in light of the upcoming Jenkins deprecation. The only...