runner
runner copied to clipboard
actions
config.sh HTTP GET request times out
Describe the bug
Running config.sh causes HTTP GET request times out. I looked at older issues like https://github.com/actions/runner/issues/574 but they didn't help.
To Reproduce Follow the official set up steps for self-hosted runners:
-
mkdir actions-runner && cd actions-runner# Download the latest runner package -
curl -o actions-runner-linux-x64-2.304.0.tar.gz -L https://github.com/actions/runner/releases/download/v2.304.0/actions-runner-linux-x64-2.304.0.tar.gz# -
tar xzf ./actions-runner-linux-x64-2.304.0.tar.gz ./config.sh --url https://github.com/my_id/my_repo --token MYTOKEN - See the error: GET request to https://pipelines.actions.githubusercontent.com/v5X4vEZCkZ5D1ZZWItsL94PoWciZTGMLDSsXOOHsSSQbOXRhFC/_apis/connectionData?connectOptions=0&lastChangeId=1302529&lastChangeId64=1302529 timed out after 60 seconds.
Expected behavior Set up should complete without timeout.
Runner Version and Platform
2.304.0
OS of the machine running the runner? Ubuntu 22.04
Runner and Worker's Diagnostic Logs
[2023-06-03 17:12:30Z INFO HostContext] No proxy settings were found based on environmental variables (http_proxy/https_proxy/HTTP_PROXY/HTTPS_PROXY)
[2023-06-03 17:12:30Z INFO HostContext] Well known directory 'Bin': '/home/MYID/actions-runner/bin'
[2023-06-03 17:12:30Z INFO HostContext] Well known directory 'Root': '/home/MYID/actions-runner'
[2023-06-03 17:12:30Z INFO HostContext] Well known config file 'Credentials': '/home/MYID/actions-runner/.credentials'
[2023-06-03 17:12:30Z INFO HostContext] Well known directory 'Bin': '/home/MYID/actions-runner/bin'
[2023-06-03 17:12:30Z INFO HostContext] Well known directory 'Root': '/home/MYID/actions-runner'
[2023-06-03 17:12:30Z INFO HostContext] Well known config file 'Runner': '/home/MYID/actions-runner/.runner'
[2023-06-03 17:12:30Z INFO Listener] Runner is built for Linux (X64) - linux-x64.
[2023-06-03 17:12:30Z INFO Listener] RuntimeInformation: Linux 5.19.0-35-generic #36~22.04.1-Ubuntu SMP PREEMPT_DYNAMIC Fri Feb 17 15:17:25 UTC 2.
[2023-06-03 17:12:30Z INFO Listener] Version: 2.304.0
[2023-06-03 17:12:30Z INFO Listener] Commit: 9ef4121b5b31ee5c03b7770288213d741081f747
[2023-06-03 17:12:30Z INFO Listener] Culture: en-US
[2023-06-03 17:12:30Z INFO Listener] UI Culture: en-US
[2023-06-03 17:12:30Z INFO HostContext] Well known directory 'Bin': '/home/MYID/actions-runner/bin'
[2023-06-03 17:12:30Z INFO HostContext] Well known directory 'Root': '/home/MYID/actions-runner'
[2023-06-03 17:12:30Z INFO Listener] Validating directory permissions for: '/home/MYID/actions-runner'
[2023-06-03 17:12:30Z INFO CommandLineParser] Parse
[2023-06-03 17:12:30Z INFO CommandLineParser] Parsing 5 args
[2023-06-03 17:12:30Z INFO CommandLineParser] parsing argument
[2023-06-03 17:12:30Z INFO CommandLineParser] HasArgs: False
[2023-06-03 17:12:30Z INFO CommandLineParser] Adding Command: configure
[2023-06-03 17:12:30Z INFO CommandLineParser] parsing argument
[2023-06-03 17:12:30Z INFO CommandLineParser] HasArgs: True
[2023-06-03 17:12:30Z INFO CommandLineParser] arg: url
[2023-06-03 17:12:30Z INFO CommandLineParser] parsing argument
[2023-06-03 17:12:30Z INFO CommandLineParser] HasArgs: True
[2023-06-03 17:12:30Z INFO CommandLineParser] Adding option 'url': 'https://github.com/MYID/MYREPO'
[2023-06-03 17:12:30Z INFO CommandLineParser] parsing argument
[2023-06-03 17:12:30Z INFO CommandLineParser] HasArgs: True
[2023-06-03 17:12:30Z INFO CommandLineParser] arg: token
[2023-06-03 17:12:30Z INFO CommandLineParser] parsing argument
[2023-06-03 17:12:30Z INFO CommandLineParser] HasArgs: True
[2023-06-03 17:12:30Z INFO CommandLineParser] Adding option 'token': '***'
[2023-06-03 17:12:30Z INFO Listener] Arguments parsed
[2023-06-03 17:12:30Z INFO Runner] ExecuteCommand
[2023-06-03 17:12:30Z INFO ConfigurationStore] currentAssemblyLocation: /home/MYID/actions-runner/bin/Runner.Listener.dll
[2023-06-03 17:12:30Z INFO HostContext] Well known directory 'Bin': '/home/MYID/actions-runner/bin'
[2023-06-03 17:12:30Z INFO ConfigurationStore] binPath: /home/MYID/actions-runner/bin
[2023-06-03 17:12:30Z INFO HostContext] Well known directory 'Bin': '/home/MYID/actions-runner/bin'
[2023-06-03 17:12:30Z INFO HostContext] Well known directory 'Root': '/home/MYID/actions-runner'
[2023-06-03 17:12:30Z INFO ConfigurationStore] RootFolder: /home/MYID/actions-runner
[2023-06-03 17:12:30Z INFO HostContext] Well known directory 'Bin': '/home/MYID/actions-runner/bin'
[2023-06-03 17:12:30Z INFO HostContext] Well known directory 'Root': '/home/MYID/actions-runner'
[2023-06-03 17:12:30Z INFO HostContext] Well known config file 'Runner': '/home/MYID/actions-runner/.runner'
[2023-06-03 17:12:30Z INFO ConfigurationStore] ConfigFilePath: /home/MYID/actions-runner/.runner
[2023-06-03 17:12:30Z INFO HostContext] Well known directory 'Bin': '/home/MYID/actions-runner/bin'
[2023-06-03 17:12:30Z INFO HostContext] Well known directory 'Root': '/home/MYID/actions-runner'
[2023-06-03 17:12:30Z INFO HostContext] Well known config file 'Credentials': '/home/MYID/actions-runner/.credentials'
[2023-06-03 17:12:30Z INFO ConfigurationStore] CredFilePath: /home/MYID/actions-runner/.credentials
[2023-06-03 17:12:30Z INFO HostContext] Well known directory 'Bin': '/home/MYID/actions-runner/bin'
[2023-06-03 17:12:30Z INFO HostContext] Well known directory 'Root': '/home/MYID/actions-runner'
[2023-06-03 17:12:30Z INFO HostContext] Well known config file 'MigratedCredentials': '/home/MYID/actions-runner/.credentials_migrated'
[2023-06-03 17:12:30Z INFO ConfigurationStore] MigratedCredFilePath: /home/MYID/actions-runner/.credentials_migrated
[2023-06-03 17:12:30Z INFO HostContext] Well known directory 'Bin': '/home/MYID/actions-runner/bin'
[2023-06-03 17:12:30Z INFO HostContext] Well known directory 'Root': '/home/MYID/actions-runner'
[2023-06-03 17:12:30Z INFO HostContext] Well known config file 'Service': '/home/MYID/actions-runner/.service'
[2023-06-03 17:12:30Z INFO ConfigurationStore] ServiceConfigFilePath: /home/MYID/actions-runner/.service
[2023-06-03 17:12:30Z INFO CommandSettings] Flag 'help': 'False'
[2023-06-03 17:12:30Z INFO CommandSettings] Flag 'version': 'False'
[2023-06-03 17:12:30Z INFO CommandSettings] Flag 'commit': 'False'
[2023-06-03 17:12:30Z INFO CommandSettings] Flag 'check': 'False'
[2023-06-03 17:12:30Z INFO CommandSettings] Command 'configure': 'True'
[2023-06-03 17:12:30Z INFO Terminal] WRITE LINE:
[2023-06-03 17:12:30Z INFO Terminal] WRITE LINE: --------------------------------------------------------------------------------
[2023-06-03 17:12:30Z INFO Terminal] WRITE LINE: | ____ _ _ _ _ _ _ _ _ |
[2023-06-03 17:12:30Z INFO Terminal] WRITE LINE: | / ___(_) |_| | | |_ _| |__ / \ ___| |_(_) ___ _ __ ___ |
[2023-06-03 17:12:30Z INFO Terminal] WRITE LINE: | | | _| | __| |_| | | | | '_ \ / _ \ / __| __| |/ _ \| '_ \/ __| |
[2023-06-03 17:12:30Z INFO Terminal] WRITE LINE: | | |_| | | |_| _ | |_| | |_) | / ___ \ (__| |_| | (_) | | | \__ \ |
[2023-06-03 17:12:30Z INFO Terminal] WRITE LINE: | \____|_|\__|_| |_|\__,_|_.__/ /_/ \_\___|\__|_|\___/|_| |_|___/ |
[2023-06-03 17:12:30Z INFO Terminal] WRITE LINE: | |
[2023-06-03 17:12:30Z INFO Terminal] WRITE: |
[2023-06-03 17:12:30Z INFO Terminal] WRITE: Self-hosted runner registration
[2023-06-03 17:12:30Z INFO Terminal] WRITE LINE: |
[2023-06-03 17:12:30Z INFO Terminal] WRITE LINE: | |
[2023-06-03 17:12:30Z INFO Terminal] WRITE LINE: --------------------------------------------------------------------------------
[2023-06-03 17:12:30Z INFO ConfigurationManager] ConfigureAsync
[2023-06-03 17:12:30Z INFO CommandSettings] Flag 'generateServiceConfig': 'False'
[2023-06-03 17:12:30Z INFO ConfigurationStore] IsConfigured()
[2023-06-03 17:12:30Z INFO ConfigurationStore] IsConfigured: False
[2023-06-03 17:12:30Z INFO ConfigurationManager] Is configured: False
[2023-06-03 17:12:30Z INFO CommandSettings] Arg 'url': 'https://github.com/MYID/MYREPO'
[2023-06-03 17:12:30Z INFO CommandSettings] Remove url from Arg dictionary.
[2023-06-03 17:12:30Z INFO CommandSettings] Arg 'token': '***'
[2023-06-03 17:12:30Z INFO CommandSettings] Remove token from Arg dictionary.
[2023-06-03 17:12:31Z INFO ConfigurationManager] Http response code: OK from 'POST https://api.github.com/actions/runner-registration' (AD48:507B:A50160:155986F:647B747F)
[2023-06-03 17:12:31Z INFO Terminal] WRITE LINE: Using V2 flow: False
[2023-06-03 17:12:31Z INFO ConfigurationManager] cred retrieved via GitHub auth
[2023-06-03 17:12:31Z INFO RunnerServer] EstablishVssConnection
[2023-06-03 17:12:31Z INFO RunnerServer] Establish connection with 100 seconds timeout.
[2023-06-03 17:12:31Z INFO GitHubActionsService] Starting operation Location.GetConnectionData
[2023-06-03 17:12:31Z INFO RunnerServer] EstablishVssConnection
[2023-06-03 17:12:31Z INFO RunnerServer] Establish connection with 60 seconds timeout.
[2023-06-03 17:12:31Z INFO GitHubActionsService] Starting operation Location.GetConnectionData
[2023-06-03 17:12:31Z INFO RunnerServer] EstablishVssConnection
[2023-06-03 17:12:31Z INFO RunnerServer] Establish connection with 60 seconds timeout.
[2023-06-03 17:12:31Z INFO GitHubActionsService] Starting operation Location.GetConnectionData
[2023-06-03 17:13:31Z WARN GitHubActionsService] GET request to https://pipelines.actions.githubusercontent.com/v5X4vEZCkZ5D1ZZWItsL94PoWciZTGMLDSsXOOHsSSQbOXRhFC/_apis/connectionData?connectOptions=0&lastChangeId=1302529&lastChangeId64=1302529 timed out after 60 seconds.
[2023-06-03 17:13:31Z WARN GitHubActionsService] GET request to https://pipelines.actions.githubusercontent.com/v5X4vEZCkZ5D1ZZWItsL94PoWciZTGMLDSsXOOHsSSQbOXRhFC/_apis/connectionData?connectOptions=0&lastChangeId=1302529&lastChangeId64=1302529 timed out after 60 seconds.
[2023-06-03 17:13:31Z INFO GitHubActionsService] Finished operation Location.GetConnectionData
[2023-06-03 17:13:31Z INFO GitHubActionsService] Finished operation Location.GetConnectionData
[2023-06-03 17:13:31Z INFO GitHubActionsService] Starting operation Location.GetConnectionData
[2023-06-03 17:13:31Z INFO GitHubActionsService] Starting operation Location.GetConnectionData
[2023-06-03 17:14:11Z WARN GitHubActionsService] GET request to https://pipelines.actions.githubusercontent.com/v5X4vEZCkZ5D1ZZWItsL94PoWciZTGMLDSsXOOHsSSQbOXRhFC/_apis/connectionData?connectOptions=0&lastChangeId=1302529&lastChangeId64=1302529 timed out after 100 seconds.
[2023-06-03 17:14:11Z INFO GitHubActionsService] Finished operation Location.GetConnectionData
[2023-06-03 17:14:11Z INFO GitHubActionsService] Starting operation Location.GetConnectionData
[2023-06-03 17:14:31Z WARN GitHubActionsService] GET request to https://pipelines.actions.githubusercontent.com/v5X4vEZCkZ5D1ZZWItsL94PoWciZTGMLDSsXOOHsSSQbOXRhFC/_apis/connectionData?connectOptions=0&lastChangeId=1302529&lastChangeId64=1302529 timed out after 60 seconds.
[2023-06-03 17:14:31Z WARN GitHubActionsService] GET request to https://pipelines.actions.githubusercontent.com/v5X4vEZCkZ5D1ZZWItsL94PoWciZTGMLDSsXOOHsSSQbOXRhFC/_apis/connectionData?connectOptions=0&lastChangeId=1302529&lastChangeId64=1302529 timed out after 60 seconds.
[2023-06-03 17:14:31Z INFO GitHubActionsService] Finished operation Location.GetConnectionData
[2023-06-03 17:14:31Z INFO GitHubActionsService] Finished operation Location.GetConnectionData
[2023-06-03 17:14:31Z INFO RunnerServer] Catch exception during connect. 4 attempt left.
[2023-06-03 17:14:31Z INFO RunnerServer] Catch exception during connect. 4 attempt left.
[2023-06-03 17:14:31Z ERR RunnerServer] System.TimeoutException: The HTTP request timed out after 00:01:00.
---> System.Threading.Tasks.TaskCanceledException: A task was canceled.
at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellationAsync(CancellationToken cancellationToken)
at System.Net.Http.HttpConnectionPool.GetHttp11ConnectionAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
at System.Net.Http.AuthenticationHelper.SendWithAuthAsync(HttpRequestMessage request, Uri authUri, Boolean async, ICredentials credentials, Boolean preAuthenticate, Boolean isProxyAuth, Boolean doRequestAuth, HttpConnectionPool pool, CancellationToken cancellationToken)
at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
at GitHub.Services.Common.VssHttpMessageHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)
--- End of inner exception stack trace ---
at GitHub.Services.Common.VssHttpMessageHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)
at GitHub.Services.Common.VssHttpRetryMessageHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
at GitHub.Services.WebApi.VssHttpClientBase.SendAsync(HttpRequestMessage message, HttpCompletionOption completionOption, Object userState, CancellationToken cancellationToken)
at GitHub.Services.WebApi.VssHttpClientBase.SendAsync[T](HttpRequestMessage message, Object userState, CancellationToken cancellationToken)
at GitHub.Services.Location.Client.LocationHttpClient.GetConnectionDataAsync(ConnectOptions connectOptions, Int64 lastChangeId, CancellationToken cancellationToken, Object userState)
at GitHub.Services.WebApi.Location.VssServerDataProvider.GetConnectionDataAsync(ConnectOptions connectOptions, Int32 lastChangeId, CancellationToken cancellationToken)
at GitHub.Services.WebApi.Location.VssServerDataProvider.ConnectAsync(ConnectOptions connectOptions, CancellationToken cancellationToken)
at GitHub.Runner.Common.RunnerService.EstablishVssConnection(Uri serverUrl, VssCredentials credentials, TimeSpan timeout)
[2023-06-03 17:14:31Z ERR RunnerServer] #####################################################
[2023-06-03 17:14:31Z ERR RunnerServer] System.TimeoutException: The HTTP request timed out after 00:01:00.
---> System.Threading.Tasks.TaskCanceledException: A task was canceled.
at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellationAsync(CancellationToken cancellationToken)
at System.Net.Http.HttpConnectionPool.GetHttp11ConnectionAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
at System.Net.Http.AuthenticationHelper.SendWithAuthAsync(HttpRequestMessage request, Uri authUri, Boolean async, ICredentials credentials, Boolean preAuthenticate, Boolean isProxyAuth, Boolean doRequestAuth, HttpConnectionPool pool, CancellationToken cancellationToken)
at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
at GitHub.Services.Common.VssHttpMessageHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)
--- End of inner exception stack trace ---
at GitHub.Services.Common.VssHttpMessageHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)
at GitHub.Services.Common.VssHttpRetryMessageHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
at GitHub.Services.WebApi.VssHttpClientBase.SendAsync(HttpRequestMessage message, HttpCompletionOption completionOption, Object userState, CancellationToken cancellationToken)
at GitHub.Services.WebApi.VssHttpClientBase.SendAsync[T](HttpRequestMessage message, Object userState, CancellationToken cancellationToken)
at GitHub.Services.Location.Client.LocationHttpClient.GetConnectionDataAsync(ConnectOptions connectOptions, Int64 lastChangeId, CancellationToken cancellationToken, Object userState)
at GitHub.Services.WebApi.Location.VssServerDataProvider.GetConnectionDataAsync(ConnectOptions connectOptions, Int32 lastChangeId, CancellationToken cancellationToken)
at GitHub.Services.WebApi.Location.VssServerDataProvider.ConnectAsync(ConnectOptions connectOptions, CancellationToken cancellationToken)
at GitHub.Runner.Common.RunnerService.EstablishVssConnection(Uri serverUrl, VssCredentials credentials, TimeSpan timeout)
[2023-06-03 17:14:31Z ERR RunnerServer] #####################################################
[2023-06-03 17:14:31Z ERR RunnerServer] System.Threading.Tasks.TaskCanceledException: A task was canceled.
at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellationAsync(CancellationToken cancellationToken)
at System.Net.Http.HttpConnectionPool.GetHttp11ConnectionAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
at System.Net.Http.AuthenticationHelper.SendWithAuthAsync(HttpRequestMessage request, Uri authUri, Boolean async, ICredentials credentials, Boolean preAuthenticate, Boolean isProxyAuth, Boolean doRequestAuth, HttpConnectionPool pool, CancellationToken cancellationToken)
at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
at GitHub.Services.Common.VssHttpMessageHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)
[2023-06-03 17:14:31Z ERR RunnerServer] System.Threading.Tasks.TaskCanceledException: A task was canceled.
at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellationAsync(CancellationToken cancellationToken)
at System.Net.Http.HttpConnectionPool.GetHttp11ConnectionAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
at System.Net.Http.AuthenticationHelper.SendWithAuthAsync(HttpRequestMessage request, Uri authUri, Boolean async, ICredentials credentials, Boolean preAuthenticate, Boolean isProxyAuth, Boolean doRequestAuth, HttpConnectionPool pool, CancellationToken cancellationToken)
at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
at GitHub.Services.Common.VssHttpMessageHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)
[2023-06-03 17:14:31Z INFO GitHubActionsService] Starting operation Location.GetConnectionData
[2023-06-03 17:14:31Z INFO GitHubActionsService] Starting operation Location.GetConnectionData
[2023-06-03 17:14:42Z INFO GitHubActionsService] Finished operation Location.GetConnectionData
[2023-06-03 17:15:31Z WARN GitHubActionsService] GET request to https://pipelines.actions.githubusercontent.com/v5X4vEZCkZ5D1ZZWItsL94PoWciZTGMLDSsXOOHsSSQbOXRhFC/_apis/connectionData?connectOptions=0&lastChangeId=1302529&lastChangeId64=1302529 timed out after 60 seconds.
[2023-06-03 17:15:31Z WARN GitHubActionsService] GET request to https://pipelines.actions.githubusercontent.com/v5X4vEZCkZ5D1ZZWItsL94PoWciZTGMLDSsXOOHsSSQbOXRhFC/_apis/connectionData?connectOptions=0&lastChangeId=1302529&lastChangeId64=1302529 timed out after 60 seconds.
[2023-06-03 17:15:31Z INFO GitHubActionsService] Finished operation Location.GetConnectionData
[2023-06-03 17:15:31Z INFO GitHubActionsService] Finished operation Location.GetConnectionData
[2023-06-03 17:15:31Z INFO GitHubActionsService] Starting operation Location.GetConnectionData
[2023-06-03 17:15:31Z INFO GitHubActionsService] Starting operation Location.GetConnectionData
[2023-06-03 17:16:31Z WARN GitHubActionsService] GET request to https://pipelines.actions.githubusercontent.com/v5X4vEZCkZ5D1ZZWItsL94PoWciZTGMLDSsXOOHsSSQbOXRhFC/_apis/connectionData?connectOptions=0&lastChangeId=1302529&lastChangeId64=1302529 timed out after 60 seconds.
[2023-06-03 17:16:31Z INFO GitHubActionsService] Finished operation Location.GetConnectionData
[2023-06-03 17:16:31Z INFO RunnerServer] Catch exception during connect. 3 attempt left.
[2023-06-03 17:16:31Z WARN GitHubActionsService] GET request to https://pipelines.actions.githubusercontent.com/v5X4vEZCkZ5D1ZZWItsL94PoWciZTGMLDSsXOOHsSSQbOXRhFC/_apis/connectionData?connectOptions=0&lastChangeId=1302529&lastChangeId64=1302529 timed out after 60 seconds.
[2023-06-03 17:16:31Z INFO GitHubActionsService] Finished operation Location.GetConnectionData
[2023-06-03 17:16:31Z INFO RunnerServer] Catch exception during connect. 3 attempt left.
[2023-06-03 17:16:31Z ERR RunnerServer] System.TimeoutException: The HTTP request timed out after 00:01:00.
---> System.Threading.Tasks.TaskCanceledException: A task was canceled.
at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellationAsync(CancellationToken cancellationToken)
at System.Net.Http.HttpConnectionPool.GetHttp11ConnectionAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
at System.Net.Http.AuthenticationHelper.SendWithAuthAsync(HttpRequestMessage request, Uri authUri, Boolean async, ICredentials credentials, Boolean preAuthenticate, Boolean isProxyAuth, Boolean doRequestAuth, HttpConnectionPool pool, CancellationToken cancellationToken)
at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
at GitHub.Services.Common.VssHttpMessageHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)
--- End of inner exception stack trace ---
at GitHub.Services.Common.VssHttpMessageHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)
at GitHub.Services.Common.VssHttpRetryMessageHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
at GitHub.Services.WebApi.VssHttpClientBase.SendAsync(HttpRequestMessage message, HttpCompletionOption completionOption, Object userState, CancellationToken cancellationToken)
at GitHub.Services.WebApi.VssHttpClientBase.SendAsync[T](HttpRequestMessage message, Object userState, CancellationToken cancellationToken)
at GitHub.Services.Location.Client.LocationHttpClient.GetConnectionDataAsync(ConnectOptions connectOptions, Int64 lastChangeId, CancellationToken cancellationToken, Object userState)
at GitHub.Services.WebApi.Location.VssServerDataProvider.GetConnectionDataAsync(ConnectOptions connectOptions, Int32 lastChangeId, CancellationToken cancellationToken)
at GitHub.Services.WebApi.Location.VssServerDataProvider.ConnectAsync(ConnectOptions connectOptions, CancellationToken cancellationToken)
at GitHub.Runner.Common.RunnerService.EstablishVssConnection(Uri serverUrl, VssCredentials credentials, TimeSpan timeout)
[2023-06-03 17:16:31Z ERR RunnerServer] #####################################################
[2023-06-03 17:16:31Z ERR RunnerServer] System.Threading.Tasks.TaskCanceledException: A task was canceled.
at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellationAsync(CancellationToken cancellationToken)
at System.Net.Http.HttpConnectionPool.GetHttp11ConnectionAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
at System.Net.Http.AuthenticationHelper.SendWithAuthAsync(HttpRequestMessage request, Uri authUri, Boolean async, ICredentials credentials, Boolean preAuthenticate, Boolean isProxyAuth, Boolean doRequestAuth, HttpConnectionPool pool, CancellationToken cancellationToken)
at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
at GitHub.Services.Common.VssHttpMessageHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)
[2023-06-03 17:16:31Z ERR RunnerServer] System.TimeoutException: The HTTP request timed out after 00:01:00.
---> System.Threading.Tasks.TaskCanceledException: A task was canceled.
at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellationAsync(CancellationToken cancellationToken)
at System.Net.Http.HttpConnectionPool.GetHttp11ConnectionAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
at System.Net.Http.AuthenticationHelper.SendWithAuthAsync(HttpRequestMessage request, Uri authUri, Boolean async, ICredentials credentials, Boolean preAuthenticate, Boolean isProxyAuth, Boolean doRequestAuth, HttpConnectionPool pool, CancellationToken cancellationToken)
at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
at GitHub.Services.Common.VssHttpMessageHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)
--- End of inner exception stack trace ---
at GitHub.Services.Common.VssHttpMessageHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)
at GitHub.Services.Common.VssHttpRetryMessageHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
at GitHub.Services.WebApi.VssHttpClientBase.SendAsync(HttpRequestMessage message, HttpCompletionOption completionOption, Object userState, CancellationToken cancellationToken)
at GitHub.Services.WebApi.VssHttpClientBase.SendAsync[T](HttpRequestMessage message, Object userState, CancellationToken cancellationToken)
at GitHub.Services.Location.Client.LocationHttpClient.GetConnectionDataAsync(ConnectOptions connectOptions, Int64 lastChangeId, CancellationToken cancellationToken, Object userState)
at GitHub.Services.WebApi.Location.VssServerDataProvider.GetConnectionDataAsync(ConnectOptions connectOptions, Int32 lastChangeId, CancellationToken cancellationToken)
at GitHub.Services.WebApi.Location.VssServerDataProvider.ConnectAsync(ConnectOptions connectOptions, CancellationToken cancellationToken)
at GitHub.Runner.Common.RunnerService.EstablishVssConnection(Uri serverUrl, VssCredentials credentials, TimeSpan timeout)
[2023-06-03 17:16:31Z ERR RunnerServer] #####################################################
[2023-06-03 17:16:31Z ERR RunnerServer] System.Threading.Tasks.TaskCanceledException: A task was canceled.
at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellationAsync(CancellationToken cancellationToken)
at System.Net.Http.HttpConnectionPool.GetHttp11ConnectionAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
at System.Net.Http.AuthenticationHelper.SendWithAuthAsync(HttpRequestMessage request, Uri authUri, Boolean async, ICredentials credentials, Boolean preAuthenticate, Boolean isProxyAuth, Boolean doRequestAuth, HttpConnectionPool pool, CancellationToken cancellationToken)
at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
at GitHub.Services.Common.VssHttpMessageHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)
[2023-06-03 17:16:31Z INFO GitHubActionsService] Starting operation Location.GetConnectionData
[2023-06-03 17:16:31Z INFO GitHubActionsService] Starting operation Location.GetConnectionData
[2023-06-03 17:17:31Z WARN GitHubActionsService] GET request to https://pipelines.actions.githubusercontent.com/v5X4vEZCkZ5D1ZZWItsL94PoWciZTGMLDSsXOOHsSSQbOXRhFC/_apis/connectionData?connectOptions=0&lastChangeId=1302529&lastChangeId64=1302529 timed out after 60 seconds.
[2023-06-03 17:17:31Z INFO GitHubActionsService] Finished operation Location.GetConnectionData
[2023-06-03 17:17:31Z INFO GitHubActionsService] Starting operation Location.GetConnectionData
[2023-06-03 17:17:31Z WARN GitHubActionsService] GET request to https://pipelines.actions.githubusercontent.com/v5X4vEZCkZ5D1ZZWItsL94PoWciZTGMLDSsXOOHsSSQbOXRhFC/_apis/connectionData?connectOptions=0&lastChangeId=1302529&lastChangeId64=1302529 timed out after 60 seconds.
[2023-06-03 17:17:31Z INFO GitHubActionsService] Finished operation Location.GetConnectionData
[2023-06-03 17:17:31Z INFO GitHubActionsService] Starting operation Location.GetConnectionData
[2023-06-03 17:18:31Z WARN GitHubActionsService] GET request to https://pipelines.actions.githubusercontent.com/v5X4vEZCkZ5D1ZZWItsL94PoWciZTGMLDSsXOOHsSSQbOXRhFC/_apis/connectionData?connectOptions=0&lastChangeId=1302529&lastChangeId64=1302529 timed out after 60 seconds.
[2023-06-03 17:18:31Z INFO GitHubActionsService] Finished operation Location.GetConnectionData
[2023-06-03 17:18:31Z INFO RunnerServer] Catch exception during connect. 2 attempt left.
[2023-06-03 17:18:31Z ERR RunnerServer] System.TimeoutException: The HTTP request timed out after 00:01:00.
---> System.Threading.Tasks.TaskCanceledException: A task was canceled.
at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellationAsync(CancellationToken cancellationToken)
at System.Net.Http.HttpConnectionPool.GetHttp11ConnectionAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
at System.Net.Http.AuthenticationHelper.SendWithAuthAsync(HttpRequestMessage request, Uri authUri, Boolean async, ICredentials credentials, Boolean preAuthenticate, Boolean isProxyAuth, Boolean doRequestAuth, HttpConnectionPool pool, CancellationToken cancellationToken)
at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
at GitHub.Services.Common.VssHttpMessageHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)
--- End of inner exception stack trace ---
at GitHub.Services.Common.VssHttpMessageHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)
at GitHub.Services.Common.VssHttpRetryMessageHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
at GitHub.Services.WebApi.VssHttpClientBase.SendAsync(HttpRequestMessage message, HttpCompletionOption completionOption, Object userState, CancellationToken cancellationToken)
at GitHub.Services.WebApi.VssHttpClientBase.SendAsync[T](HttpRequestMessage message, Object userState, CancellationToken cancellationToken)
at GitHub.Services.Location.Client.LocationHttpClient.GetConnectionDataAsync(ConnectOptions connectOptions, Int64 lastChangeId, CancellationToken cancellationToken, Object userState)
at GitHub.Services.WebApi.Location.VssServerDataProvider.GetConnectionDataAsync(ConnectOptions connectOptions, Int32 lastChangeId, CancellationToken cancellationToken)
at GitHub.Services.WebApi.Location.VssServerDataProvider.ConnectAsync(ConnectOptions connectOptions, CancellationToken cancellationToken)
at GitHub.Runner.Common.RunnerService.EstablishVssConnection(Uri serverUrl, VssCredentials credentials, TimeSpan timeout)
[2023-06-03 17:18:31Z ERR RunnerServer] #####################################################
[2023-06-03 17:18:31Z ERR RunnerServer] System.Threading.Tasks.TaskCanceledException: A task was canceled.
at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellationAsync(CancellationToken cancellationToken)
at System.Net.Http.HttpConnectionPool.GetHttp11ConnectionAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
at System.Net.Http.AuthenticationHelper.SendWithAuthAsync(HttpRequestMessage request, Uri authUri, Boolean async, ICredentials credentials, Boolean preAuthenticate, Boolean isProxyAuth, Boolean doRequestAuth, HttpConnectionPool pool, CancellationToken cancellationToken)
at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
at GitHub.Services.Common.VssHttpMessageHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)
[2023-06-03 17:18:31Z WARN GitHubActionsService] GET request to https://pipelines.actions.githubusercontent.com/v5X4vEZCkZ5D1ZZWItsL94PoWciZTGMLDSsXOOHsSSQbOXRhFC/_apis/connectionData?connectOptions=0&lastChangeId=1302529&lastChangeId64=1302529 timed out after 60 seconds.
[2023-06-03 17:18:31Z INFO GitHubActionsService] Finished operation Location.GetConnectionData
[2023-06-03 17:18:31Z INFO RunnerServer] Catch exception during connect. 2 attempt left.
[2023-06-03 17:18:31Z ERR RunnerServer] System.TimeoutException: The HTTP request timed out after 00:01:00.
---> System.Threading.Tasks.TaskCanceledException: A task was canceled.
at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellationAsync(CancellationToken cancellationToken)
at System.Net.Http.HttpConnectionPool.GetHttp11ConnectionAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
at System.Net.Http.AuthenticationHelper.SendWithAuthAsync(HttpRequestMessage request, Uri authUri, Boolean async, ICredentials credentials, Boolean preAuthenticate, Boolean isProxyAuth, Boolean doRequestAuth, HttpConnectionPool pool, CancellationToken cancellationToken)
at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
at GitHub.Services.Common.VssHttpMessageHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)
--- End of inner exception stack trace ---
at GitHub.Services.Common.VssHttpMessageHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)
at GitHub.Services.Common.VssHttpRetryMessageHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
at GitHub.Services.WebApi.VssHttpClientBase.SendAsync(HttpRequestMessage message, HttpCompletionOption completionOption, Object userState, CancellationToken cancellationToken)
at GitHub.Services.WebApi.VssHttpClientBase.SendAsync[T](HttpRequestMessage message, Object userState, CancellationToken cancellationToken)
at GitHub.Services.Location.Client.LocationHttpClient.GetConnectionDataAsync(ConnectOptions connectOptions, Int64 lastChangeId, CancellationToken cancellationToken, Object userState)
at GitHub.Services.WebApi.Location.VssServerDataProvider.GetConnectionDataAsync(ConnectOptions connectOptions, Int32 lastChangeId, CancellationToken cancellationToken)
at GitHub.Services.WebApi.Location.VssServerDataProvider.ConnectAsync(ConnectOptions connectOptions, CancellationToken cancellationToken)
at GitHub.Runner.Common.RunnerService.EstablishVssConnection(Uri serverUrl, VssCredentials credentials, TimeSpan timeout)
[2023-06-03 17:18:31Z ERR RunnerServer] #####################################################
[2023-06-03 17:18:31Z ERR RunnerServer] System.Threading.Tasks.TaskCanceledException: A task was canceled.
at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellationAsync(CancellationToken cancellationToken)
at System.Net.Http.HttpConnectionPool.GetHttp11ConnectionAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
at System.Net.Http.AuthenticationHelper.SendWithAuthAsync(HttpRequestMessage request, Uri authUri, Boolean async, ICredentials credentials, Boolean preAuthenticate, Boolean isProxyAuth, Boolean doRequestAuth, HttpConnectionPool pool, CancellationToken cancellationToken)
at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
at GitHub.Services.Common.VssHttpMessageHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)
[2023-06-03 17:18:31Z INFO GitHubActionsService] Starting operation Location.GetConnectionData
[2023-06-03 17:18:31Z INFO GitHubActionsService] Starting operation Location.GetConnectionData
[2023-06-03 17:19:31Z WARN GitHubActionsService] GET request to https://pipelines.actions.githubusercontent.com/v5X4vEZCkZ5D1ZZWItsL94PoWciZTGMLDSsXOOHsSSQbOXRhFC/_apis/connectionData?connectOptions=0&lastChangeId=1302529&lastChangeId64=1302529 timed out after 60 seconds.
[2023-06-03 17:19:31Z INFO GitHubActionsService] Finished operation Location.GetConnectionData
[2023-06-03 17:19:31Z INFO GitHubActionsService] Starting operation Location.GetConnectionData
[2023-06-03 17:19:31Z WARN GitHubActionsService] GET request to https://pipelines.actions.githubusercontent.com/v5X4vEZCkZ5D1ZZWItsL94PoWciZTGMLDSsXOOHsSSQbOXRhFC/_apis/connectionData?connectOptions=0&lastChangeId=1302529&lastChangeId64=1302529 timed out after 60 seconds.
[2023-06-03 17:19:31Z INFO GitHubActionsService] Finished operation Location.GetConnectionData
[2023-06-03 17:19:31Z INFO GitHubActionsService] Starting operation Location.GetConnectionData
Hey @AlienKevin
Can you confirm you don't have network-related issues? You can use this troubleshooting guide.
I have the same issue with 2 self hosted runners which were working fine last week. Now they just appear offline and the runner log shows "WARN GitHubActionsService] GET request to.. timed out after 60 seconds"
@nikola-jokic I can git clone from github without trouble so I don't think there's any issue with my network.
Also, a really weird thing is that some pods can connect, yet they still show offline in the runner list. But some cannot connect. All are running on the same bare metal server, via k3s.
We are also hitting this issue, I have checked all endpoints described here https://github.com/actions/runner/blob/main/docs/checks/network.md and those seem to work.
We see this in the _diag logs:
GET request to https://pipelinesghubeus24.actions.githubusercontent.com/PkO5TDsqR7ypkv3Q1FFqmuba-----removed----RKyhShMr773/_apis/distributedtask/pools?poolType=Automation timed out after 100 seconds.
(I removed one bit just in case)
ok, in my case it was an IPv6 connectivity issue.
Once I disabled IPv6 it worked..
Also having this issue. I've properly configured IPV6 on the server, but still have the same issue.
Just resolved my issue, the problem was the MTU size.
My hypotesis: the virtual machine has by default an MTU of 1500. Usually on a network path, if there are segments where the MTU needs to be lower, there is a notification back to the sender, so the MSS is reduced accordingly. However, for some reason "pipelinesghubeus2.actions.githubusercontent.com" network path probably do not send back the notifications or someone eats them.
Anyway, to resolve the issue, I just set sudo ip link set dev ens18 mtu 1400. I hope it helps, because this is an annoying issue hard to debug.
Just resolved my issue, the problem was the MTU size.
My hypotesis: the virtual machine has by default an MTU of 1500. Usually on a network path, if there are segments where the MTU needs to be lower, there is a notification back to the sender, so the MSS is reduced accordingly. However, for some reason "pipelinesghubeus2.actions.githubusercontent.com" network path probably do not send back the notifications or someone eats them.
Anyway, to resolve the issue, I just set
sudo ip link set dev ens18 mtu 1400. I hope it helps, because this is an annoying issue hard to debug.
tried sudo ip link set dev enp5s0 mtu 1400 still getting error The HTTP request timed out after 00:01:40.
any solutions ? (self hosted runner linux-x64-2.312.0)
Dirty Fix.
- create a proxy server. create a ssh tunnel with DNS resolution
sshuttle --dns -vr <USER>@<IP> 0/0 --ssh-cmd 'ssh -i key.pem' - run
run /config.sh --url https://github.com/<repo> --token <token> - check github runner page to see Active/idle Status 🌟
Just resolved my issue, the problem was the MTU size.
My hypotesis: the virtual machine has by default an MTU of 1500. Usually on a network path, if there are segments where the MTU needs to be lower, there is a notification back to the sender, so the MSS is reduced accordingly. However, for some reason "pipelinesghubeus2.actions.githubusercontent.com" network path probably do not send back the notifications or someone eats them.
Anyway, to resolve the issue, I just set
sudo ip link set dev ens18 mtu 1400. I hope it helps, because this is an annoying issue hard to debug.
This solved it for me, thank you!
