Gitlab /projects usage improvements

[enriquegh]

Question description

From an EM at Gitlab:

I'm wondering if you could connect me with an engineer or EM who is familiar with requests to the GitLab GET /projects API endpoint made from the user agent Sourcegraph-Bot. I'm assuming these are calls from Sourcegraph to index a GitLab user's repos. We noticed a lot of the requests are quite slow and may be returning more data than needed, and I was hoping I could talk to someone at Sourcegraph about potentially making more efficient use of the endpoint.

Is your question related to a problem? If so, please describe or link to another issue.

Additional context

Internal Slack thread: https://sourcegraph.slack.com/archives/C05EMJM2SLR/p1707513264604149?thread_ts=1707512398.176149&cid=C05EMJM2SLR

cc @ggilmore