cortex

cortex copied to clipboard

container probes fail when Cortex mutual TLS is enabled

12

**Describe the bug** I followed the [instructions here ](https://cortexmetrics.io/docs/guides/tls/) to enable mTLS in Cortex. I deployed Cortex from the latest [helm chart](https://github.com/cortexproject/cortex-helm-chart). The outcome is pods are being terminated because...

danfromtitan

Compactor Failing to compact blocks as it contains out of orders samples.

7

**Describe the bug** Compactor Failing to compact blocks as it contains out of orders samples. ``` level=error ts=2021-11-25T23:23:46.612236147Z caller=compactor.go:537 component=compactor msg="failed to compact user blocks" user=redacted err="compaction: group 0@16569674436192844872: blocks...

alanprot

HA dedupe should not require a "cluster" label

13

I'm told the purpose of the cluster label is to allow differentiatiation between multiple Prometheus HA pairs in a tenant. Its name is set via `-distributor.ha-tracker.cluster`. Cortex should support the...

bboreham

Failure to compact due to maximum index size 64 GiB

7

**Describe the bug** Over the weekend we significantly expanded one of our clusters, pushing ~153M timeseries to our Cortex 1.11.1 cluster in a day. **To Reproduce** Steps to reproduce the...

thejosephstevens

Update Documentation for Store Gateway

1

**Is your feature request related to a problem? Please describe.** The configuration [documentation](https://cortexmetrics.io/docs/configuration/configuration-file/#store_gateway_config) for the store gateway seems to be the only source of information on this tier. From that...

justinrush

Failed to receive series from cortex-store-gateway-headless:9095 in Cortex. Is anyone faced the same issue?

1

"expanding series: failed to receive series from cortex-store-gateway-headless:9095: rpc error: code = Aborted desc = fetch series for block 01G09HZRF0RGTF3ZNV819J8BH2: load chunks: get range reader: The specified key does not...

Rahuly360

the ring never removes old ingester even if the ingester pod is evicted

45

I have a similar problem as #1502 when my ingester pod was evicted , a new ingester pod will be created . now the ring has two ingester, but only...

wuyafang

Cryptic error message from querier

1

Example: ``` level=warn ts=2021-03-05T09:08:41.326358339Z caller=logging.go:71 traceID=44b1364b1ae4070a msg="POST /api/prom/api/v1/query (500) 1.767165ms Response: \"\\x1f\\x8b\\b\\x00\\x00\\x00\\x00\\x00\\x00\\xff4\\xcaщ\\xc3@\\fE\\xd1V\\x1e\\xfa\\xde\\n\\\\\\xc76\\xa0\\xb5\\x1e\\x1b \\x91\\xb1ƌd\\xe4\\xe7\\xd3\\xdf\\xdbNYģ8B\\xdbw\\xbf\\xd8 \\xdc5\\xcc\\xe3\\x1f\\xc9\\xe1\\xcc\\x05\\u007f\\xc7ze\\xc1\\xc38\\xe1\\x89\\xea\\x1d\\xbd\\x194\\fu!\\x9af\\xa1|#\\xbcpj \\xe2\\xd8M\\x8b\\x06Ε\\xb4|#m\\xad\\x9f4l:\\x91\\xa5\\x8d\\xc1Ly

bboreham

Is that possible to query for the “raw” data within a time range with exact ingested time stamps without considering arbitrary step for range queries

3

**feature request** Hi, I would like to retrieve data AS it was collected and recorded by cortex. I do not want to use an **arbitrary step** for range queries. **solution**...

venkatchinmay

Frontend retries genuine errors

6

Relevant log line: ``` level=error ts=2018-10-04T09:20:28.637542898Z caller=frontend.go:203 msg="error processing request" try=4 err=null resp="&HTTPResponse{Code:500,Headers:[&Header{Key:Access-Control-Allow-Methods,Values:[GET, OPTIONS],} &Header{Key:Access-Control-Allow-Origin,Values:[*],} &Header{Key:Access-Control-Expose-Headers,Values:[Date],} &Header{Key:Content-Type,Values:[application/json],} &Header{Key:Content-Encoding,Values:[gzip],} &Header{Key:Access-Control-Allow-Headers,Values:[Accept, Authorization, Content-Type, Origin],}],Body:[31 139 8 0 0 0 0 0 0...

gouthamve