yasiryagi

Consider move from ES to Prometheus for Metrics collection

1

I highly recommend moving from Elastic search to Prometheus for collecting storage and distributed nodes metrics. This enable each node to collect , store and service it is own metrics....

Storage bags replication risk

6

Problem: - Replication of channel/bag to buckets/nodes only happened at the initial when the channel/bag is created. - As the buckets/nodes fail/retire and new buckets/nodes introduced, channel/bag only stay attached...

Auto set set-bucket-limits extrinsics

3

Issue : Currently every time an operator make a change to his server and storage capacity he need to notify the lead to set set-bucket-limits extrinsics. Ask: to detect change...

Problem: There is no way to make a storage node higher or lower priority for selection for a new bag. Current status: When channel is first created, Atlas selects 4...

Object Upload fails but still set as accepted on chain

3

Issue: Uploads that has failed , but still marked as accepted on chain Evidence: dataObjectId: 2100687 ``` { "data": { "storageDataObjects": [ { "isAccepted": true, "id": "2100687" } ] }...

| fields.meta.message.keyword | message.keyword | | -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | -------------------------------------------------------------------------------------------------------- | | uncaughtException: Data object 28403 has already been accepted by storage nodeError: Data object 28403 has already been accepted by...

[Colossus] storage node crash shows passwords

1

Description: When Colossus crashed the log and ES included the key password . logs: ``` "argv": [ "/usr/local/bin/node", "/joystream/storage-node/bin/run", "server", "--worker=12", "--port=3333", "--uploads=/data", "--sync", "--syncInterval=1", "--queryNodeEndpoint=https://adovrn-joystream.yyagi.cloud/graphql", "--apiUrl=ws://joystream-node:9944/", "--keyFile=/keystore/storage-role-key.json", "--password=************", "--elasticSearchEndpoint=https://elastic.joyutils.org/",...

Lost object investigation tool

2

## Lost Objects: ### Description: A tool to identify and locate lost objects. #### collect: Find all objects and bags that : - Locally stored: Collect a json of all...

The http call fail and respond with 'HTTP/1.1 502 Bad Gateway', detail below [graph_http_error.txt](https://github.com/graphprotocol/mission-control-indexer/files/5691770/graph_http_error.txt)