Block indexing halting at tezos testnet. Problem with "big_map_contents_pkey" index.

[amurde]

Hello all, yesterday morning both our conseil halted reading data from Tezos testnet. At the same time, around 6 in the morning CET.

Error in logs is: " Caused by: org.postgresql.util.PSQLException: ERROR: index row size 3032 exceeds btree version 4 maximum 2704 for index "big_map_contents_pkey" Detail: Index row references tuple (35161,12) in relation "big_map_contents". Hint: Values larger than 1/3 of a buffer page cannot be indexed. Consider a function index of an MD5 hash of the value, or use full text indexing "

Tezos node ver 11.1 Conseil ver 2021-november-release-39-7

[SiddharthV1]

Hi amurde ,

Thanks for bringing it to our attention , we are actively looking at the issue

[amurde]

Hello all, i dropped database on one of the nodes and tried to read it from the scratch. Result is the same:

".....value_micheline"=EXCLUDED."value_micheline","block_level"=EXCLUDED."block_level","timestamp"=EXCLUDED."timestamp","cycle"=EXCLUDED."cycle","period"=EXCLUDED."period","invalidated_asof"=EXCLUDED."invalidated_asof" was aborted: ERROR: index row size 3032 exceeds btree version 4 maximum 2704 for index "big_map_contents_pkey" Detail: Index row references tuple (35573,7) in relation "big_map_contents". Hint: Values larger than 1/3 of a buffer page cannot be indexed. Consider a function index of an MD5 hash of the value, or use full text indexing. Call getNextException to see other errors in the batch."

We are talking about testnet-hangzhounet data. Nodes is in archive mode.