upgrade to 1.40.2 migration old data

[jeyem]

Is this a regression?

Yes

Description

Following the migration, certain columns were left with NULL values, which the agent does not handle properly, resulting in runtime errors.

Please provide the exception or error you saw

`2025-04-10_15:10:46.641 ERROR o.h.i.s.m.MessagingService@L171:[zio-default-blocking-20] {} - zio-fiber-67584424 Defect processing message: 136118cc-5584-4a89-a5ac-66f6f6a86b3b   
zio.FiberFailure: SQL `NULL` read at column 9 (JDBC type Other) but mapping is to a non-Option type; use Option here. Note that JDBC column indexing is 1-based.
        at doobie.util.invariant$NonNullableColumnRead$.apply(invariant.scala:54)
        at doobie.util.Get.unsafeGetNonNullable(get.scala:29)
        at doobie.util.Read$.fromGet$$anonfun$1(read.scala:74)
        at doobie.util.Read$.fromGet$$anonfun$adapted$1(read.scala:74)
        at doobie.util.ReadPlatform.given_Read_$times$colon$$anonfun$1(ReadPlatform.scala:19)
        at doobie.util.ReadPlatform.given_Read_$times$colon$$anonfun$adapted$1(ReadPlatform.scala:19)
        at doobie.util.ReadPlatform.given_Read_$times$colon$$anonfun$1(ReadPlatform.scala:19)
        at doobie.util.ReadPlatform.given_Read_$times$colon$$anonfun$adapted$1(ReadPlatform.scala:19)
        at doobie.util.ReadPlatform.given_Read_$times$colon$$anonfun$1(ReadPlatform.scala:19)
        at doobie.util.ReadPlatform.given_Read_$times$colon$$anonfun$adapted$1(ReadPlatform.scala:19)
        at doobie.util.ReadPlatform.given_Read_$times$colon$$anonfun$1(ReadPlatform.scala:19)
        at doobie.util.ReadPlatform.given_Read_$times$colon$$anonfun$adapted$1(ReadPlatform.scala:19)
        at doobie.util.ReadPlatform.given_Read_$times$colon$$anonfun$1(ReadPlatform.scala:19)
        at doobie.util.ReadPlatform.given_Read_$times$colon$$anonfun$adapted$1(ReadPlatform.scala:19)
        at doobie.util.ReadPlatform.given_Read_$times$colon$$anonfun$1(ReadPlatform.scala:19)
        at doobie.util.ReadPlatform.given_Read_$times$colon$$anonfun$adapted$1(ReadPlatform.scala:19)
        at doobie.util.ReadPlatform.given_Read_$times$colon$$anonfun$1(ReadPlatform.scala:19)
        at doobie.util.ReadPlatform.given_Read_$times$colon$$anonfun$adapted$1(ReadPlatform.scala:19)
        at doobie.util.ReadPlatform.given_Read_$times$colon$$anonfun$1(ReadPlatform.scala:19)
        at doobie.util.ReadPlatform.given_Read_$times$colon$$anonfun$adapted$1(ReadPlatform.scala:19)
        at doobie.util.ReadPlatform.given_Read_$times$colon$$anonfun$1(ReadPlatform.scala:19)
        at doobie.util.ReadPlatform.given_Read_$times$colon$$anonfun$adapted$1(ReadPlatform.scala:19)
        at doobie.util.Read.map$$anonfun$1(read.scala:49)
        at doobie.util.Read.map$$anonfun$adapted$1(read.scala:49)
        at doobie.hi.resultset$.build$$anonfun$1(resultset.scala:90)
        at doobie.free.KleisliInterpreter.primitive$$anonfun$1$$anonfun$1(kleisliinterpreter.scala:107)
        at zio.interop.ZioAsync.suspend$$anonfun$2(ZioAsync.scala:27)
        at zio.ZIOCompanionVersionSpecific.attempt$$anonfun$1(ZIOCompanionVersionSpecific.scala:108)
        at zio.ZIO$.suspendSucceed$$anonfun$1(ZIO.scala:4823)
`

Please provide the environment you discovered this bug in

Anything else?

No response

[yshyn-iohk]

@jeyem, could you add more information how to reproduce the issue? I cannot figure out it from the stack-trace

[jeyem]

@jeyem, could you add more information how to reproduce the issue? I cannot figure out it from the stack-trace

This is all logs trace that I got from my cloud-agent, I had older version 1.39.0 that works and had data then I'd upgrade to 1.40.2 look like some data has no defualt setup on table that lead to be null

[yshyn-iohk]

I've got it. But which table and what entity?

[jeyem]

I've got it. But which table and what entity?

I already asked this question, from Identus team couldn't find my self so I cleared all tables on connect, pollux and agent related databases to bypass this error

[yshyn-iohk]

@jeyem, is it possible to share a couple of pages of logs before the error?

[yshyn-iohk]

It's not easy to reproduce the issue. @jeyem, I will close it as we don't have the required information.