Devansh Choubey

Results 34 comments of Devansh Choubey

Hello @wangxiaoyou1993, but this is the only log we get for this, apologies but please let me know if I am missing anything INFO:cold_sea/2/20240418T113235:{"pipeline_run_id": 5, "pipeline_schedule_id": 2, "pipeline_uuid": "cold_sea", "hostname":...

apologies but how ?? @wangxiaoyou1993 ![image](https://github.com/mage-ai/mage-ai/assets/85338857/67551299-d5df-41c6-ba5f-cae6fa29a0d5)

yep @wangxiaoyou1993 we tried this same traceback, apart from this just logs of message received and message being inserted into postgres with the mongodb document. then this error, no other...

Hello @wangxiaoyou1993, could you please help with any update on this ??

Hello @wangxiaoyou1993, quick update on this, mongdb to postgres streaming does work in case we do some kind of transformation and then pass on it to postgres data exporter.

nothing much just few custom transforms that we do for data type issues like dates etc. we figured that mongodb issue would be eliminated if we instead of passing mongodb...

apologies but my hunch is that I don't think it's related to any particular datatype. it's a generaly issue when fetching data from mongodb and dumping into Postgres. it works...

yep we fetch the data and then do a transformation step in between, if we do that then we don't get such errors. ps:- we are already using tens of...

I shifted to using devtron, which seems promising https://github.com/devtron-labs/devtron