meteor icon indicating copy to clipboard operation
meteor copied to clipboard
verified publisher icon raystack

fix: send asset metadata create_time & update_time to Compass

Open sudo-suhas opened this issue 3 years ago • 0 comments

Compass request data structure did not support sending the create_time and update_time parsed from data present in extractors. For example, this would be the time a table was created in a database and the time it was last updated at.

  • Update Proton's commit ID to pull in changes that add create_time and update_time fields in each of the asset metadata types - table, user, topic etc.
  • Populate Asset.Data.{CreateTime, UpdateTime} and stop populating Asset.{CreateTime,UpdateTime} (these fields are used by the system to track the first and last injestion run that inserted/updated the asset).

Depends on https://github.com/odpf/proton/pull/191. Closes #409.

sudo-suhas avatar Sep 23 '22 13:09 sudo-suhas