pixiebrix-extension icon indicating copy to clipboard operation
pixiebrix-extension copied to clipboard

Compress trace record data

Open twschiller opened this issue 3 years ago • 2 comments

Context

  • Our traces (and debug logging) snapshots the context when the brick is called
  • For extensions with a lot of bricks and/or large values (e.g., from API calls) that can clog up the IDB
  • There's needless redundancy between traces
  • Tracing/program slice tools for real programming languages work by compressing the trace, e.g., storing diffs between program counters

Implementation Sketch

  • In a trace "pre-" section, only include the diff from the previous trace record
  • Link each trace record to the previous trace record

twschiller avatar Jul 22 '22 12:07 twschiller

I used this in the past: it takes strings, outputs strings

https://github.com/pieroxy/lz-string

fregante avatar Jul 25 '22 07:07 fregante

I used this in the past: it takes strings, outputs strings

Thanks, long-term I suspect we'll need to avoid storing the redundant data. But this is worth a quick look to see if it's a helpful stop gap

twschiller avatar Jul 26 '22 03:07 twschiller

This issue will be closed in 7 days unless the stale label is removed, or a comment is added to the issue.

github-actions[bot] avatar Dec 28 '23 00:12 github-actions[bot]

This issue was closed because it has been stale for 7 days with no activity.

github-actions[bot] avatar Jan 04 '24 00:01 github-actions[bot]