featurebase icon indicating copy to clipboard operation
featurebase copied to clipboard

Too much memory

Open macheal opened this issue 4 years ago • 1 comments

(pprof) top
Showing nodes accounting for 47575.89MB, 94.73% of 50222.60MB total
Dropped 349 nodes (cum <= 251.11MB)
Showing top 10 nodes out of 72
    flat  flat%   sum%        cum   cum%
9682.80MB 19.28% 19.28%  9682.80MB 19.28%  github.com/pilosa/pilosa/roaring.NewContainer
9028.46MB 17.98% 37.26% 21659.43MB 43.13%  github.com/pilosa/pilosa.(*fragment).rowFromStorage
6074.87MB 12.10% 49.35% 11995.23MB 23.88%  github.com/pilosa/pilosa/roaring.NewSliceBitmap (inline)
5928.36MB 11.80% 61.16%  5928.36MB 11.80%  github.com/pilosa/pilosa/roaring.newSliceContainers (inline)
  5211MB 10.38% 71.53%     5211MB 10.38%  github.com/pilosa/pilosa/roaring.glob..func1
3517.86MB  7.00% 78.54%  3906.36MB  7.78%  github.com/pilosa/pilosa.(*fragment).Blocks
3261.08MB  6.49% 85.03%  3261.08MB  6.49%  github.com/pilosa/pilosa.(*simpleCache).Add
3193.19MB  6.36% 91.39%  3193.19MB  6.36%  github.com/pilosa/pilosa.(*rankCache).BulkAdd
1157.99MB  2.31% 93.69%  1157.99MB  2.31%  github.com/pilosa/pilosa.(*rankCache).recalculate
520.28MB  1.04% 94.73%   520.28MB  1.04%  github.com/pilosa/pilosa/roaring.(*Container).unmapOrClone


(pprof) list github.com/pilosa/pilosa/roaring.NewContainer
Total: 49.05GB
ROUTINE ======================== github.com/pilosa/pilosa/roaring.NewContainer in /Users/wangguangyu/go/src/github.com/macheal/pilosa/roaring/container_stash.go
  9.46GB     9.46GB (flat, cum) 19.28% of Total
       .          .     81:
       .          .     82:// NewContainer returns a new instance of container. This trivial function
       .          .     83:// may later become more interesting.
       .          .     84:func NewContainer() *Container {
       .          .     85:   statsHit("NewContainer")
  9.46GB     9.46GB     86:   c := &Container{typeID: containerArray, len: 0, cap: stashedArraySize}
       .          .     87:   c.pointer = (*uint16)(unsafe.Pointer(&c.data[0]))
       .          .     88:   return c
       .          .     89:}
       .          .     90:
       .          .     91:// NewContainerBitmap makes a bitmap container using the provided bitmap, or

macheal avatar Feb 26 '21 14:02 macheal