Multicore performance

Open przmv opened this issue 10 years ago • 1 comments

Hello,

I've noticed recently that running gonx-based applications on more CPUs doesn't improve the performance. So, I've created a benchmark processing 1 million records and measured the results on four multi-core VM instances on Google Cloud Platform — https://cloud.google.com/compute/docs/machine-types#highcpu

Also I've compared 'em with another benchmark results utilizing glow library.

Here are the resulting charts:

Apr 06 '16 19:04 przmv

Thanks for benchmarks! The library has no multicore support or any kink of autoscaling, it uses hardcoded number of workers https://github.com/satyrius/gonx/blob/master/mapreduce.go#L25. I think we can calculate topLoad depending on CPU count or accept desired count as a parameter. And we should play with GOMAXPROCS

Apr 07 '16 01:04 satyrius