Performance Analysis

[alexheifetz]

Need to start with performance analysis of the framework. Define a process for continuous testing, identification of issues (if any).

1. CPU Profiling - Identify hot spots and suggest design optimizations (non-blocking IO, parallel processing, etc)
2. Thread Profiling - Identify anomalies (potential locks, frozen threads, etc_
3. Memory Profiling - GC Cycles, Heap Size, etc.

[alexheifetz]

We have profiling tool licenses available for YourKit and JProfiler

@igordayen please prepare test plan.

[igordayen]

adding to list: 4. Load / Stress testing in cloud / Kubdernetes env.

[igordayen]

Initial observations using JProfiler:

1. CPU prifiling - more-less normal

2. Memory Heap Profiling - requires attention due to excessive memory consumption by MultiIngestor.