ansakharov

Fixes #82

Fixes #92 (issue)

Feature: Add optional commit commit to kafka in s3 plugin

2

**Issue** Current implementation: file plugin commits event after written to file, s3 plugin writes zip files to storage. Desired implementation: file plugin commits event after written to file, s3 plugin...

For better separation of throttling required different mechanism of limiting. **Solution** Use Redis to store limit for each pod and renew it. In absence of Redis fallback to memory limiter.

Pg insert just reties in cycle, replace it with exponential backoff.

Redis throttle need flexible way of limits updation from redis.