chore(log_to_metric transform): Audit log_to_metric transform
closes https://github.com/vectordotdev/vector/issues/14067
There were some minor changes to when an event is considered "dropped" with this transform. A single event can generate multiple metrics. If a single metric fails, the event is dropped and no metrics are published.
Deploy Preview for vector-project canceled.
| Name | Link |
|---|---|
| Latest commit | 4f6ea43f0ce7f9acda0ca0cf2896af0020b4bc79 |
| Latest deploy log | https://app.netlify.com/sites/vector-project/deploys/63403c53073b0c0009f2e62c |
Soak Test Results
Baseline: 7b26f65c6bde9fe824ea15948fa0147cf026db5e Comparison: d58f3dc7183205a084f98f2748656a088ffe5d83 Total Vector CPUs: 4
Explanation
A soak test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.
The table below, if present, lists those experiments that have experienced a statistically significant change in their throughput performance between baseline and comparision SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±8.87% change in mean throughput are discarded. An experiment is erratic if its coefficient of variation is greater than 0.3. The abbreviated table will be omitted if no interesting changes are observed.
No interesting changes in throughput with confidence ≥ 90.00% and absolute Δ mean >= ±8.87%:
Fine details of change detection per experiment.
| experiment | Δ mean | Δ mean % | confidence | baseline mean | baseline stdev | baseline stderr | baseline outlier % | baseline CoV | comparison mean | comparison stdev | comparison stderr | comparison outlier % | comparison CoV | erratic | declared erratic |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| syslog_log2metric_splunk_hec_metrics | 432.36KiB | 2.57 | 100.00% | 16.45MiB | 843.12KiB | 17.19KiB | 0 | 0.0500354 | 16.87MiB | 1.09MiB | 22.71KiB | 0 | 0.0646003 | False | False |
| http_pipelines_blackhole_acks | 24.96KiB | 2.15 | 100.00% | 1.13MiB | 110.78KiB | 2.26KiB | 0 | 0.0954338 | 1.16MiB | 83.78KiB | 1.71KiB | 0 | 0.0706492 | False | False |
| syslog_log2metric_humio_metrics | 274.43KiB | 2.13 | 100.00% | 12.57MiB | 435.7KiB | 8.9KiB | 0 | 0.0338497 | 12.84MiB | 531.5KiB | 10.82KiB | 0 | 0.0404309 | False | False |
| syslog_humio_logs | 262.87KiB | 1.6 | 100.00% | 16.01MiB | 813.1KiB | 16.6KiB | 0 | 0.0495761 | 16.27MiB | 772.86KiB | 15.83KiB | 0 | 0.0463793 | False | False |
| splunk_hec_route_s3 | 223.58KiB | 1.2 | 99.82% | 18.25MiB | 2.43MiB | 50.65KiB | 0 | 0.133258 | 18.47MiB | 2.42MiB | 50.71KiB | 0 | 0.131197 | False | False |
| syslog_splunk_hec_logs | 127.1KiB | 0.78 | 100.00% | 15.93MiB | 854.62KiB | 17.39KiB | 0 | 0.0523964 | 16.05MiB | 785.67KiB | 16.03KiB | 0 | 0.0477965 | False | False |
| http_text_to_http_json | 61.17KiB | 0.15 | 97.27% | 39.24MiB | 984.47KiB | 20.1KiB | 0 | 0.0244941 | 39.3MiB | 934.77KiB | 19.08KiB | 0 | 0.0232223 | False | False |
| syslog_regex_logs2metric_ddmetrics | 12.09KiB | 0.1 | 52.87% | 12.38MiB | 578.25KiB | 11.78KiB | 0 | 0.0456159 | 12.39MiB | 587.24KiB | 11.96KiB | 0 | 0.0462815 | False | False |
| splunk_hec_to_splunk_hec_logs_noack | 13.57KiB | 0.06 | 76.23% | 23.82MiB | 454.75KiB | 9.28KiB | 0 | 0.0186363 | 23.84MiB | 332.38KiB | 6.78KiB | 0 | 0.0136138 | False | False |
| splunk_hec_to_splunk_hec_logs_acks | 9.82KiB | 0.04 | 31.14% | 23.75MiB | 867.43KiB | 17.64KiB | 0 | 0.0356632 | 23.76MiB | 835.48KiB | 17.0KiB | 0 | 0.0343354 | False | False |
| enterprise_http_to_http | -1.21KiB | -0 | 12.61% | 23.85MiB | 263.51KiB | 5.38KiB | 0 | 0.0107892 | 23.84MiB | 262.4KiB | 5.37KiB | 0 | 0.0107443 | False | False |
| file_to_blackhole | -55.64KiB | -0.06 | 48.87% | 95.34MiB | 2.81MiB | 58.24KiB | 0 | 0.0294622 | 95.29MiB | 2.96MiB | 61.52KiB | 0 | 0.0310418 | False | False |
| splunk_hec_indexer_ack_blackhole | -16.14KiB | -0.07 | 46.74% | 23.76MiB | 858.55KiB | 17.47KiB | 0 | 0.03528 | 23.74MiB | 937.29KiB | 19.07KiB | 0 | 0.0385414 | False | False |
| datadog_agent_remap_blackhole | -44.91KiB | -0.07 | 26.34% | 58.91MiB | 4.84MiB | 100.86KiB | 0 | 0.0821873 | 58.86MiB | 4.19MiB | 87.46KiB | 0 | 0.0712447 | False | False |
| http_to_http_json | -26.97KiB | -0.11 | 97.78% | 23.85MiB | 333.27KiB | 6.8KiB | 0 | 0.0136447 | 23.82MiB | 470.94KiB | 9.63KiB | 0 | 0.0193027 | False | False |
| datadog_agent_remap_blackhole_acks | -83.38KiB | -0.14 | 58.71% | 60.24MiB | 4.16MiB | 86.61KiB | 0 | 0.06905 | 60.15MiB | 2.56MiB | 53.51KiB | 0 | 0.0425021 | False | False |
| fluent_elasticsearch | -285.29KiB | -0.35 | 100.00% | 79.47MiB | 53.45KiB | 1.08KiB | 0 | 0.000656603 | 79.19MiB | 3.05MiB | 62.65KiB | 0 | 0.0384972 | False | False |
| http_to_http_noack | -92.48KiB | -0.38 | 99.99% | 23.84MiB | 403.25KiB | 8.24KiB | 0 | 0.0165176 | 23.75MiB | 1.09MiB | 22.64KiB | 0 | 0.0457212 | False | False |
| http_pipelines_no_grok_blackhole | -53.89KiB | -0.51 | 98.97% | 10.37MiB | 109.16KiB | 2.23KiB | 0 | 0.010281 | 10.31MiB | 1.0MiB | 20.87KiB | 0 | 0.0971372 | False | False |
| http_to_http_acks | -114.39KiB | -0.65 | 38.01% | 17.28MiB | 7.67MiB | 160.41KiB | 0 | 0.443955 | 17.17MiB | 7.94MiB | 165.68KiB | 0 | 0.462393 | True | True |
| socket_to_socket_blackhole | -251.75KiB | -1.12 | 100.00% | 21.94MiB | 1.32MiB | 27.67KiB | 0 | 0.0603258 | 21.69MiB | 1.11MiB | 23.22KiB | 0 | 0.051195 | False | False |
| syslog_loki | -176.55KiB | -1.21 | 100.00% | 14.23MiB | 689.85KiB | 14.13KiB | 0 | 0.0473291 | 14.06MiB | 827.12KiB | 16.81KiB | 0 | 0.0574432 | False | False |
| datadog_agent_remap_datadog_logs | -856.78KiB | -1.38 | 100.00% | 60.64MiB | 912.56KiB | 18.68KiB | 0 | 0.0146933 | 59.8MiB | 4.23MiB | 88.04KiB | 0 | 0.0707093 | False | False |
| http_pipelines_blackhole | -27.42KiB | -1.7 | 100.00% | 1.57MiB | 149.06KiB | 3.05KiB | 0 | 0.09255 | 1.55MiB | 190.58KiB | 3.88KiB | 0 | 0.120378 | False | False |
| datadog_agent_remap_datadog_logs_acks | -1.08MiB | -1.77 | 100.00% | 60.93MiB | 4.41MiB | 92.18KiB | 0 | 0.072333 | 59.85MiB | 5.34MiB | 111.06KiB | 0 | 0.0891247 | False | False |