chore(pipelines transform): Audit pipelines transform

[fuchsnj]

This adds an assert_transform_compliance test to the pipelines transform.

[netlify[bot]]

✅ Deploy Preview for vector-project ready!

Name	Link
🔨 Latest commit	c8ce4879ce70c0bc93e6e87e617d5a7a1477646c
🔍 Latest deploy log	https://app.netlify.com/sites/vector-project/deploys/633ef5f1dbaf620008b87bf1
😎 Deploy Preview	https://deploy-preview-14483--vector-project.netlify.app
📱 Preview on mobile	Toggle QR Code... Use your smartphone camera to open QR code link.

---

To edit notification comments on pull requests, go to your Netlify site settings.

[github-actions[bot]]

Soak Test Results

Baseline: 9cf1ea9b08ed745e3872c1cc81757f6078c82419 Comparison: f2da1dc3521175dede984621076148a6931e07ff Total Vector CPUs: 4

Explanation

A soak test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their throughput performance between baseline and comparision SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±8.87% change in mean throughput are discarded. An experiment is erratic if its coefficient of variation is greater than 0.3. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in throughput with confidence ≥ 90.00% and absolute Δ mean >= ±8.87%:

Fine details of change detection per experiment.

experiment	Δ mean	Δ mean %	confidence	baseline mean	baseline stdev	baseline stderr	baseline outlier %	baseline CoV	comparison mean	comparison stdev	comparison stderr	comparison outlier %	comparison CoV	erratic	declared erratic
socket_to_socket_blackhole	765.55KiB	3.32	100.00%	22.54MiB	987.9KiB	20.17KiB	0	0.0427929	23.29MiB	1.01MiB	21.16KiB	0	0.043459	False	False
http_pipelines_blackhole_acks	32.01KiB	2.61	100.00%	1.2MiB	115.18KiB	2.34KiB	0	0.093774	1.23MiB	80.73KiB	1.65KiB	0	0.0640584	False	False
http_text_to_http_json	754.63KiB	1.9	100.00%	38.79MiB	1.41MiB	29.37KiB	0	0.0362165	39.53MiB	1.41MiB	29.44KiB	0	0.0356219	False	False
datadog_agent_remap_datadog_logs	1.11MiB	1.86	100.00%	59.93MiB	2.72MiB	57.04KiB	0	0.0454152	61.04MiB	4.9MiB	101.96KiB	0	0.0801958	False	False
datadog_agent_remap_blackhole_acks	748.31KiB	1.19	100.00%	61.61MiB	4.37MiB	90.9KiB	0	0.0708496	62.34MiB	2.51MiB	52.5KiB	0	0.040222	False	False
datadog_agent_remap_blackhole	621.44KiB	1.04	100.00%	58.54MiB	3.91MiB	81.43KiB	0	0.066708	59.15MiB	3.0MiB	62.56KiB	0	0.0506837	False	False
http_to_http_acks	143.62KiB	0.81	45.57%	17.25MiB	8.08MiB	169.0KiB	0	0.468473	17.39MiB	7.94MiB	165.96KiB	0	0.456717	True	True
datadog_agent_remap_datadog_logs_acks	459.36KiB	0.73	100.00%	61.77MiB	2.8MiB	58.5KiB	0	0.0452645	62.22MiB	4.42MiB	92.08KiB	0	0.0710843	False	False
syslog_log2metric_humio_metrics	72.96KiB	0.56	100.00%	12.77MiB	288.46KiB	5.89KiB	0	0.0220574	12.84MiB	578.89KiB	11.78KiB	0	0.0440189	False	False
http_pipelines_no_grok_blackhole	6.79KiB	0.06	19.47%	10.51MiB	602.94KiB	12.31KiB	0	0.0560273	10.51MiB	1.18MiB	24.62KiB	0	0.112465	False	False
splunk_hec_to_splunk_hec_logs_noack	5.75KiB	0.02	41.87%	23.83MiB	387.03KiB	7.9KiB	0	0.0158564	23.84MiB	333.68KiB	6.81KiB	0	0.0136675	False	False
enterprise_http_to_http	1.49KiB	0.01	15.93%	23.84MiB	254.68KiB	5.2KiB	0	0.0104281	23.85MiB	257.03KiB	5.26KiB	0	0.0105237	False	False
splunk_hec_indexer_ack_blackhole	45.46B	0	0.13%	23.75MiB	937.3KiB	19.07KiB	0	0.03854	23.75MiB	940.44KiB	19.13KiB	0	0.0386691	False	False
splunk_hec_to_splunk_hec_logs_acks	-10.89KiB	-0.04	33.46%	23.76MiB	854.98KiB	17.39KiB	0	0.0351404	23.74MiB	895.76KiB	18.21KiB	0	0.036833	False	False
http_pipelines_blackhole	-1.17KiB	-0.07	22.76%	1.64MiB	118.84KiB	2.43KiB	0	0.0706031	1.64MiB	159.01KiB	3.24KiB	0	0.0945339	False	False
http_to_http_json	-26.02KiB	-0.11	97.15%	23.85MiB	343.12KiB	7.01KiB	0	0.0140481	23.82MiB	469.29KiB	9.59KiB	0	0.0192341	False	False
fluent_elasticsearch	-100.9KiB	-0.12	100.00%	79.47MiB	54.52KiB	1.1KiB	0	0.000669851	79.37MiB	1.14MiB	23.46KiB	0	0.0143525	False	False
file_to_blackhole	-134.68KiB	-0.14	72.04%	95.32MiB	3.63MiB	75.22KiB	0	0.0380914	95.19MiB	4.78MiB	99.26KiB	0	0.0501572	False	False
syslog_regex_logs2metric_ddmetrics	-34.21KiB	-0.27	96.53%	12.58MiB	617.9KiB	12.58KiB	0	0.0479529	12.55MiB	500.03KiB	10.2KiB	0	0.0389086	False	False
syslog_splunk_hec_logs	-55.08KiB	-0.33	99.26%	16.15MiB	777.75KiB	15.83KiB	0	0.0470213	16.1MiB	643.39KiB	13.12KiB	0	0.0390282	False	False
http_to_http_noack	-119.1KiB	-0.49	100.00%	23.85MiB	253.1KiB	5.18KiB	0	0.0103633	23.73MiB	1.16MiB	24.26KiB	0	0.0490462	False	False
splunk_hec_route_s3	-193.74KiB	-1	99.69%	18.98MiB	2.25MiB	46.75KiB	0	0.118267	18.79MiB	2.2MiB	45.97KiB	0	0.116811	False	False
syslog_humio_logs	-192.66KiB	-1.14	100.00%	16.57MiB	117.26KiB	2.39KiB	0	0.00690978	16.38MiB	128.46KiB	2.63KiB	0	0.0076567	False	False
syslog_log2metric_splunk_hec_metrics	-247.39KiB	-1.38	100.00%	17.51MiB	1.15MiB	24.02KiB	0	0.0657616	17.27MiB	1.19MiB	24.74KiB	0	0.0686841	False	False
syslog_loki	-389.85KiB	-2.64	100.00%	14.4MiB	541.09KiB	11.08KiB	0	0.0366856	14.02MiB	776.59KiB	15.79KiB	0	0.0540819	False	False