Taylor Gray

Results 44 comments of Taylor Gray

@cmanning09 After thinking about your comments for a while, I think I am more in favor of tags being a part of the `EventMetadata`, and then creating a plugin that...

Nesting the configuration here makes a lot of sense. Do you think `domain` should be required if `aws` is used? Or should it still just be conditionally optional based on...

Hi @okvittem, Thank you for creating this issue. We will keep it in mind to be added in a future release of Data Prepper. In the meantime, please read our...

Yes that is also an option. While there are only a couple obvious types of log formats to support (apache, syslog, etc), I do think the idea of putting all...

Are you able to run the Memory Profiler on this to see where the memory is getting used? My guess would be that it has to do with the MapDB...

Thanks for the background info. That is interesting. What rps did you get the `OutOfMemory` Error with? Is it possible that the `ServiceMap` just couldn't handle the load with the...

I really like this! It is clever to set the routes in the EventMetadata. I do think users will want the `remove_routes` functionality, but there is no reason to add...

> > has the added benefit of only evaluating conditionals once in the router processor. > > @graytaylor0 , the original conditional would be evaluated once but every downstream processor...

> Can this already be achieved like so: ```application-log-pipeline: source: http: prepper: ... sink: - pipeline: name: "log-pipeline" appach-log-pipeline: source: http: prepper: ... sink: - pipeline: name: "log-pipeline" log-pipeline: source:...

Hi @vishnujanardhanan, Based on your pipeline.txt file, your `opensearch` sink is misconfigured. If you use the `trace_analytics_raw` `index_type`, you cannot specify the `index` field. When using the `index_type` as `trace_analytics_raw`,...