Chad Myers
Chad Myers
This would also help with running in AWS ECS Fargate where it's hard to get files into the container (requires a sidecar to pull file(s) from S3 into a shared...
We're getting the same errors -- this and the cluster UUID error in opensearch-project/opensearch-build#186 We ensured that we're using the latest (2.0.2) version of the plugin. Has anyone got logstash-output-opensearch...
Example debug log of a 403: ``` [2023-09-12T17:08:50,783][DEBUG][org.apache.http.wire ] http-outgoing-5 >> "{"server_name":"REDACTED","region":"us-west-2","relayer":"managed","program":"search","tags":["tcpjson","nxlog","log4net_dated","Dovetail","customer","REDACTED","test_opsgenie_heartbeat"],"host":"172.REDACTED","ec2_instance_id":"i-REDACTED","log_message":"REDACTED","type":"dovetail-log4net","source_server":"REDACTED (i-REDACTED)","@timestamp":"2023-09-12T17:07:03.237Z","level":"INFO","port":62153,"message":"REDACTED"}[\n]" [2023-09-12T17:08:50,791][DEBUG][org.apache.http.wire ] http-outgoing-5
This is another 403 error we get when logstash is starting up - it tries to create the index template. ``` _index_template Error: Sep 12 15:10:16 ip-172-30-0-227.us-west-2.compute.internal logstash[306234]: [2023-09-12T15:10:16,459][ERROR][logstash.outputs.opensearch] Failed...
I'm following [this Workshop from AWS](https://catalog.us-east-1.prod.workshops.aws/workshops/f8d2c175-634d-4c5d-94cb-d83bbc656c6a/en-US/30-time-series/04-data-ingestion-pipelines/03-logstash-ingest/02-running-logstash) to try to create a repro scenario of sorts, or at least to try to isolate my environment out of things as much as...
I added this inline policy to the IAM instance profile of my Cloud9 instance: ``` { "Version": "2012-10-17", "Statement": [ { "Sid": "AllowOSSAPI", "Effect": "Allow", "Action": "aoss:APIAccessAll", "Resource": "arn:aws:aoss:us-west-2:REDACTED:collection/REDACTED" }...
This is what I have in my Data Access Policy: ``` { "Rules": [ { "Resource": [ "collection/REDACTED" ], "Permission": [ "aoss:*" ], "ResourceType": "collection" }, { "Resource": [ "index/*/*"...
@dblock @dlvenable Have either of you (or anyone) know anyone who's got the logstash-output-opensearch plugin working with OSS? Because as far as I can tell, I've got the OSS data...
@kkmr Thank you. There's [an AWS Workshop](https://catalog.us-east-1.prod.workshops.aws/workshops/f8d2c175-634d-4c5d-94cb-d83bbc656c6a/en-US/30-time-series/04-data-ingestion-pipelines) that's very similar to that that I followed with no luck. The only things I can see that are different are: - The...
> > Have either of you (or anyone) know anyone who's got the logstash-output-opensearch plugin working with OSS? > > I don't know of anyone who has tried ATM, but...