fluency icon indicating copy to clipboard operation
fluency copied to clipboard

Not getting logs on AWS EKS cluster

Open rward27 opened this issue 5 years ago • 1 comments

Hello, this has been a great plugin but I am facing some issues with this

I have a presto instance running on a namespace and it has a custom plugin and event-listener configured that gets all the logs and forwards them to 24224 port.

I can see the logs if they are written as log.info("any string here") but fluency.emit(tag, map<>) is not working at all and i dont see any logs or event object being sent to fluentd instance.

can you please help in configuring how it can work or how i can debug this when on AWS EKS?

Below is the fluency code:

Map<String, Object> builder = new HashMap<>();
builder.put("createTime", queryCompletedEvent.getCreateTime().toEpochMilli());
            builder.put("endTime", queryCompletedEvent.getEndTime().toEpochMilli());
            builder.put("executionStartTime", queryCompletedEvent.getExecutionStartTime().toEpochMilli());

log.info("Hello world"); // this works and i can see it in grafana dashboard or on console in kubectl logs of the pod

            fluency.emit("presto.query",builder);  // nothing happens and this doesnt emit anything on any pod instance
            fluency.close();
 

rward27 avatar Feb 04 '21 17:02 rward27

@rward27 Thanks for reporting the issue. I have 2 questions.

  1. How was the Fluency instance instantiated? Can you tell me the configuration of FluencyBuilderForFluentd?
  2. You didn't see any warning nor error messages from Fluency?

komamitsu avatar Feb 11 '21 12:02 komamitsu