connect icon indicating copy to clipboard operation
connect copied to clipboard

Pulsar Component - missing features

Open crtomirmajer opened this issue 4 years ago • 3 comments

Pulsar component is missing some important features:

  • support for Token/OAuth2 Authentication, currently none. I suggest adding the following:
pulsar:
    auth:
        oauth2:
          audience: "urn:sn:pulsar:x:y"
          issuer_url: "https://auth.xyz"
          private_key_file: /this/folder/key.json
        token:
          token: <base64-token-here> 
  • configurable subscription type, currently hardcoded to Shared. My proposal is to add subscription_type option:
pulsar:
   subscription_type: <type-here>  # one of: shared, key_shared, exclusive, failover
  • message attributes, such as id, publishTime, redeliveryCount, etc. (see Message interface)

crtomirmajer avatar Oct 25 '21 13:10 crtomirmajer

Hi @crtomirmajer. Thanks for raising these! Happy to accept PRs if you're interested in hacking at them. Otherwise, I can look into it.

mihaitodor avatar Oct 25 '21 13:10 mihaitodor

OK, I'm happy to work on that.

crtomirmajer avatar Oct 25 '21 14:10 crtomirmajer

Another thing that's currently missing is exposing SubscriptionInitialPosition in ConsumerOptions

// SubscriptionInitialPosition is the initial position at which the cursor will be set when subscribe
// Default is `Latest`
SubscriptionInitialPosition

As far as I understand, it's the pulsar equivalent of setting the offset to start consuming from in Kafka.

Unless someone objects, I'll try to put a PR up this week 🤞

srenatus avatar May 15 '24 08:05 srenatus