Adding AWS SigV4 authentication

[fabiojmendes]

This pull request implements the AWS SigV4 as described in #197

[reta]

@fabiojmendes I believe we do not intent to bundle vendor specific schemes into the connector but offer the capability to have it packaged / bundled with additional JARs that could be loaded using ServiceLoader mechanism, @willyborankin please correct me if I am wrong here.

[fabiojmendes]

I see your point, but perhaps supporting aws out of the box would be worth the trade off.

I believe that using opensearch as an aws service is a very common use case.

[willyborankin]

@fabiojmendes I believe we do not intent to bundle vendor specific schemes into the connector but offer the capability to have it packaged / bundled with additional JARs that could be loaded using ServiceLoader mechanism, @willyborankin please correct me if I am wrong here.

@reta TBH I do not see any problems with adding it to the connector. It is a "kinda" connector way. In any case configuration for custom certificates needs to be added as well.

[willyborankin]

@fabiojmendes I believe we do not intent to bundle vendor specific schemes into the connector but offer the capability to have it packaged / bundled with additional JARs that could be loaded using ServiceLoader mechanism, @willyborankin please correct me if I am wrong here.

@reta TBH I do not see any problems with adding it to the connector. It is a "kinda" connector way. In any case configuration for custom certificates needs to be added as well.

@fabiojmendes. We do want to see you solution.I personally think this is a valuable feature. Since we need to add support SSL configuration it will take sometime. @reta I think we need to add a separate project which will build together with the connector as separate jar/jars with additional auth libs. Wdyt?

[fabiojmendes]

Sounds good @willyborankin, do you need any changes from my side at this point?

[fire2]

what is the status of this? it would be great to have support for IAM role authentication in the connector out of the box...

[fabiojmendes]

Is there still interest from the maintainers to merge this PR?

[SubhraB]

Trying to make it work with aws opensearch serverless, the feature would be extremely helpful.

Edit - I am using strimzi kafka connect, so i will need IRSA to work.

[SubhraB]

Another update - For now I am able to make it work using aws-sigv4-proxy tool.

[fire2]

@reta any chance to get this merged and released?

[reta]

@reta any chance to get this merged and released?

Hey @fire2 , I am (sadly) not with Aiven anymore and kicked out of this repository :( sorry about that