Use Kafka connect with AWS documentDB

Question

I'm trying to use AWS DocumentDB as a sink for storing data received from Kafka and was wondering if the MongoDB Kafka connector works with DocumentDB as its documentation mentions that it is compatible with MongoDB drivers.

https://www.mongodb.com/docs/kafka-connector/current/

https://aws.amazon.com/documentdb/

If not this connector what is the alternate way other than building a custom kafka connect?

What specific errors do you get when you try?

OneCricketeer
– OneCricketeer

2022-05-31 21:09:34 +00:00
Commented May 31, 2022 at 21:09 — OneCricketeer
– OneCricketeer, Commented May 31, 2022 at 21:09

Anshu · Accepted Answer · 2022-12-05 09:55:32Z

1

You can use MongoDB Kafka connector with DocumentDB for source as well Sink. Kafka Connector worker(with Mongodb Kafka connector) can be run in distributed mode using containers as well as EC2 hosts.

You can refer blog here which has step by step details https://aws.amazon.com/blogs/database/stream-data-with-amazon-documentdb-and-amazon-msk-using-a-kafka-connector/

edited Dec 5, 2022 at 9:55

answered Jun 27, 2022 at 5:48

Anshu

112 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Use Kafka connect with AWS documentDB

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related