Creating a MongoDB collection for each Kafka topic automatically in MongoDB Kafka Sink Connector

Question

Is there a way in the MongoDB Kafka Sink Connector to create a MongoDB collection for per Kafka topic by defining a pattern or prefix or other way?

Isn't a collection created by the sink connector already, if it doesn't exist? — OneCricketeer
– OneCricketeer, Commented Jan 30, 2023 at 18:19

n-0 · Accepted Answer · 2023-07-05 08:40:56Z

0

@OneCricketeer already pointed out in the comments that the sink connector creates topics already. If you don't specify a value for collection in the configuration, the default setting is the topic name. To match every topic that your producers write to, you can use "topics.regex": ".*". It's easy to overlook in the mongodb docs

answered Jul 5, 2023 at 8:40

n-0

4374 silver badges12 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Creating a MongoDB collection for each Kafka topic automatically in MongoDB Kafka Sink Connector

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related