17 questions
0
votes
1
answer
85
views
With flink-connector-mongodb, it takes too long to get data
I'm trying to configure a batch process using apach flink connector mongodb.
It takes almost 10 minutes to retrieve one item from mongodb using flink-connector-mongodb.
If no conditions are given in ...
0
votes
2
answers
400
views
Apache Flink job trying to read from Mongo via cdc source connector results in MongoTimeoutException
I am trying to use Mongo CDC connector as a source for my DataStream source in my Flink job. I use the same example code as [per the docs][1].
That's my code:
MongoDBSource<String> mongoSource =
...
0
votes
1
answer
348
views
Unable to write Spark dataframe to Mongo
Using mongo-connector version 10.0.1
the below are my config
.config("spark.mongodb.write.connection.uri", "mongodb://127.0.0.1:27017/")
.config("spark.mongodb.write.database&...
1
vote
1
answer
1k
views
Unknown error 504 when connecting Source : MongoDB to Destination: Postgres on Airbyte
New to Airbyte
Airbyte on Docker on Ec2
Source : MongoDb
Destination : Postgres
When creating the connection it throws the below error : 504 error
The same connection working fine on my local Airbyte ...
0
votes
1
answer
2k
views
Mongodb Spark SQL ConfigException - Missing configuration for: database
I am using mongo spark connector 10.1.1 (spark v2.13) and am attempting to read a collection's contents into a dataset for processing.
The spark session is configured as below:
//Build Spark session
...
0
votes
2
answers
2k
views
schemas.enable=false config not applied to connector
I am using mongokafka sink connector from kafka to mongo and connector jar is mongo-kafka-connect-1.7.0-all.jar. I have added mongodb-driver-core-4.5.0.jar also in plugins path of connect cluster.
I ...
1
vote
0
answers
215
views
sync mongo collections to elastic search using mongo-connector
I want to sync mongo collections to elastic search using mongo-connector. created the replica-set and trying to sync the data. getting few issues. below versions used so far.
mongo 4.4
elastic search ...
0
votes
1
answer
163
views
Missing documents while connecting Mongodb and elasticsearch via mongo-connector
I am trying to transfer documents from MongoDB 4.4.5 to Elasticsearch7.12 via mongo-connector 3.1.1
I start by using:
sudo mongo-connector -m 127.0.0.1:27017 -t 127.0.0.1:9200 -d elastic2_doc_manager -...
1
vote
2
answers
319
views
Bulk Insertion in Py2neo
Im writing a custom doc manager for mongo-connector to replicate mongodb documents to neo4j. Here I would like to create bulk relationships. Im using py2neo2020.0.
It seems there are some options in ...