658 questions
0
votes
0
answers
33
views
Message queue where each key is processed by only one consumer at a time, but other messages for the same key can be assigned to other consumers
I'm building a distributed system that processes messages from hundreds of thousands of sensors, each identified by a sensor_id.
I need to guarantee:
Strict ordering per sensor_id
No two consumers ...
- 1,510
4
votes
1
answer
10k
views
Is Kafka a Message Queue or a Message Broker? [closed]
After going through a couple of articles explaining the difference between Message Queues and Message Brokers, I'm quite confused as to whether Kafka is a Message Queue or a Message Broker.
The main ...
- 193k
0
votes
0
answers
64
views
celery worker not consuming tasks from rabbitMQ queue
I have a queue in RabbitMQ broker called queue-ktm of type quorum. There are tasks pushed to this queue and available.
I run a celery worker to consume from this queue with following configuration:
...
- 4,161
0
votes
1
answer
90
views
How to publish once to a topic and route them to different queues based on the topic in the Solace broker?
I want to publish a sale of a product. I just wanted to publish once to a topic like sale/124 where each number represents an id of a store. Then each queue connected to that store only had to ...
0
votes
0
answers
43
views
How to dynamically extend the holding time of a message for the message consumer in RabbitMQ?
Simply put, I want to implement the same function of ServiceBusReceiver.RenewMessageLockAsync of Azure Service Bus queue in RabbitMQ. This function lets the message consumer "extend" the &...
- 2,287
1
vote
1
answer
731
views
RabbitMQ BrokerUnreachableException (.net 4.8 vs .NET 8.0) (doesn't work/works)
I am trying to connect to a localhost RabbitMQ server on my machine and keep getting the error.
Error:
RabbitMQ.Client.Exceptions.BrokerUnreachableException: 'None of the specified endpoints were ...
- 39
0
votes
0
answers
23
views
CPU-bound code blocks main thread with faststream and fastapi [duplicate]
I have a zip file with csv tables which are read and formatted with polars. I want to run it so this operation doesn't block my main thread. But it blocks it and fastapi cannot process any incoming ...
60
votes
6
answers
28k
views
What is the difference between message queue and message broker?
From what I understand, a message queue helps with inter-process communication, but it is limited to basically allow communication between only 2 applications? I'm asking this because for example MSMQ ...
- 38.5k
0
votes
0
answers
47
views
Message sent to RabbitMQ exchange is not passed to the bound queue
I'm new to message brokers and feel quite confused. The task is to send changes from PostgreSQL table to a RabbitMQ as a no-code solution. The instrument chosen is pg-bifrost. I took a look at the ...
1
vote
2
answers
2k
views
How to subscribe to multiple topics (at least 2) and republish the message recieved to a single topic with Mosquitto MQTT using linux shell comands
Iam trying to figure out a way to subscribe to multiple topics, and then after receiving a message the function should publish it to a different broker depending on the topic.
I've thought of ...
0
votes
0
answers
144
views
VerneMQ handling client disconnections in a clustered environment
VerneMQ broker with 3 nodes A,B and C is deployed in Kubernetes with clustering enabled. Assume that a client x is connected to Node B. A request to disconnect client x is sent to the broker and the ...
- 139
146
votes
4
answers
87k
views
What's the purpose of Kafka's key/value pair-based messaging?
All of the examples of Kafka | producers show the ProducerRecord's key/value pair as not only being the same type (all examples show <String,String>), but the same value. For example:
producer....
- 1
3
votes
2
answers
6k
views
How do I get RabbitMQ to read from the queue one by one?
I am just playing with RabbitMQ and trying to get a test sender and receiver set up in two C# projects.
TestSender.cs
using System;
using RabbitMQ.Client;
using System.Text;
public class ...
0
votes
2
answers
572
views
SQL queue doesn't start activation procedure SQL Server
SQL Server 2019
I'm trying to start stored procedures from a trigger (so that the trigger stays lean) to process data in some production facility. Working with queues/messages etc is new to me
I've ...
- 13
0
votes
2
answers
202
views
ESQL : Extracting Unique Elements from Recurring XML Segment
I am facing a challenge with ESQL code. I have an XML message that contains a recurring segment, and I need to extract unique values from a specific element within that segment. Following is the input ...
- 2,420
2
votes
2
answers
190
views
MQTT handleMessage Function Not Invoked Despite Subscription
I'm working on a Go application that subscribes to an MQTT topic and processes incoming messages using a handleMessage function. However, I'm encountering an issue where the handleMessage function is ...
- 141
3
votes
1
answer
1k
views
RabbitMQ auto-delete queues with timeouts
I have a k8s service, using rabbitMQ as message broker.
I want to be able to delete a specific queue if the service deployment which may have multiple pods is stopped.
Reading the documentation ...
- 950
2
votes
2
answers
9k
views
Is the character § supported by CCSID 1208
I need to know if the character § is supported by CCSID 1208. In general, How do we find the list of characters supported by a particular CCSID.
Thanks
- 6,280
0
votes
3
answers
3k
views
With the clear session flag set to FALSE, I am missing the published values
Is anyone has a logical explanation why despite I have the clear session flage = false I do not receive the updated published message I am subscribed to while i am not connected to the broker?
With ...
- 168
2
votes
1
answer
370
views
Consume service bus message after x time
I'm doing a project to study more of brokers and i'm using .NET 6.0 and Service bus to do this.
My question is: I need to publish a message and consume the same message only after a few time (i put ...
- 12k
0
votes
0
answers
326
views
Build Mosquitto (MQTT broker) on Ubuntu
I'm trying to build mosquitto from the source code (which is in the official github repository). After resolving some dependencies make install finishes without errors.
However, when testing ...
- 36.3k
0
votes
1
answer
1k
views
Sticky Sessions with Message Broker
I'm working on a project where we are trying to utilize message brokering where after a type message starts going to a given consumer, it continues to go to that consumer. This is essentially the same ...
- 33.6k
0
votes
1
answer
91
views
Does RabbitMQ keeps an open connection for the consumer?
I am trying to implement a RabbitMQ solution in an environment where all connections have to be started from the secure zone to the less secure zone.
The standard RabbitMQ implementation foresees the ...
- 33.6k
-1
votes
2
answers
526
views
Message Broker for Custom Messaging Protocols? [closed]
Is there any framework or platform that is providing message exchange in reliable, flexible, and scalable manner? Where I have the following scenario:
I have external devices exchanging messages with ...
- 36.3k
0
votes
2
answers
286
views
How to get only the last message in a group in Apache ActiveMQ "Classic"?
Scenario:
Users are taking a long quiz. I store the current score and location in the quiz after each interaction. I want to store in the DB only the last interaction the user did during this current ...
- 4,336