265 questions
2
votes
1
answer
72
views
Sending a custom event to DLQ topic using @RetryableTopic
I’m using Spring Boot with Kafka and the @RetryableTopic annotation.
What I want to achieve:
Messages that end up in the DLQ should instead be wrapped in a custom type (DlqEventWrapper) that includes ...
- 280
0
votes
1
answer
43
views
Can the dead letter queue be ordered by date?
I am an integration tester on a project that has only just started using Azure Service Bus Topics and although I have permission to view the Dead Letter Queue, it's becoming difficult to find the ...
-1
votes
1
answer
75
views
How to use custom queue name for a poison queue?
For items in an Azure queue that my application cannot process, I want them in a dead letter queue.
Ignoring the differences between a DLQ and a PMQ, we only want to be able to deal with two queues. ...
- 1,346
0
votes
1
answer
57
views
Why is my actor ask getting dead letters?
Background:
I have the following flow process:
Peer Actor on one instance generated and sends a PeerRequest proto (via http) to another instance
The PeerServer receives and process the request
It ...
- 923
0
votes
1
answer
571
views
Pubsub message goes to dead letter immediately without any consuming attempt
I'm currently facing problem where sometimes when a pubsub message is published, the message goes straight into the dead letter, without any attempt to deliver it to the corresponding subscriber.
The ...
0
votes
1
answer
142
views
How to pass ServiceBusReceivedMessage as an input to the Azure Durable function activity?
I'm trying to move ServiceBus triggered message to deadletter queue inside once of the Azure durable function activity.
[FunctionName(nameof(CaviContainerStart))]
public async Task CaviContainerStart(
...
0
votes
1
answer
499
views
Resubmitting messages from deadletter on Azure service bus on Topic queue with partitioning and duplicate detection enabled
I am trying to resubmit messages from the deadletter queue on a Azure service bus that is configured with a topic queue that has partitioning and duplicate detection enabled.
When I try to add one or ...
- 85
2
votes
1
answer
698
views
When using 'x-max-length' and 'x-overflow', how to send to dead-letter-exchange
According to the internet (my question is at the bottom), when using the drop-head overflow behavior in RabbitMQ, it's important to understand that this behavior is distinct from the mechanisms that ...
- 102k
0
votes
0
answers
63
views
Apache Camel persist failed messages to Postgresql dead letter table
I'm using Apache Camel to build integrations, and I want to persist failed messages so I can build the UI and allow user to redeliver / reprocess them when they decide it's time to do it.
I have a ...
- 105
0
votes
1
answer
355
views
PubSub BigQuery Subscription issues
I have set up a PubSub BigQuery Subscription. My topic has a schema, and I am able to succesfully write to the BigQuery table.
I have been stress testing the workflow to ensure that all messages sent ...
- 1
0
votes
1
answer
168
views
Error implementing C# .NET 7 RestAPI RabbitMQ - MassTransit Dead Letter Queue (DLQ)
I'm trying to get better at using micro services and I'm stuck on something. I'm working with:
ASP.NET Core 7 Web API (for the micro services)
C#
SQL Server
RabbitMQ and MassTransit
Docker compose (...
- 45
-1
votes
1
answer
115
views
AWS DLQ for two consumers, what is best practice? [closed]
Have Consumer that should process DLQ queue messages also want additionally log information about messages that come to DLQ by Lambda.
See two possible solutions.
from these two solutions on image ...
- 1,374
0
votes
1
answer
66
views
does rabbitmq support delay queue for different ttl message by ttl and dead letter?
Why I got message which is set 10min ttl before the 20min ttl message which is sent early than the 10min ttl message?
I expect that get 20min message firstly, and then get 10min message secondly.
...
- 11
0
votes
1
answer
614
views
How to ensure ordered delivery of messages on a session enabled queue/subscription when dead lettering happens in Azure Service Bus
I am working on building an integration project which involves the usage of Azure Service Bus Topic subscriptions and an Azure Function app subscribing to the topic. My essential requirement is to ...
- 1,132
0
votes
1
answer
186
views
MSMQ: dead-letter messages and transactional dead-letter messages
MSMQ system queues include a) journal messages, b) dead-letter messages, c) transactional dead-letter messages.
In "Journal messages" there are all journal messages of private queues.
I have ...
- 11
0
votes
0
answers
437
views
How can I subscribe to the Azure Service Bus deadletter queue in MassTransit?
I'm new to MassTransit and Azure Service Bus.
When a received message fails due to an unexpected exception, or maybe an unlucky power failure, I would like the message to go to the deadletter queue (...
2
votes
0
answers
130
views
RabbitMQ - How to setup dead letter queue to autodelete?
Is there posibility to setup RabbitMQ dead-letter queue to auto-deleteing itself when has no waiting messages to re-deliever?
I have dead-letter queue with arguments:
x-message-ttl: 15000
x-dead-...
0
votes
0
answers
191
views
How to increase the consumption speed of Kafka consumer with multiple listener topics?
I have a kafka consumer class which has 2 listener TOPICS and a DLQ listener. When load testing with million records i.e.producing 15 requests per second that reaches topic-1 and 1 request per second ...
- 37
0
votes
1
answer
2k
views
Pub/Sub: How to retrieve messages sent to a dead-letter-topic and store them into a BigQuery table?
For context
We currently have a data mining script which collects a massive throughput of event data and publishes it to a Pub/Sub topic with a schema enforcement (with all fields being optional). A ...
- 179
1
vote
1
answer
301
views
How does Azure Dead-Lettered Message count work in Service Bus Standard Metrics?
I configured azure metric alert when there is a dead-lettered message in a specific topic.
The dead-lettered queue only has one message but I discovered that when using Average, it is not always ...
- 69
0
votes
1
answer
101
views
Can pubsub messages go to the dead letter queue even if they succeed with the main subscriber?
I have a topic that delivers to a push subscription with ordering keys enabled. The retry limit is about 15 with exponential backoff up to 10 minutes.
It looks like some messages are being processed ...
- 2,080
1
vote
1
answer
313
views
Does google pub sub deliver messages to dead letter queues with the same message id?
If you have topic t1 with subscriber s1 and s1 has dead letter forwarding to topic t2 with subscription s2, then do messages delivered to s1 have the same ids as their versions delivered to s2?
My ...
- 2,080
0
votes
1
answer
117
views
How to test extended kafkaListener with custom element?
My dev env :
Java 8
spring-kafka - 2.6.1
spring-kafka-test- 2.6.7
spring-boot - 2.3.10
Rest API to send message
@PostMapping(
value = {"publish"})
@ExternalApi
public ResponseEntity&...
- 5
5
votes
2
answers
3k
views
Dead letter queue for cloud tasks
Is it possible to create Dead letter queue for cloud tasks (GCP) ?
I am using cloud tasks instead of pub/sub to have control over the concurrent massages send. However, unlike pub/sub, cloud task ...
- 51
0
votes
1
answer
1k
views
RabbitMQ dead letter queue housekeeping
I have a RabbitMQ instance that has an exchange, a regular queue and a dead letter queue. Rejected messages are moved from the regular queue to the dead letter queue.
These rejected messages are not ...
- 21