Cloudera SQL Stream Builder Introducing DLQ
Yesterday one of my customers asked about the ability to control deserialization errors in SSB applications. Referencing our Dead Letter Queue Documentation within the Deserialize Tab we can see there are quite a few options for exception handling:
This is actually a very important feature. In production streaming applications, operators may not have realtime insights into data shapes that do not fit expected schema. These exceptions need to be trapped versus ignored. The Dead Letter Queue is how you trap those exceptions in a different Kafka Topic.
Check out this blog that goes into detailed explanation of configuring Dead Letter Queues for your Virtual Kafka Tables. Using Dead Letter Queues with Sql Stream Builder
Check out Streaming SQL Console:
As always, check out the docs: