Scenario 2 - Parallel processing without duplicates

We have a producer service that produces service requests and more than one consumer can process those requests in parallel, but the same service request should not be delivered to more than one consumer.

Approach: We can use SQS as the service router between the producer service and consumer services as follows:

  1. The producer publishes messages to SQS
  2. SQS delivers each message only to one of the consumers (fan-out)
  3. Multiple consumers publish their results to another service, such as S3 or DynamoDB, and results are aggregated (fan-in)
..................Content has been hidden....................

You can't read the all page of ebook, please click here login for view all page.
Reset
3.140.197.136