A notification service is a system responsible for delivering timely and relevant information to users across various channels such as SMS, email, push notifications, and in-app messages.
This was quite amazing and super super helpful. I am an experienced coder but have not had many opportunities to design high scale systems at work or in practice so this is going to help me a ton.
Exactly once delivery semantics are mentioned but not explained. Can you please add some detail to describe how the system will achieve exactly once delivery, as well as the tradeoffs for doing so? Thanks!
I'm really interested to know how you gonna scale the consumer because on average 17,000 notifications/second and lets assume 10k are getting consumed at the same time. How the poller/consumer picking the notifications from topic will scale it and so does the database choice and IO for getting the data from DB.
You can use different queues for each channel. For example, an EmailNotification can use an EmailMessagingQueue, and so on. This way, the load will be distributed across multiple queues, preventing a single point of failure. At extremely large scale, we should also create separate services such as an EmailNotificationService and a PushNotificationService.
This is awesome content. Just few points to add on if you agree:
1) Syncing mechanisms between Cache and User Preferences NoSQL db to ensure consistency
2) How does Cache payload look like along with the key
3) Cache TTL, eviction strategy, invalidation strategy, cache writing strategy, dealing with a data level conflict (discrepancy between current cache and NoSQL db entry)
4) Deduplication of notification so that users don’t get same notification again
very nicely explained, specially the details of request message and types of db usage, the way notification service is crafting the message for individual channel. learning alot from you.
This was quite amazing and super super helpful. I am an experienced coder but have not had many opportunities to design high scale systems at work or in practice so this is going to help me a ton.
Really happy to hear this, thank you so much!
Thanks Man, its really helpful!
Nice one Ashish 👍🏻
Excellent study case, Ashish!
Impressive! You are truly a gem. Thank you for dedicating your time and sharing such valuable content with crystal-clear clarity.
Thank you 😊
Love to hear this.
Great content brother
thank you!
Thanks for sharing.
you are welcome!
Exactly once delivery semantics are mentioned but not explained. Can you please add some detail to describe how the system will achieve exactly once delivery, as well as the tradeoffs for doing so? Thanks!
I'm really interested to know how you gonna scale the consumer because on average 17,000 notifications/second and lets assume 10k are getting consumed at the same time. How the poller/consumer picking the notifications from topic will scale it and so does the database choice and IO for getting the data from DB.
You can use different queues for each channel. For example, an EmailNotification can use an EmailMessagingQueue, and so on. This way, the load will be distributed across multiple queues, preventing a single point of failure. At extremely large scale, we should also create separate services such as an EmailNotificationService and a PushNotificationService.
Let’s talk about implementing the notification service , with best design / architecture / patterns .
I would like to do it in rust .
Anyone interested to tag along ?
I am thinking to open source such components so lot others can benefit
let me know if you want to do it with java .
Ashish,
This is awesome content. Just few points to add on if you agree:
1) Syncing mechanisms between Cache and User Preferences NoSQL db to ensure consistency
2) How does Cache payload look like along with the key
3) Cache TTL, eviction strategy, invalidation strategy, cache writing strategy, dealing with a data level conflict (discrepancy between current cache and NoSQL db entry)
4) Deduplication of notification so that users don’t get same notification again
very well explained. can add more diagrams in detailed desigend section. thanks!!
Great Content Ashish. Really enjoyed the article.
Just started learning System Design, one question I have is, Publish/Subscribe is it used here?
Like when the notification is sent to the channel processor then we can send that from there to the client using Publish/Subscribe?
what db for what is unclear for more , like I don't know about scheduler service fetches from SQl or NOSQL
very nicely explained, specially the details of request message and types of db usage, the way notification service is crafting the message for individual channel. learning alot from you.