Hello All,
Reposting after the question was booted from another post!
I wanted to know if the number of background workers can be configured in a server app?
Scenario:
Data feeds are generated at a very high rate by producers. These are placed on a queue which will be monitored by a background task. This background task will have to unmarshall the data feed, process it and insert relevant records to a high performance DB. I can see the potential of the queue growing to a large size because there being only one thread to process the incoming data feeds.
I know in my project, I can simply take out the processing bits from the web application and create a standalone program that reads items from the queue. Then I can launch this program N times to perform the data feed processing. This might actually be a better option in terms of scaling the application horizontally and can potentially be automated using elastic cloud management tools.
But wanted to know if we can increase the number of threads with AddBackgroundWorker?
Thanks.
Reposting after the question was booted from another post!
I wanted to know if the number of background workers can be configured in a server app?
Scenario:
Data feeds are generated at a very high rate by producers. These are placed on a queue which will be monitored by a background task. This background task will have to unmarshall the data feed, process it and insert relevant records to a high performance DB. I can see the potential of the queue growing to a large size because there being only one thread to process the incoming data feeds.
I know in my project, I can simply take out the processing bits from the web application and create a standalone program that reads items from the queue. Then I can launch this program N times to perform the data feed processing. This might actually be a better option in terms of scaling the application horizontally and can potentially be automated using elastic cloud management tools.
But wanted to know if we can increase the number of threads with AddBackgroundWorker?
Thanks.