Run tasks in a batch
I am trying to understand System.Task
, but I am not sure if what I am doing is correct. My goal is to write a method to process images parallel in a batch.
Is my understanding correct, that in case of batchSize = 3
the method will queue 3 tasks and run all 3 tasks in parallel as soon as Task.WaitAll()
being called ?
Is there are more elegant way if doing it ?
private static void ProcessImages(int batchSize)
List<Task> tasks = new List<Task>();
foreach (var image in ImageSource.ReadImages())
if(tasks.Count < batchSize)
tasks.Add(Task.Run(() => ImageProcessor.ProcessImage(image)));
else
Task.WaitAll(tasks.ToArray());
tasks.Clear();
c# task task-parallel-library
add a comment |
I am trying to understand System.Task
, but I am not sure if what I am doing is correct. My goal is to write a method to process images parallel in a batch.
Is my understanding correct, that in case of batchSize = 3
the method will queue 3 tasks and run all 3 tasks in parallel as soon as Task.WaitAll()
being called ?
Is there are more elegant way if doing it ?
private static void ProcessImages(int batchSize)
List<Task> tasks = new List<Task>();
foreach (var image in ImageSource.ReadImages())
if(tasks.Count < batchSize)
tasks.Add(Task.Run(() => ImageProcessor.ProcessImage(image)));
else
Task.WaitAll(tasks.ToArray());
tasks.Clear();
c# task task-parallel-library
add a comment |
I am trying to understand System.Task
, but I am not sure if what I am doing is correct. My goal is to write a method to process images parallel in a batch.
Is my understanding correct, that in case of batchSize = 3
the method will queue 3 tasks and run all 3 tasks in parallel as soon as Task.WaitAll()
being called ?
Is there are more elegant way if doing it ?
private static void ProcessImages(int batchSize)
List<Task> tasks = new List<Task>();
foreach (var image in ImageSource.ReadImages())
if(tasks.Count < batchSize)
tasks.Add(Task.Run(() => ImageProcessor.ProcessImage(image)));
else
Task.WaitAll(tasks.ToArray());
tasks.Clear();
c# task task-parallel-library
I am trying to understand System.Task
, but I am not sure if what I am doing is correct. My goal is to write a method to process images parallel in a batch.
Is my understanding correct, that in case of batchSize = 3
the method will queue 3 tasks and run all 3 tasks in parallel as soon as Task.WaitAll()
being called ?
Is there are more elegant way if doing it ?
private static void ProcessImages(int batchSize)
List<Task> tasks = new List<Task>();
foreach (var image in ImageSource.ReadImages())
if(tasks.Count < batchSize)
tasks.Add(Task.Run(() => ImageProcessor.ProcessImage(image)));
else
Task.WaitAll(tasks.ToArray());
tasks.Clear();
c# task task-parallel-library
c# task task-parallel-library
asked Nov 11 '18 at 3:40
koryakinpkoryakinp
1,68021038
1,68021038
add a comment |
add a comment |
2 Answers
2
active
oldest
votes
Is my understanding correct, that in case of batchSize = 3 the method
will queue 3 tasks and run all 3 tasks in parallel as soon as
Task.WaitAll() being called ?
While the idea to add tasks to the list and then Task.WaitAll()
these tasks is correct, your code is unfortunatelly buggy and will not work as expected. Specifically, it will NOT execute tasks for images that follows after each batch and also it will NOT execute tasks for images in the last batch, if number of images is not divisible by batchSize+1
.
Is there are more elegant way if doing it ?
Fortunatelly, executing tasks in batches is very common requirement, so .NET already contains methods that makes it much easier. With PLINQ it is as simple as this:
ImageSource.ReadImages()
.AsParallel()
.WithDegreeOfParallelism(batchSize)
.ForAll(image => ImageProcessor.ProcessImage(image));
add a comment |
Another option is to use Microsoft's Reactive Framework (NuGet "System.Reactive").
Then this works:
ImageSource
.ReadImages()
.ToObservable()
.Select(image => Observable.Start(() => ImageProcessor.ProcessImage(image)))
.Merge(maxConcurrent: 3)
.Wait();
IMHO the Reactive Framework is far more powerful than tasks.
add a comment |
Your Answer
StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53245639%2frun-tasks-in-a-batch%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
2 Answers
2
active
oldest
votes
2 Answers
2
active
oldest
votes
active
oldest
votes
active
oldest
votes
Is my understanding correct, that in case of batchSize = 3 the method
will queue 3 tasks and run all 3 tasks in parallel as soon as
Task.WaitAll() being called ?
While the idea to add tasks to the list and then Task.WaitAll()
these tasks is correct, your code is unfortunatelly buggy and will not work as expected. Specifically, it will NOT execute tasks for images that follows after each batch and also it will NOT execute tasks for images in the last batch, if number of images is not divisible by batchSize+1
.
Is there are more elegant way if doing it ?
Fortunatelly, executing tasks in batches is very common requirement, so .NET already contains methods that makes it much easier. With PLINQ it is as simple as this:
ImageSource.ReadImages()
.AsParallel()
.WithDegreeOfParallelism(batchSize)
.ForAll(image => ImageProcessor.ProcessImage(image));
add a comment |
Is my understanding correct, that in case of batchSize = 3 the method
will queue 3 tasks and run all 3 tasks in parallel as soon as
Task.WaitAll() being called ?
While the idea to add tasks to the list and then Task.WaitAll()
these tasks is correct, your code is unfortunatelly buggy and will not work as expected. Specifically, it will NOT execute tasks for images that follows after each batch and also it will NOT execute tasks for images in the last batch, if number of images is not divisible by batchSize+1
.
Is there are more elegant way if doing it ?
Fortunatelly, executing tasks in batches is very common requirement, so .NET already contains methods that makes it much easier. With PLINQ it is as simple as this:
ImageSource.ReadImages()
.AsParallel()
.WithDegreeOfParallelism(batchSize)
.ForAll(image => ImageProcessor.ProcessImage(image));
add a comment |
Is my understanding correct, that in case of batchSize = 3 the method
will queue 3 tasks and run all 3 tasks in parallel as soon as
Task.WaitAll() being called ?
While the idea to add tasks to the list and then Task.WaitAll()
these tasks is correct, your code is unfortunatelly buggy and will not work as expected. Specifically, it will NOT execute tasks for images that follows after each batch and also it will NOT execute tasks for images in the last batch, if number of images is not divisible by batchSize+1
.
Is there are more elegant way if doing it ?
Fortunatelly, executing tasks in batches is very common requirement, so .NET already contains methods that makes it much easier. With PLINQ it is as simple as this:
ImageSource.ReadImages()
.AsParallel()
.WithDegreeOfParallelism(batchSize)
.ForAll(image => ImageProcessor.ProcessImage(image));
Is my understanding correct, that in case of batchSize = 3 the method
will queue 3 tasks and run all 3 tasks in parallel as soon as
Task.WaitAll() being called ?
While the idea to add tasks to the list and then Task.WaitAll()
these tasks is correct, your code is unfortunatelly buggy and will not work as expected. Specifically, it will NOT execute tasks for images that follows after each batch and also it will NOT execute tasks for images in the last batch, if number of images is not divisible by batchSize+1
.
Is there are more elegant way if doing it ?
Fortunatelly, executing tasks in batches is very common requirement, so .NET already contains methods that makes it much easier. With PLINQ it is as simple as this:
ImageSource.ReadImages()
.AsParallel()
.WithDegreeOfParallelism(batchSize)
.ForAll(image => ImageProcessor.ProcessImage(image));
answered Nov 11 '18 at 5:51
ŇufŇuf
4,85921222
4,85921222
add a comment |
add a comment |
Another option is to use Microsoft's Reactive Framework (NuGet "System.Reactive").
Then this works:
ImageSource
.ReadImages()
.ToObservable()
.Select(image => Observable.Start(() => ImageProcessor.ProcessImage(image)))
.Merge(maxConcurrent: 3)
.Wait();
IMHO the Reactive Framework is far more powerful than tasks.
add a comment |
Another option is to use Microsoft's Reactive Framework (NuGet "System.Reactive").
Then this works:
ImageSource
.ReadImages()
.ToObservable()
.Select(image => Observable.Start(() => ImageProcessor.ProcessImage(image)))
.Merge(maxConcurrent: 3)
.Wait();
IMHO the Reactive Framework is far more powerful than tasks.
add a comment |
Another option is to use Microsoft's Reactive Framework (NuGet "System.Reactive").
Then this works:
ImageSource
.ReadImages()
.ToObservable()
.Select(image => Observable.Start(() => ImageProcessor.ProcessImage(image)))
.Merge(maxConcurrent: 3)
.Wait();
IMHO the Reactive Framework is far more powerful than tasks.
Another option is to use Microsoft's Reactive Framework (NuGet "System.Reactive").
Then this works:
ImageSource
.ReadImages()
.ToObservable()
.Select(image => Observable.Start(() => ImageProcessor.ProcessImage(image)))
.Merge(maxConcurrent: 3)
.Wait();
IMHO the Reactive Framework is far more powerful than tasks.
answered Nov 12 '18 at 12:32
EnigmativityEnigmativity
75.3k864130
75.3k864130
add a comment |
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53245639%2frun-tasks-in-a-batch%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown