Acquire lease on the same azure blob at the same time
Noticed the following behavior in my team’s application:
Multiple threads trying to acquire the lease on the same blob using the line below:
await blob.AcquireLeaseAsync(TimeSpan.FromSeconds(lockTime), null, null, new BlobRequestOptions() RetryPolicy = RetryPolicy , null);
Multiple threads got a lease successfully, each got a different lease, around the same time.
This is because AcquireLeaseAsync is NOT thread-safe right?
I thought lease is a lock, so it can only be granted to one thread at a time?
We tried to add an access condition of lease ID being null, which seems to be helpful.
await blob.AcquireLeaseAsync(TimeSpan.FromSeconds(lockTime), null, new AccessCondition LeaseId = null, new BlobRequestOptions() RetryPolicy = RetryPolicy , null);
But not sure if it’s fool-proof, i.e is there a chance multiple threads can pass this access condition when trying to acquire lease on the blob?
Below is the code that I use to generate this issue:
class Program
static void Main(string args)
Console.WriteLine("started");
var storageConnStr = "";
var client = CloudStorageAccount.Parse(storageConnStr).CreateCloudBlobClient();
var container = client.GetContainerReference("test");
var blob = container.GetBlobReference("Program.cs");
List<Task> list = new List<Task>();
for (int i = 0; i < 100; i++)
list.Add(Task.Run(() => AcquireLease(blob)));
Task.WhenAll(list).Wait();
static void AcquireLease(CloudBlob blob)
try
var id = blob.AcquireLeaseAsync(TimeSpan.FromSeconds(30), null, null, null, null).Result;
Console.WriteLine($"Successfully acquired lease on thread Thread.CurrentThread.ManagedThreadId, lease id id, time is DateTime.UtcNow");
catch (Exception)
Console.WriteLine($"Got exception at Thread.CurrentThread.ManagedThreadId");
Sample output:
Successfully acquired lease on thread 86, lease id
dfbd393e-46e2-49dc-98f4-853356fbc255, time is 11/10/2018 2:16:57 AM
Successfully acquired lease on thread 22, lease id
f81b3dbf-68f6-401d-b82e-a1c19fb3527c, time is 11/10/2018 2:16:57 AM
Successfully acquired lease on thread 54, lease id
6c05c2ee-c5a5-4d4e-83a9-b65688fca6df, time is 11/10/2018 2:16:57 AM
c# multithreading azure azure-storage-blobs
add a comment |
Noticed the following behavior in my team’s application:
Multiple threads trying to acquire the lease on the same blob using the line below:
await blob.AcquireLeaseAsync(TimeSpan.FromSeconds(lockTime), null, null, new BlobRequestOptions() RetryPolicy = RetryPolicy , null);
Multiple threads got a lease successfully, each got a different lease, around the same time.
This is because AcquireLeaseAsync is NOT thread-safe right?
I thought lease is a lock, so it can only be granted to one thread at a time?
We tried to add an access condition of lease ID being null, which seems to be helpful.
await blob.AcquireLeaseAsync(TimeSpan.FromSeconds(lockTime), null, new AccessCondition LeaseId = null, new BlobRequestOptions() RetryPolicy = RetryPolicy , null);
But not sure if it’s fool-proof, i.e is there a chance multiple threads can pass this access condition when trying to acquire lease on the blob?
Below is the code that I use to generate this issue:
class Program
static void Main(string args)
Console.WriteLine("started");
var storageConnStr = "";
var client = CloudStorageAccount.Parse(storageConnStr).CreateCloudBlobClient();
var container = client.GetContainerReference("test");
var blob = container.GetBlobReference("Program.cs");
List<Task> list = new List<Task>();
for (int i = 0; i < 100; i++)
list.Add(Task.Run(() => AcquireLease(blob)));
Task.WhenAll(list).Wait();
static void AcquireLease(CloudBlob blob)
try
var id = blob.AcquireLeaseAsync(TimeSpan.FromSeconds(30), null, null, null, null).Result;
Console.WriteLine($"Successfully acquired lease on thread Thread.CurrentThread.ManagedThreadId, lease id id, time is DateTime.UtcNow");
catch (Exception)
Console.WriteLine($"Got exception at Thread.CurrentThread.ManagedThreadId");
Sample output:
Successfully acquired lease on thread 86, lease id
dfbd393e-46e2-49dc-98f4-853356fbc255, time is 11/10/2018 2:16:57 AM
Successfully acquired lease on thread 22, lease id
f81b3dbf-68f6-401d-b82e-a1c19fb3527c, time is 11/10/2018 2:16:57 AM
Successfully acquired lease on thread 54, lease id
6c05c2ee-c5a5-4d4e-83a9-b65688fca6df, time is 11/10/2018 2:16:57 AM
c# multithreading azure azure-storage-blobs
3
I believe the issue is that you're firing an async operation but not waiting for its response. I am sure if you wait for it, you will get an exception that lease can't be acquired.
– Gaurav Mantri
Nov 10 at 6:09
@GauravMantri Thanks for the response. If you look at the code I used, I think I do wait for the async operation to complete.
– checai
Nov 10 at 23:36
blob.AcquireLeaseAsync(TimeSpan.FromSeconds(30), null, null, null, null).Result;
– checai
Nov 10 at 23:36
Also not sure why AcquireLeaseAsync depends on customer code to achieve leasing atomic?
– checai
Nov 10 at 23:38
add a comment |
Noticed the following behavior in my team’s application:
Multiple threads trying to acquire the lease on the same blob using the line below:
await blob.AcquireLeaseAsync(TimeSpan.FromSeconds(lockTime), null, null, new BlobRequestOptions() RetryPolicy = RetryPolicy , null);
Multiple threads got a lease successfully, each got a different lease, around the same time.
This is because AcquireLeaseAsync is NOT thread-safe right?
I thought lease is a lock, so it can only be granted to one thread at a time?
We tried to add an access condition of lease ID being null, which seems to be helpful.
await blob.AcquireLeaseAsync(TimeSpan.FromSeconds(lockTime), null, new AccessCondition LeaseId = null, new BlobRequestOptions() RetryPolicy = RetryPolicy , null);
But not sure if it’s fool-proof, i.e is there a chance multiple threads can pass this access condition when trying to acquire lease on the blob?
Below is the code that I use to generate this issue:
class Program
static void Main(string args)
Console.WriteLine("started");
var storageConnStr = "";
var client = CloudStorageAccount.Parse(storageConnStr).CreateCloudBlobClient();
var container = client.GetContainerReference("test");
var blob = container.GetBlobReference("Program.cs");
List<Task> list = new List<Task>();
for (int i = 0; i < 100; i++)
list.Add(Task.Run(() => AcquireLease(blob)));
Task.WhenAll(list).Wait();
static void AcquireLease(CloudBlob blob)
try
var id = blob.AcquireLeaseAsync(TimeSpan.FromSeconds(30), null, null, null, null).Result;
Console.WriteLine($"Successfully acquired lease on thread Thread.CurrentThread.ManagedThreadId, lease id id, time is DateTime.UtcNow");
catch (Exception)
Console.WriteLine($"Got exception at Thread.CurrentThread.ManagedThreadId");
Sample output:
Successfully acquired lease on thread 86, lease id
dfbd393e-46e2-49dc-98f4-853356fbc255, time is 11/10/2018 2:16:57 AM
Successfully acquired lease on thread 22, lease id
f81b3dbf-68f6-401d-b82e-a1c19fb3527c, time is 11/10/2018 2:16:57 AM
Successfully acquired lease on thread 54, lease id
6c05c2ee-c5a5-4d4e-83a9-b65688fca6df, time is 11/10/2018 2:16:57 AM
c# multithreading azure azure-storage-blobs
Noticed the following behavior in my team’s application:
Multiple threads trying to acquire the lease on the same blob using the line below:
await blob.AcquireLeaseAsync(TimeSpan.FromSeconds(lockTime), null, null, new BlobRequestOptions() RetryPolicy = RetryPolicy , null);
Multiple threads got a lease successfully, each got a different lease, around the same time.
This is because AcquireLeaseAsync is NOT thread-safe right?
I thought lease is a lock, so it can only be granted to one thread at a time?
We tried to add an access condition of lease ID being null, which seems to be helpful.
await blob.AcquireLeaseAsync(TimeSpan.FromSeconds(lockTime), null, new AccessCondition LeaseId = null, new BlobRequestOptions() RetryPolicy = RetryPolicy , null);
But not sure if it’s fool-proof, i.e is there a chance multiple threads can pass this access condition when trying to acquire lease on the blob?
Below is the code that I use to generate this issue:
class Program
static void Main(string args)
Console.WriteLine("started");
var storageConnStr = "";
var client = CloudStorageAccount.Parse(storageConnStr).CreateCloudBlobClient();
var container = client.GetContainerReference("test");
var blob = container.GetBlobReference("Program.cs");
List<Task> list = new List<Task>();
for (int i = 0; i < 100; i++)
list.Add(Task.Run(() => AcquireLease(blob)));
Task.WhenAll(list).Wait();
static void AcquireLease(CloudBlob blob)
try
var id = blob.AcquireLeaseAsync(TimeSpan.FromSeconds(30), null, null, null, null).Result;
Console.WriteLine($"Successfully acquired lease on thread Thread.CurrentThread.ManagedThreadId, lease id id, time is DateTime.UtcNow");
catch (Exception)
Console.WriteLine($"Got exception at Thread.CurrentThread.ManagedThreadId");
Sample output:
Successfully acquired lease on thread 86, lease id
dfbd393e-46e2-49dc-98f4-853356fbc255, time is 11/10/2018 2:16:57 AM
Successfully acquired lease on thread 22, lease id
f81b3dbf-68f6-401d-b82e-a1c19fb3527c, time is 11/10/2018 2:16:57 AM
Successfully acquired lease on thread 54, lease id
6c05c2ee-c5a5-4d4e-83a9-b65688fca6df, time is 11/10/2018 2:16:57 AM
c# multithreading azure azure-storage-blobs
c# multithreading azure azure-storage-blobs
edited Nov 10 at 5:36
Jayendran
3,20631336
3,20631336
asked Nov 10 at 2:49
checai
123128
123128
3
I believe the issue is that you're firing an async operation but not waiting for its response. I am sure if you wait for it, you will get an exception that lease can't be acquired.
– Gaurav Mantri
Nov 10 at 6:09
@GauravMantri Thanks for the response. If you look at the code I used, I think I do wait for the async operation to complete.
– checai
Nov 10 at 23:36
blob.AcquireLeaseAsync(TimeSpan.FromSeconds(30), null, null, null, null).Result;
– checai
Nov 10 at 23:36
Also not sure why AcquireLeaseAsync depends on customer code to achieve leasing atomic?
– checai
Nov 10 at 23:38
add a comment |
3
I believe the issue is that you're firing an async operation but not waiting for its response. I am sure if you wait for it, you will get an exception that lease can't be acquired.
– Gaurav Mantri
Nov 10 at 6:09
@GauravMantri Thanks for the response. If you look at the code I used, I think I do wait for the async operation to complete.
– checai
Nov 10 at 23:36
blob.AcquireLeaseAsync(TimeSpan.FromSeconds(30), null, null, null, null).Result;
– checai
Nov 10 at 23:36
Also not sure why AcquireLeaseAsync depends on customer code to achieve leasing atomic?
– checai
Nov 10 at 23:38
3
3
I believe the issue is that you're firing an async operation but not waiting for its response. I am sure if you wait for it, you will get an exception that lease can't be acquired.
– Gaurav Mantri
Nov 10 at 6:09
I believe the issue is that you're firing an async operation but not waiting for its response. I am sure if you wait for it, you will get an exception that lease can't be acquired.
– Gaurav Mantri
Nov 10 at 6:09
@GauravMantri Thanks for the response. If you look at the code I used, I think I do wait for the async operation to complete.
– checai
Nov 10 at 23:36
@GauravMantri Thanks for the response. If you look at the code I used, I think I do wait for the async operation to complete.
– checai
Nov 10 at 23:36
blob.AcquireLeaseAsync(TimeSpan.FromSeconds(30), null, null, null, null).Result;
– checai
Nov 10 at 23:36
blob.AcquireLeaseAsync(TimeSpan.FromSeconds(30), null, null, null, null).Result;
– checai
Nov 10 at 23:36
Also not sure why AcquireLeaseAsync depends on customer code to achieve leasing atomic?
– checai
Nov 10 at 23:38
Also not sure why AcquireLeaseAsync depends on customer code to achieve leasing atomic?
– checai
Nov 10 at 23:38
add a comment |
active
oldest
votes
Your Answer
StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53235616%2facquire-lease-on-the-same-azure-blob-at-the-same-time%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
active
oldest
votes
active
oldest
votes
active
oldest
votes
active
oldest
votes
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Some of your past answers have not been well-received, and you're in danger of being blocked from answering.
Please pay close attention to the following guidance:
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53235616%2facquire-lease-on-the-same-azure-blob-at-the-same-time%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
3
I believe the issue is that you're firing an async operation but not waiting for its response. I am sure if you wait for it, you will get an exception that lease can't be acquired.
– Gaurav Mantri
Nov 10 at 6:09
@GauravMantri Thanks for the response. If you look at the code I used, I think I do wait for the async operation to complete.
– checai
Nov 10 at 23:36
blob.AcquireLeaseAsync(TimeSpan.FromSeconds(30), null, null, null, null).Result;
– checai
Nov 10 at 23:36
Also not sure why AcquireLeaseAsync depends on customer code to achieve leasing atomic?
– checai
Nov 10 at 23:38