IOfflineNumberCommitTo3E.Run

// Job ID: #1133035
using AG.A1.Scheduler.Project.Contracts.Contracts.Number;

var offlineNumberCommitTo3E = Activate<IOfflineNumberCommitTo3E>();
await offlineNumberCommitTo3E.Run(null, null);

Parameters

CurrentCulture
"en-US"
CurrentUICulture
"en-US"
RecurringJobId
"NUMBER-Offline-Commit-Number-To-3E-Task"
RetryCount
10
Time
1764810069

State

12/4/2025 5:52:30 AM (+1m 40.150s) Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: The operation was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
 ---> System.IO.IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request..
 ---> System.Net.Sockets.SocketException (995): The I/O operation has been aborted because of either a thread exit or an application request.
   --- End of inner exception stack trace ---
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token)
   at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](TIOAdapter adapter)
   at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](TIOAdapter adapter, Memory`1 buffer)
   at System.Net.Http.HttpConnection.FillAsync(Boolean async)
   at System.Net.Http.HttpConnection.ChunkedEncodingReadStream.CopyToAsyncCore(Stream destination, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpConnection.ChunkedEncodingReadStream.CopyToAsyncCore(Stream destination, CancellationToken cancellationToken)
   at System.IO.Compression.DeflateStream.CopyToStream.CopyFromSourceToDestinationAsync()
   at System.Net.Http.DecompressionHandler.DecompressedContent.SerializeToStreamAsync(Stream stream, TransportContext context, CancellationToken cancellationToken)
   at System.Net.Http.HttpContent.LoadIntoBufferAsyncCore(Task serializeToStreamTask, MemoryStream tempBuffer)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 389
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 210
   at AG.Integrations.RESTClients.AlliantOneApiREST.NumberControllers.NumberA1ApiClientController.GetNumbersForOfflineCommit() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\AlliantOneApiREST\NumberControllers\NumberA1ApiClientController.cs:line 104
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Commands.OfflineNumberCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Commands\OfflineNumberCommitTo3ECommandHandler.cs:line 25
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+27ms Processing

Server:
dw0sdwk000fbp:4304
Worker:
61bd479d
+34msOfflineNumberCommitTo3ECommandHandler - Started

+1h 49m Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+10ms Scheduled

Retry attempt 10 of 10: The request was canceled due to the configured Ht…

Enqueue at:
12/4/2025 5:50:44 AM

+1m 40.310s Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: The operation was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
 ---> System.IO.IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request..
 ---> System.Net.Sockets.SocketException (995): The I/O operation has been aborted because of either a thread exit or an application request.
   --- End of inner exception stack trace ---
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token)
   at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](TIOAdapter adapter)
   at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](TIOAdapter adapter, Memory`1 buffer)
   at System.Net.Http.HttpConnection.FillAsync(Boolean async)
   at System.Net.Http.HttpConnection.CopyToContentLengthAsync(Stream destination, Boolean async, UInt64 length, Int32 bufferSize, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnection.ContentLengthReadStream.CompleteCopyToAsync(Task copyTask, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpConnection.ContentLengthReadStream.CompleteCopyToAsync(Task copyTask, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionResponseContent.SerializeToStreamAsync(Stream stream, TransportContext context, CancellationToken cancellationToken)
   at System.Net.Http.HttpContent.LoadIntoBufferAsyncCore(Task serializeToStreamTask, MemoryStream tempBuffer)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 389
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 210
   at AG.Integrations.RESTClients.AlliantOneApiREST.NumberControllers.NumberA1ApiClientController.GetNumbersForOfflineCommit() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\AlliantOneApiREST\NumberControllers\NumberA1ApiClientController.cs:line 102
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Commands.OfflineNumberCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Commands\OfflineNumberCommitTo3ECommandHandler.cs:line 25
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+170ms Processing

Server:
dw0sdwk000fbp:4304
Worker:
7e19962d
+252msOfflineNumberCommitTo3ECommandHandler - Started

+1h 13m Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+14ms Scheduled

Retry attempt 9 of 10: The request was canceled due to the configured Ht…

Enqueue at:
12/4/2025 3:59:14 AM

+1m 40.520s Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: A task was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: A task was canceled.
   at System.Net.Http.HttpConnection.CopyToContentLengthAsync(Stream destination, Boolean async, UInt64 length, Int32 bufferSize, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnection.ContentLengthReadStream.CompleteCopyToAsync(Task copyTask, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionResponseContent.SerializeToStreamAsync(Stream stream, TransportContext context, CancellationToken cancellationToken)
   at System.Net.Http.HttpContent.LoadIntoBufferAsyncCore(Task serializeToStreamTask, MemoryStream tempBuffer)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 389
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 210
   at AG.Integrations.RESTClients.AlliantOneApiREST.NumberControllers.NumberA1ApiClientController.GetNumbersForOfflineCommit() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\AlliantOneApiREST\NumberControllers\NumberA1ApiClientController.cs:line 102
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Commands.OfflineNumberCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Commands\OfflineNumberCommitTo3ECommandHandler.cs:line 25
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+33ms Processing

Server:
dw0sdwk000fbp:4304
Worker:
b39c806b
+48msOfflineNumberCommitTo3ECommandHandler - Started

+43m 47.110s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+3ms Scheduled

Retry attempt 8 of 10: The request was canceled due to the configured Ht…

Enqueue at:
12/4/2025 2:44:30 AM

+1m 40.257s Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: The operation was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
 ---> System.IO.IOException: The read operation failed, see inner exception.
 ---> System.ObjectDisposedException: Cannot access a disposed object.
Object name: 'SslStream'.
   at System.Net.Security.SslStream.<ThrowIfExceptional>g__ThrowExceptional|138_0(ExceptionDispatchInfo e)
   at System.Net.Security.SslStream.DecryptData(Int32 frameSize)
   at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](TIOAdapter adapter, Memory`1 buffer)
   --- End of inner exception stack trace ---
   at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](TIOAdapter adapter, Memory`1 buffer)
   at System.Net.Http.HttpConnection.FillAsync(Boolean async)
   at System.Net.Http.HttpConnection.ChunkedEncodingReadStream.CopyToAsyncCore(Stream destination, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpConnection.ChunkedEncodingReadStream.CopyToAsyncCore(Stream destination, CancellationToken cancellationToken)
   at System.IO.Compression.DeflateStream.CopyToStream.CopyFromSourceToDestinationAsync()
   at System.Net.Http.DecompressionHandler.DecompressedContent.SerializeToStreamAsync(Stream stream, TransportContext context, CancellationToken cancellationToken)
   at System.Net.Http.HttpContent.LoadIntoBufferAsyncCore(Task serializeToStreamTask, MemoryStream tempBuffer)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 389
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 210
   at AG.Integrations.RESTClients.AlliantOneApiREST.NumberControllers.NumberA1ApiClientController.GetNumbersForOfflineCommit() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\AlliantOneApiREST\NumberControllers\NumberA1ApiClientController.cs:line 102
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Commands.OfflineNumberCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Commands\OfflineNumberCommitTo3ECommandHandler.cs:line 25
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+37ms Processing

Server:
dw0sdwk000fbp:4304
Worker:
b39c806b
+57msOfflineNumberCommitTo3ECommandHandler - Started

+24m 53.023s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+7ms Scheduled

Retry attempt 7 of 10: The request was canceled due to the configured Ht…

Enqueue at:
12/4/2025 1:59:07 AM

+1m 40.206s Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: A task was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: A task was canceled.
   at System.IO.Compression.DeflateStream.CopyToStream.WriteAsyncCore(ReadOnlyMemory`1 buffer, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnection.ChunkedEncodingReadStream.CopyToAsyncCore(Stream destination, CancellationToken cancellationToken)
   at System.IO.Compression.DeflateStream.CopyToStream.CopyFromSourceToDestinationAsync()
   at System.Net.Http.DecompressionHandler.DecompressedContent.SerializeToStreamAsync(Stream stream, TransportContext context, CancellationToken cancellationToken)
   at System.Net.Http.HttpContent.LoadIntoBufferAsyncCore(Task serializeToStreamTask, MemoryStream tempBuffer)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 389
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 210
   at AG.Integrations.RESTClients.AlliantOneApiREST.NumberControllers.NumberA1ApiClientController.GetNumbersForOfflineCommit() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\AlliantOneApiREST\NumberControllers\NumberA1ApiClientController.cs:line 102
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Commands.OfflineNumberCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Commands\OfflineNumberCommitTo3ECommandHandler.cs:line 25
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+40ms Processing

Server:
dw0sdwk000fbp:4304
Worker:
61bd479d
+54msOfflineNumberCommitTo3ECommandHandler - Started

+10m 51.680s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+4ms Scheduled

Retry attempt 6 of 10: The request was canceled due to the configured Ht…

Enqueue at:
12/4/2025 1:32:41 AM

+1m 40.310s Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: The operation was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
 ---> System.IO.IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request..
 ---> System.Net.Sockets.SocketException (995): The I/O operation has been aborted because of either a thread exit or an application request.
   --- End of inner exception stack trace ---
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token)
   at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](TIOAdapter adapter)
   at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](TIOAdapter adapter, Memory`1 buffer)
   at System.Net.Http.HttpConnection.FillAsync(Boolean async)
   at System.Net.Http.HttpConnection.CopyToContentLengthAsync(Stream destination, Boolean async, UInt64 length, Int32 bufferSize, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnection.ContentLengthReadStream.CompleteCopyToAsync(Task copyTask, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpConnection.ContentLengthReadStream.CompleteCopyToAsync(Task copyTask, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionResponseContent.SerializeToStreamAsync(Stream stream, TransportContext context, CancellationToken cancellationToken)
   at System.Net.Http.HttpContent.LoadIntoBufferAsyncCore(Task serializeToStreamTask, MemoryStream tempBuffer)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 392
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 209
   at AG.Integrations.RESTClients.AlliantOneApiREST.NumberControllers.NumberA1ApiClientController.GetNumbersForOfflineCommit() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\AlliantOneApiREST\NumberControllers\NumberA1ApiClientController.cs:line 102
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Commands.OfflineNumberCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Commands\OfflineNumberCommitTo3ECommandHandler.cs:line 25
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+40ms Processing

Server:
dw0sdwk000fbp:4304
Worker:
8ac400f8
+157msOfflineNumberCommitTo3ECommandHandler - Started

+7m 5.470s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+16ms Scheduled

Retry attempt 5 of 10: The request was canceled due to the configured Ht…

Enqueue at:
12/4/2025 1:19:59 AM

+1m 40.180s Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: The operation was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
 ---> System.IO.IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request..
 ---> System.Net.Sockets.SocketException (995): The I/O operation has been aborted because of either a thread exit or an application request.
   --- End of inner exception stack trace ---
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token)
   at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](TIOAdapter adapter)
   at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](TIOAdapter adapter, Memory`1 buffer)
   at System.Net.Http.HttpConnection.InitialFillAsync(Boolean async)
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
   at System.Net.Http.DiagnosticsHandler.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 392
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 209
   at AG.Integrations.RESTClients.AlliantOneApiREST.NumberControllers.NumberA1ApiClientController.GetNumbersForOfflineCommit() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\AlliantOneApiREST\NumberControllers\NumberA1ApiClientController.cs:line 102
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Commands.OfflineNumberCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Commands\OfflineNumberCommitTo3ECommandHandler.cs:line 25
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+24ms Processing

Server:
dw0sdwk000fbp:4304
Worker:
7e19962d
+38msOfflineNumberCommitTo3ECommandHandler - Started

+2m 5.213s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+7ms Scheduled

Retry attempt 4 of 10: The request was canceled due to the configured Ht…

Enqueue at:
12/4/2025 1:11:10 AM

+1m 40.223s Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: The operation was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
 ---> System.IO.IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request..
 ---> System.Net.Sockets.SocketException (995): The I/O operation has been aborted because of either a thread exit or an application request.
   --- End of inner exception stack trace ---
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token)
   at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](TIOAdapter adapter)
   at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](TIOAdapter adapter, Memory`1 buffer)
   at System.Net.Http.HttpConnection.InitialFillAsync(Boolean async)
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
   at System.Net.Http.DiagnosticsHandler.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 392
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 209
   at AG.Integrations.RESTClients.AlliantOneApiREST.NumberControllers.NumberA1ApiClientController.GetNumbersForOfflineCommit() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\AlliantOneApiREST\NumberControllers\NumberA1ApiClientController.cs:line 102
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Commands.OfflineNumberCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Commands\OfflineNumberCommitTo3ECommandHandler.cs:line 25
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+40ms Processing

Server:
dw0sdwk000fbp:4304
Worker:
b39c806b
+81msOfflineNumberCommitTo3ECommandHandler - Started

+1m 34.030s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+17ms Scheduled

Retry attempt 3 of 10: The request was canceled due to the configured Ht…

Enqueue at:
12/4/2025 1:07:25 AM

+1m 41.396s Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: The operation was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
 ---> System.IO.IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request..
 ---> System.Net.Sockets.SocketException (995): The I/O operation has been aborted because of either a thread exit or an application request.
   --- End of inner exception stack trace ---
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token)
   at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](TIOAdapter adapter)
   at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](TIOAdapter adapter, Memory`1 buffer)
   at System.Net.Http.HttpConnection.InitialFillAsync(Boolean async)
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
   at System.Net.Http.DiagnosticsHandler.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 392
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 209
   at AG.Integrations.RESTClients.AlliantOneApiREST.NumberControllers.NumberA1ApiClientController.GetNumbersForOfflineCommit() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\AlliantOneApiREST\NumberControllers\NumberA1ApiClientController.cs:line 102
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Commands.OfflineNumberCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Commands\OfflineNumberCommitTo3ECommandHandler.cs:line 25
   at System.Runtime.CompilerServices.TaskAwaiter.GetResult()

+264ms Processing

Server:
dw0sdwk000fbp:4304
Worker:
61bd479d
+752msOfflineNumberCommitTo3ECommandHandler - Started

+1m 3.073s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+7ms Scheduled

Retry attempt 2 of 10: Could not load file or assembly 'AG.A1.Scheduler.…

Enqueue at:
12/4/2025 1:03:52 AM

+24.316s Failed

Can not change the state to 'Processing': target method was not found.

System.IO.FileNotFoundException

Could not load file or assembly 'AG.A1.Scheduler.Project.Contracts, Culture=neutral, PublicKeyToken=null'. The system cannot find the file specified.

System.IO.FileNotFoundException: Could not load file or assembly 'AG.A1.Scheduler.Project.Contracts, Culture=neutral, PublicKeyToken=null'. The system cannot find the file specified.
File name: 'AG.A1.Scheduler.Project.Contracts, Culture=neutral, PublicKeyToken=null'
   at System.Reflection.RuntimeAssembly.InternalLoad(ObjectHandleOnStack assemblyName, ObjectHandleOnStack requestingAssembly, StackCrawlMarkHandle stackMark, Boolean throwOnFileNotFound, ObjectHandleOnStack assemblyLoadContext, ObjectHandleOnStack retAssembly)
   at System.Reflection.Assembly.Load(AssemblyName assemblyRef)
   at Hangfire.Common.TypeHelper.AssemblyResolver(String assemblyString)
   at System.Collections.Concurrent.ConcurrentDictionary`2.GetOrAdd(TKey key, Func`2 valueFactory)
   at System.TypeNameParser.ResolveAssembly(String asmName, Func`2 assemblyResolver, Boolean throwOnError, StackCrawlMark& stackMark)
   at System.TypeNameParser.ConstructType(Func`2 assemblyResolver, Func`4 typeResolver, Boolean throwOnError, Boolean ignoreCase, StackCrawlMark& stackMark)
   at System.TypeNameParser.GetType(String typeName, Func`2 assemblyResolver, Func`4 typeResolver, Boolean throwOnError, Boolean ignoreCase, StackCrawlMark& stackMark)
   at System.Type.GetType(String typeName, Func`2 assemblyResolver, Func`4 typeResolver, Boolean throwOnError)
   at Hangfire.Common.TypeHelper.DefaultTypeResolver(String typeName)
   at Hangfire.Storage.InvocationData.DeserializeJob()

+40ms Processing

Server:
dw0sdwk000fbp:7432
Worker:
db03f867
+114msOfflineNumberCommitTo3ECommandHandler - Started

+50.414s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+3ms Scheduled

Retry attempt 1 of 10: Request failed with status code BadGateway

Enqueue at:
12/4/2025 1:02:42 AM

+55.073s Failed

An exception occurred during performance of the job.

System.Net.Http.HttpRequestException

Request failed with status code BadGateway

System.Net.Http.HttpRequestException: Request failed with status code BadGateway
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 389
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 210
   at AG.Integrations.RESTClients.AlliantOneApiREST.NumberControllers.NumberA1ApiClientController.GetNumbersForOfflineCommit() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\AlliantOneApiREST\NumberControllers\NumberA1ApiClientController.cs:line 104
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Commands.OfflineNumberCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Commands\OfflineNumberCommitTo3ECommandHandler.cs:line 25
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+40ms Processing

Server:
dw0sdwk000fbp:7432
Worker:
7da13192
+33msOfflineNumberCommitTo3ECommandHandler - Started

+14ms Enqueued

Triggered by recurring job scheduler

Queue:
a1-numbers

12/4/2025 1:01:09 AM Created