IOfflineNumberCommitTo3E.Run

// Job ID: #1149146
using AG.A1.Scheduler.Project.Contracts.Contracts.Number;

var offlineNumberCommitTo3E = Activate<IOfflineNumberCommitTo3E>();
await offlineNumberCommitTo3E.Run(null, null);

Parameters

CurrentCulture
"en-US"
CurrentUICulture
"en-US"
RecurringJobId
"NUMBER-Offline-Commit-Number-To-3E-Task"
RetryCount
10
Time
1766397673

State

12/22/2025 2:11:55 PM (+1m 40.794s) Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: The operation was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
 ---> System.IO.IOException: The read operation failed, see inner exception.
 ---> System.ObjectDisposedException: Cannot access a disposed object.
Object name: 'SslStream'.
   at System.Net.Security.SslStream.<ThrowIfExceptional>g__ThrowExceptional|138_0(ExceptionDispatchInfo e)
   at System.Net.Security.SslStream.DecryptData(Int32 frameSize)
   at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](TIOAdapter adapter, Memory`1 buffer)
   --- End of inner exception stack trace ---
   at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](TIOAdapter adapter, Memory`1 buffer)
   at System.Net.Http.HttpConnection.FillAsync(Boolean async)
   at System.Net.Http.HttpConnection.ChunkedEncodingReadStream.CopyToAsyncCore(Stream destination, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpConnection.ChunkedEncodingReadStream.CopyToAsyncCore(Stream destination, CancellationToken cancellationToken)
   at System.IO.Compression.DeflateStream.CopyToStream.CopyFromSourceToDestinationAsync()
   at System.Net.Http.DecompressionHandler.DecompressedContent.SerializeToStreamAsync(Stream stream, TransportContext context, CancellationToken cancellationToken)
   at System.Net.Http.HttpContent.LoadIntoBufferAsyncCore(Task serializeToStreamTask, MemoryStream tempBuffer)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 389
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 210
   at AG.Integrations.RESTClients.AlliantOneApiREST.NumberControllers.NumberA1ApiClientController.GetNumbersForOfflineCommit() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\AlliantOneApiREST\NumberControllers\NumberA1ApiClientController.cs:line 128
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Commands.OfflineNumberCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Commands\OfflineNumberCommitTo3ECommandHandler.cs:line 25
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+20ms Processing

Server:
dw1sdwk000dtj:2644
Worker:
396bb9f9
+31msOfflineNumberCommitTo3ECommandHandler - Started

+1h 53m Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+6ms Scheduled

Retry attempt 10 of 10: The request was canceled due to the configured Ht…

Enqueue at:
12/22/2025 2:10:09 PM

+1m 40.434s Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: The operation was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
 ---> System.IO.IOException: The read operation failed, see inner exception.
 ---> System.ObjectDisposedException: Cannot access a disposed object.
Object name: 'System.Net.Sockets.NetworkStream'.
   at System.Net.Sockets.NetworkStream.<ThrowIfDisposed>g__ThrowObjectDisposedException|63_0()
   at System.Net.Sockets.NetworkStream.ReadAsync(Memory`1 buffer, CancellationToken cancellationToken)
   at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](TIOAdapter adapter)
   at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](TIOAdapter adapter, Memory`1 buffer)
   --- End of inner exception stack trace ---
   at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](TIOAdapter adapter, Memory`1 buffer)
   at System.Net.Http.HttpConnection.<CheckUsabilityOnScavenge>g__ReadAheadWithZeroByteReadAsync|45_0()
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
   at System.Net.Http.DiagnosticsHandler.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 389
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 210
   at AG.Integrations.RESTClients.AlliantOneApiREST.NumberControllers.NumberA1ApiClientController.GetNumbersForOfflineCommit() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\AlliantOneApiREST\NumberControllers\NumberA1ApiClientController.cs:line 126
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Commands.OfflineNumberCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Commands\OfflineNumberCommitTo3ECommandHandler.cs:line 25
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+113ms Processing

Server:
dw1sdwk000dtj:2644
Worker:
b5742d66
+142msOfflineNumberCommitTo3ECommandHandler - Started

+1h 12m Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+3ms Scheduled

Retry attempt 9 of 10: The request was canceled due to the configured Ht…

Enqueue at:
12/22/2025 12:14:45 PM

+1m 40.454s Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: The operation was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
 ---> System.IO.IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request..
 ---> System.Net.Sockets.SocketException (995): The I/O operation has been aborted because of either a thread exit or an application request.
   --- End of inner exception stack trace ---
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token)
   at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](TIOAdapter adapter)
   at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](TIOAdapter adapter, Memory`1 buffer)
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
   at System.Net.Http.DiagnosticsHandler.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 389
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 210
   at AG.Integrations.RESTClients.AlliantOneApiREST.NumberControllers.NumberA1ApiClientController.GetNumbersForOfflineCommit() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\AlliantOneApiREST\NumberControllers\NumberA1ApiClientController.cs:line 126
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Commands.OfflineNumberCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Commands\OfflineNumberCommitTo3ECommandHandler.cs:line 25
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+20ms Processing

Server:
dw1sdwk000dtj:2644
Worker:
396bb9f9
+96msOfflineNumberCommitTo3ECommandHandler - Started

+43m 13.246s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+4ms Scheduled

Retry attempt 8 of 10: Could not load file or assembly 'AG.A1.Scheduler.…

Enqueue at:
12/22/2025 11:00:12 AM

+6m 926ms Failed

Can not change the state to 'Processing': target method was not found.

System.IO.FileNotFoundException

Could not load file or assembly 'AG.A1.Scheduler.Project.Contracts, Culture=neutral, PublicKeyToken=null'. The system cannot find the file specified.

System.IO.FileNotFoundException: Could not load file or assembly 'AG.A1.Scheduler.Project.Contracts, Culture=neutral, PublicKeyToken=null'. The system cannot find the file specified.
File name: 'AG.A1.Scheduler.Project.Contracts, Culture=neutral, PublicKeyToken=null'
   at System.Reflection.RuntimeAssembly.InternalLoad(ObjectHandleOnStack assemblyName, ObjectHandleOnStack requestingAssembly, StackCrawlMarkHandle stackMark, Boolean throwOnFileNotFound, ObjectHandleOnStack assemblyLoadContext, ObjectHandleOnStack retAssembly)
   at System.Reflection.RuntimeAssembly.InternalLoad(AssemblyName assemblyName, RuntimeAssembly requestingAssembly, StackCrawlMark& stackMark, Boolean throwOnFileNotFound, AssemblyLoadContext assemblyLoadContext)
   at System.Reflection.Assembly.Load(AssemblyName assemblyRef)
   at Hangfire.Common.TypeHelper.AssemblyResolver(String assemblyString)
   at System.Collections.Concurrent.ConcurrentDictionary`2.GetOrAdd(TKey key, Func`2 valueFactory)
   at System.TypeNameParser.ResolveAssembly(String asmName, Func`2 assemblyResolver, Boolean throwOnError, StackCrawlMark& stackMark)
   at System.TypeNameParser.ConstructType(Func`2 assemblyResolver, Func`4 typeResolver, Boolean throwOnError, Boolean ignoreCase, StackCrawlMark& stackMark)
   at System.TypeNameParser.GetType(String typeName, Func`2 assemblyResolver, Func`4 typeResolver, Boolean throwOnError, Boolean ignoreCase, StackCrawlMark& stackMark)
   at System.Type.GetType(String typeName, Func`2 assemblyResolver, Func`4 typeResolver, Boolean throwOnError)
   at Hangfire.Common.TypeHelper.DefaultTypeResolver(String typeName)
   at Hangfire.Storage.InvocationData.DeserializeJob()

+50ms Processing

Server:
dw1sdwk000dtj:7404
Worker:
66390918
+154msOfflineNumberCommitTo3ECommandHandler - Started

+1m 18.850s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+10ms Scheduled

Retry attempt 2 of 10: The request was canceled due to the configured Ht…

Enqueue at:
12/22/2025 10:10:54 AM

+1m 41.560s Failed

An exception occurred during performance of the job.

System.Threading.Tasks.TaskCanceledException

The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
 ---> System.TimeoutException: The operation was canceled.
 ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
 ---> System.IO.IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request..
 ---> System.Net.Sockets.SocketException (995): The I/O operation has been aborted because of either a thread exit or an application request.
   --- End of inner exception stack trace ---
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token)
   at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](TIOAdapter adapter, Memory`1 buffer)
   at System.Net.Http.HttpConnection.<CheckUsabilityOnScavenge>g__ReadAheadWithZeroByteReadAsync|45_0()
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
   at System.Net.Http.DiagnosticsHandler.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   --- End of inner exception stack trace ---
   --- End of inner exception stack trace ---
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 389
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 210
   at AG.Integrations.RESTClients.AlliantOneApiREST.NumberControllers.NumberA1ApiClientController.GetNumbersForOfflineCommit() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\AlliantOneApiREST\NumberControllers\NumberA1ApiClientController.cs:line 126
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Commands.OfflineNumberCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Commands\OfflineNumberCommitTo3ECommandHandler.cs:line 25
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+47ms Processing

Server:
dw1sdwk000dtj:7404
Worker:
e9eb6021
+91msOfflineNumberCommitTo3ECommandHandler - Started

+34.337s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+10ms Scheduled

Retry attempt 1 of 10: Request failed with status code BadGateway

Enqueue at:
12/22/2025 10:07:54 AM

+1m 10.613s Failed

An exception occurred during performance of the job.

System.Net.Http.HttpRequestException

Request failed with status code BadGateway

System.Net.Http.HttpRequestException: Request failed with status code BadGateway
   at AG.A1.Framework.Rest.RESTClient.HandleResponse[T](RestResponse restResponse) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 392
   at AG.A1.Framework.Rest.RESTClient.GetInternalAsync[T](IRESTEndpoint apiEndpoint, IDictionary`2 headers, String expectedRootElement, IDictionary`2 parameters) in C:\agent\_work\1\s\A1Solution\src-framework\AG.A1.Framework\Rest\RESTClient.cs:line 209
   at AG.Integrations.RESTClients.AlliantOneApiREST.NumberControllers.NumberA1ApiClientController.GetNumbersForOfflineCommit() in C:\agent\_work\1\s\A1Solution\src-integrations\AG.Integrations.RESTClients\AlliantOneApiREST\NumberControllers\NumberA1ApiClientController.cs:line 126
   at AG.A1.Scheduler.Project.Application.Features.CommitNumberTo3E.Commands.OfflineNumberCommitTo3ECommandHandler.Run(PerformContext performContext, IJobCancellationToken cancellationToken) in C:\agent\_work\1\s\A1Solution\src-schedulers\AG.A1.Scheduler.Project.Application\Features\CommitNumberTo3E\Commands\OfflineNumberCommitTo3ECommandHandler.cs:line 25
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

+5m 43ms Processing

Server:
dw1sdwk000dtj:7404
Worker:
cb698fdc
+70msOfflineNumberCommitTo3ECommandHandler - Started

+47ms Processing

Server:
dw1sdwk000dtj:5428
Worker:
094c6a44
+449msOfflineNumberCommitTo3ECommandHandler - Started

+57ms Enqueued

Triggered by recurring job scheduler

Queue:
a1-numbers

12/22/2025 10:01:13 AM Created