Failed jobs do not become expired to allow you to re-queue them without any
time pressure. You should re-queue or delete them manually, or apply AutomaticRetry(OnAttemptsExceeded = AttemptsExceededAction.Delete)
attribute to delete them automatically.
An exception occurred during processing of a background job. Fewer details...
10/26/2024 17:55:04
System.Data.SqlClient.SqlException
A network-related or instance-specific error occurred while establishing a connection to SQL Server. The server was not found or was not accessible. Verify that the instance name is correct and that SQL Server is configured to allow remote connections. (provider: TCP Provider, error: 40 - Could not open a connection to SQL Server)
System.Data.SqlClient.SqlException (0x80131904): A network-related or instance-specific error occurred while establishing a connection to SQL Server. The server was not found or was not accessible. Verify that the instance name is correct and that SQL Server is configured to allow remote connections. (provider: TCP Provider, error: 40 - Could not open a connection to SQL Server)
at System.Data.ProviderBase.DbConnectionPool.TryGetConnection(DbConnectionowningObject, UInt32waitForMultipleObjectsTimeout, BooleanallowCreate, BooleanonlyOneCheckConnection, DbConnectionOptionsuserOptions, DbConnectionInternal&connection)
at System.Data.ProviderBase.DbConnectionPool.TryGetConnection(DbConnectionowningObject, TaskCompletionSource`1retry, DbConnectionOptionsuserOptions, DbConnectionInternal&connection)
at System.Data.ProviderBase.DbConnectionFactory.TryGetConnection(DbConnectionowningConnection, TaskCompletionSource`1retry, DbConnectionOptionsuserOptions, DbConnectionInternaloldConnection, DbConnectionInternal&connection)
at System.Data.ProviderBase.DbConnectionInternal.TryOpenConnectionInternal(DbConnectionouterConnection, DbConnectionFactoryconnectionFactory, TaskCompletionSource`1retry, DbConnectionOptionsuserOptions)
at System.Data.SqlClient.SqlConnection.TryOpen(TaskCompletionSource`1retry)
at System.Data.SqlClient.SqlConnection.Open()
at Hangfire.SqlServer.SqlServerStorage.CreateAndOpenConnection()
at Hangfire.SqlServer.SqlServerStorage.UseConnection[T](DbConnectiondedicatedConnection, Func`2func)
at Hangfire.SqlServer.SqlServerConnection.GetJobData(Stringid)
at Hangfire.Server.Worker.PerformJob(BackgroundProcessContextcontext, IStorageConnectionconnection, StringjobId)
An exception occurred during performance of the job. More details...
10/26/2024 17:55:04
System.Net.Http.HttpRequestException
Response status code does not indicate success: 500 (Internal Server Error).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 500 (Internal Server Error).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at DPoint.Scheduler.Infrastructure.Tasks.DragonCDP.CrawlSegmentDataFromDragonCDPTask.ExecuteJob() in /src/DPoint.Scheduler.Infrastructure/Tasks/DragonCDP/CrawlSegmentDataFromDragonCDPTask.cs:line 41
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Tasktask)
An exception occurred during performance of the job. More details...
10/26/2024 17:55:19
System.Threading.Tasks.TaskCanceledException
The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
---> System.TimeoutException: The operation was canceled.
---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled.
---> System.Net.Sockets.SocketException (125): Operation canceled
--- End of inner exception stack trace ---
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16token)
at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingHttpMessageHandler.SendAsync(HttpRequestMessagerequest, CancellationTokencancellationToken)
at IdentityModel.AspNetCore.AccessTokenManagement.ClientAccessTokenHandler.SendAsync(HttpRequestMessagerequest, CancellationTokencancellationToken) in D:\a\IdentityModel.AspNetCore\IdentityModel.AspNetCore\src\AccessTokenManagement\ClientAccessToken\ClientAccessTokenHandler.cs:line 46
at Microsoft.Extensions.Http.Logging.LoggingScopeHttpMessageHandler.SendAsync(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
--- End of inner exception stack trace ---
--- End of inner exception stack trace ---
at System.Net.Http.HttpClient.HandleFailure(Exceptione, BooleantelemetryStarted, HttpResponseMessageresponse, CancellationTokenSourcects, CancellationTokencancellationToken, CancellationTokenSourcependingRequestsCts)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
at DPoint.Scheduler.Infrastructure.Tasks.ExecuteDataCleanedUpQueueVMTProcessingEventTask.ExecuteJob() in /src/DPoint.Scheduler.Infrastructure/Tasks/ExecuteDataCleanedUpQueueVMTProcessingEventTask.cs:line 40
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Tasktask)
An exception occurred during performance of the job. More details...
10/26/2024 17:27:18
System.Net.Http.HttpRequestException
Response status code does not indicate success: 500 (Internal Server Error).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 500 (Internal Server Error).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at DPoint.Scheduler.Infrastructure.Tasks.Reports.ExecuteExportJobTask.ExecuteJob() in /src/DPoint.Scheduler.Infrastructure/Tasks/Reports/ExecuteExportJobTask.cs:line 44
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Tasktask)
An exception occurred during performance of the job. More details...
10/26/2024 17:20:12
System.Net.Http.HttpRequestException
Response status code does not indicate success: 500 (Internal Server Error).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 500 (Internal Server Error).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at DPoint.Scheduler.Infrastructure.Tasks.SyncCustomersLabHairOfVMTProcessingEventTask.ExecuteJob() in /src/DPoint.Scheduler.Infrastructure/Tasks/SyncCustomersLabHairOfVMTProcessingEventTask.cs:line 40
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Tasktask)
An exception occurred during performance of the job. More details...
10/26/2024 17:10:19
System.Net.Http.HttpRequestException
Response status code does not indicate success: 500 (Internal Server Error).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 500 (Internal Server Error).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at DPoint.Scheduler.Infrastructure.Tasks.SyncCustomersLabHairOfVMTProcessingEventTask.ExecuteJob() in /src/DPoint.Scheduler.Infrastructure/Tasks/SyncCustomersLabHairOfVMTProcessingEventTask.cs:line 40
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Tasktask)
An exception occurred during performance of the job. More details...
10/26/2024 17:00:13
System.Net.Http.HttpRequestException
Response status code does not indicate success: 500 (Internal Server Error).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 500 (Internal Server Error).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at DPoint.Scheduler.Infrastructure.Tasks.SyncCustomersLabHairOfVMTProcessingEventTask.ExecuteJob() in /src/DPoint.Scheduler.Infrastructure/Tasks/SyncCustomersLabHairOfVMTProcessingEventTask.cs:line 40
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Tasktask)
An exception occurred during performance of the job. More details...
10/26/2024 16:50:19
System.Net.Http.HttpRequestException
Response status code does not indicate success: 500 (Internal Server Error).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 500 (Internal Server Error).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at DPoint.Scheduler.Infrastructure.Tasks.SyncCustomersLabHairOfVMTProcessingEventTask.ExecuteJob() in /src/DPoint.Scheduler.Infrastructure/Tasks/SyncCustomersLabHairOfVMTProcessingEventTask.cs:line 40
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Tasktask)
An exception occurred during performance of the job. More details...
10/26/2024 16:40:23
System.Net.Http.HttpRequestException
Response status code does not indicate success: 500 (Internal Server Error).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 500 (Internal Server Error).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at DPoint.Scheduler.Infrastructure.Tasks.SyncCustomersLabHairOfVMTProcessingEventTask.ExecuteJob() in /src/DPoint.Scheduler.Infrastructure/Tasks/SyncCustomersLabHairOfVMTProcessingEventTask.cs:line 40
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Tasktask)
An exception occurred during performance of the job. More details...
10/26/2024 14:02:49
System.Threading.Tasks.TaskCanceledException
The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
---> System.TimeoutException: The operation was canceled.
---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled.
---> System.Net.Sockets.SocketException (125): Operation canceled
--- End of inner exception stack trace ---
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16token)
at System.Net.Http.HttpConnection.InitialFillAsync(Booleanasync)
at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingHttpMessageHandler.SendAsync(HttpRequestMessagerequest, CancellationTokencancellationToken)
at IdentityModel.AspNetCore.AccessTokenManagement.ClientAccessTokenHandler.SendAsync(HttpRequestMessagerequest, CancellationTokencancellationToken) in D:\a\IdentityModel.AspNetCore\IdentityModel.AspNetCore\src\AccessTokenManagement\ClientAccessToken\ClientAccessTokenHandler.cs:line 46
at Microsoft.Extensions.Http.Logging.LoggingScopeHttpMessageHandler.SendAsync(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
--- End of inner exception stack trace ---
--- End of inner exception stack trace ---
at System.Net.Http.HttpClient.HandleFailure(Exceptione, BooleantelemetryStarted, HttpResponseMessageresponse, CancellationTokenSourcects, CancellationTokencancellationToken, CancellationTokenSourcependingRequestsCts)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
at DPoint.Scheduler.Infrastructure.Tasks.DragonCDP.CrawlSegmentDataFromDragonCDPTask.ExecuteJob() in /src/DPoint.Scheduler.Infrastructure/Tasks/DragonCDP/CrawlSegmentDataFromDragonCDPTask.cs:line 41
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Tasktask)