File: C:\AssetWorks\FASuite\main-ms\Logs\202608\20260824\DataServices\DataServices.log
- ==========[ 08/24/2026 04:18:02 ]==========
Log ID: fc4d6076-71fd-486e-b5ad-dedd83fc7d4c
UTC Timestamp: 8/24/2026 11:18:02 AM
Level: Error
Caller: Run
TargetSite: System.Data.Common.DbDataReader <ExecuteDbDataReaderAsync>b__210_0(System.Threading.Tasks.Task`1[Microsoft.Data.SqlClient.SqlDataReader])
File: C:\azure-agent\_work\19\s\src\FA.Api.Common\Events\EventLoop.cs
Line: 403
Tag: EventLoop
--- Message ---
Failed to process events | Execution Timeout Expired. The timeout period elapsed prior to completion of the operation or the server is not responding.
=>The wait operation timed out
--- StackTrace ---
at Microsoft.Data.SqlClient.SqlCommand.<>c.<ExecuteDbDataReaderAsync>b__210_0(Task`1 result)
at System.Threading.Tasks.ContinuationResultTaskFromResultTask`2.InnerInvoke()
at System.Threading.Tasks.Task.Execute()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at FASuite.Sql.Execute.<RunQueriesEnumerable>d__54.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Threading.Tasks.Sources.ManualResetValueTaskSourceCore`1.GetResult(Int16 token)
at FASuite.Sql.Execute.<RunQueriesEnumerable>d__53.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at FASuite.Sql.Execute.<RunQueriesEnumerable>d__53.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Threading.Tasks.Sources.ManualResetValueTaskSourceCore`1.GetResult(Int16 token)
at FA.Api.Common.Events.EventLoop.<FetchEvents>d__35.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at FA.Api.Common.Events.EventLoop.<FetchEvents>d__35.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Threading.Tasks.Sources.ManualResetValueTaskSourceCore`1.GetResult(Int16 token)
at FA.Api.Common.Events.EventLoop.<ProcessEvents>d__29.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at FA.Api.Common.Events.EventLoop.<ProcessEvents>d__29.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at FA.Api.Common.Events.EventLoop.<Run>d__28.MoveNext()
Service shutdown signal received, stopping service...
Stop completed at 8/24/2026 6:36:03 AM (local time), uptime 2.19:04:39.7883436
___ __ _
/\ | \ \ / / | |
/ \ ___ ___ ___| |\ \ /\ / /__ _ __| | _____
/ /\ \ / __/ __|/ _ \ __\ \/ \/ / _ \| '__| |/ / __|
/ ____ \\__ \__ \ __/ |_ \ /\ / (_) | | | <\__ \
/_/ \_\___/___/\___|\__| \/ \/ \___/|_| |_|\_\___/
==================== DataServices ====================
=== Monday, August 24, 2026 - 6:36:19 AM ===
Loading config from C:\AssetWorks\FASuite\main-ms\config\FASuite.config
Configuration Information
| Web Service URL: http://10.8.1.25:42069
| Host Machine IP: 10.8.1.25
| Local Time: Monday, August 24, 2026 6:36:19 AM
| Version: 26.2.0+1cfcb410ad617b3a1b1c226d2badb0a576a833ec
| OS Version: Microsoft Windows NT 6.3.9600.0
| Running As: Service
| Log Verbosity: Warn
| Target Database: MSSQL - QADEPLOY @ SPKSQL-TEMP\I22
| FA AppServer: 127.0.0.1:50420
| Mapping Enabled: True
| Mobile Licensed: True
| Uploads Path: C:\AssetWorks\FASuite\main-ms\Uploads
| Logs Base Path: C:\AssetWorks\FASuite\main-ms\Logs
| Mapping Licensed: True
| Advanced Indexing: True
| Maintain Indexes: False
| OpenSearch URL: http://10.8.0.149:9200
| OpenSearch Index Prefix: SPKQADeploySQL
Health Check
| FA AppServer: Success (105 ms)
| Database: Success (70 ms)
| OpenSearch: Success (70 ms)
| Uploads Path: Found
Database Information
| DB Vendor Info: Microsoft SQL Server 2022 (RTM-CU25-GDR) (KB5101347) - 16.0.4262.2 (X64)
Jun 18 2026 14:30:08
Copyright (C) 2022 Microsoft Corporation
Standard Edition (64-bit) on Windows Server 2022 Datacenter 10.0 <X64> (Build 20348: ) (Hypervisor)
| FA DB Version: 26.2 - step 84
| Message: MSSQL QA Instance (nightly) (Marta DB) It was a bright cold day in April and the clocks were striking thirteen.
- ==========[ 08/24/2026 06:36:27 ]==========
Bad shape for CHACO-PVMT-1001
- ==========[ 08/24/2026 06:36:27 ]==========
Bad shape for CHACO-PVMT-1008
- ==========[ 08/24/2026 06:36:27 ]==========
Bad shape for CHACO-PVMT-1015
- ==========[ 08/24/2026 06:36:27 ]==========
Bad shape for CHACO-PVMT-1002
- ==========[ 08/24/2026 06:36:27 ]==========
Bad shape for CHACO-PVMT-1009
- ==========[ 08/24/2026 06:36:27 ]==========
Bad shape for CHACO-PVMT-1016
- ==========[ 08/24/2026 06:36:27 ]==========
Bad shape for CHACO-PVMT-1003
- ==========[ 08/24/2026 06:36:27 ]==========
Bad shape for CHACO-PVMT-1004
- ==========[ 08/24/2026 06:36:27 ]==========
Bad shape for CHACO-PVMT-1018
- ==========[ 08/24/2026 06:36:27 ]==========
Bad shape for CHACO-PVMT-1036
- ==========[ 08/24/2026 06:36:27 ]==========
Bad shape for CHACO-PVMT-1006
- ==========[ 08/24/2026 06:36:27 ]==========
Bad shape for CHACO-PVMT-1013
- ==========[ 08/24/2026 06:36:27 ]==========
Bad shape for CHACO-PVMT-1032
- ==========[ 08/24/2026 06:36:27 ]==========
Bad shape for CHACO-PVMT-1037
- ==========[ 08/24/2026 06:36:27 ]==========
Bad shape for CHACO-PVMT-1014
- ==========[ 08/24/2026 06:36:27 ]==========
Bad shape for CHACO-PVMT-1026
- ==========[ 08/24/2026 06:36:27 ]==========
Bad shape for CHACO-PVMT-1033
- ==========[ 08/24/2026 06:36:27 ]==========
Bad shape for CHACO-PVMT-1050
- ==========[ 08/24/2026 06:36:27 ]==========
Bad shape for CHACO-PVMT-1027
- ==========[ 08/24/2026 06:36:27 ]==========
Bad shape for CHACO-PVMT-1034
- ==========[ 08/24/2026 06:36:27 ]==========
Bad shape for CHACO-PVMT-1045
- ==========[ 08/24/2026 06:36:27 ]==========
Bad shape for CHACO-PVMT-1039
- ==========[ 08/24/2026 06:36:27 ]==========
Bad shape for CHACO-PVMT-1028
- ==========[ 08/24/2026 06:36:27 ]==========
Bad shape for CHACO-PVMT-1046
- ==========[ 08/24/2026 06:36:27 ]==========
Bad shape for CHACO-PVMT-1035
- ==========[ 08/24/2026 06:36:27 ]==========
Bad shape for CHACO-PVMT-1047
- ==========[ 08/24/2026 06:36:27 ]==========
Bad shape for CHACO-PVMT-1041
- ==========[ 08/24/2026 06:36:27 ]==========
Bad shape for CHACO-PVMT-1042
- ==========[ 08/24/2026 06:36:27 ]==========
Bad shape for CHACO-PVMT-1048
- ==========[ 08/24/2026 06:36:27 ]==========
Bad shape for CHACO-PVMT-1049
- ==========[ 08/24/2026 06:36:27 ]==========
Bad shape for CHACO-PVMT-1022
- ==========[ 08/24/2026 06:36:27 ]==========
Bad shape for CHACO-PVMT-1023
- ==========[ 08/24/2026 06:36:27 ]==========
Bad shape for CHACO-PVMT-1030
- ==========[ 08/24/2026 06:36:27 ]==========
Bad shape for CHACO-PVMT-1019
- ==========[ 08/24/2026 06:36:27 ]==========
Bad shape for CHACO-PVMT-1020
- ==========[ 08/24/2026 06:36:27 ]==========
Bad shape for CHACO-PVMT-1038
- ==========[ 08/24/2026 06:36:28 ]==========
Bad shape for CHACO-PVMT-1010
- ==========[ 08/24/2026 06:36:28 ]==========
Bad shape for CHACO-PVMT-1017
- ==========[ 08/24/2026 06:36:28 ]==========
Bad shape for CHACO-PVMT-1011
- ==========[ 08/24/2026 06:36:28 ]==========
Bad shape for CHACO-PVMT-1024
- ==========[ 08/24/2026 06:36:28 ]==========
Bad shape for CHACO-PVMT-1031
- ==========[ 08/24/2026 06:36:28 ]==========
Bad shape for CHACO-PVMT-1025
- ==========[ 08/24/2026 06:36:28 ]==========
Bad shape for CHACO-PVMT-1043
- ==========[ 08/24/2026 06:36:28 ]==========
Bad shape for CHACO-PVMT-1007
- ==========[ 08/24/2026 06:36:28 ]==========
Bad shape for CHACO-PVMT-1021
- ==========[ 08/24/2026 06:36:28 ]==========
Bad shape for CHACO-PVMT-1040
- ==========[ 08/24/2026 06:36:28 ]==========
Bad shape for CHACO-PVMT-1029
- ==========[ 08/24/2026 06:36:28 ]==========
Bad shape for CHACO-PVMT-1005
- ==========[ 08/24/2026 06:36:28 ]==========
Bad shape for CHACO-PVMT-1012
- ==========[ 08/24/2026 06:36:28 ]==========
Bad shape for CHACO-PVMT-1044
- ==========[ 08/24/2026 06:36:28 ]==========
Bad shape for SPOKANE CT
- ==========[ 08/24/2026 06:36:28 ]==========
Bad shape for USA-IA-O'BRIEN
- ==========[ 08/24/2026 06:36:29 ]==========
Bad shape for USA-MD-PRINCE GEORGE'S
- ==========[ 08/24/2026 06:36:29 ]==========
Bad shape for USA-MD-QUEEN ANNE'S
- ==========[ 08/24/2026 06:36:29 ]==========
Bad shape for USA-MD-ST. MARY'S
- ==========[ 08/24/2026 06:36:29 ]==========
Bad shape for RR-UP-SOUTHEAST
Service shutdown signal received, stopping service...
Stop completed at 8/24/2026 7:02:38 AM (local time), uptime 00:26:18.7720903
___ __ _
/\ | \ \ / / | |
/ \ ___ ___ ___| |\ \ /\ / /__ _ __| | _____
/ /\ \ / __/ __|/ _ \ __\ \/ \/ / _ \| '__| |/ / __|
/ ____ \\__ \__ \ __/ |_ \ /\ / (_) | | | <\__ \
/_/ \_\___/___/\___|\__| \/ \/ \___/|_| |_|\_\___/
==================== DataServices ====================
=== Monday, August 24, 2026 - 7:02:54 AM ===
Loading config from C:\AssetWorks\FASuite\main-ms\config\FASuite.config
Configuration Information
| Web Service URL: http://10.8.1.25:42069
| Host Machine IP: 10.8.1.25
| Local Time: Monday, August 24, 2026 7:02:54 AM
| Version: 26.2.0+1cfcb410ad617b3a1b1c226d2badb0a576a833ec
| OS Version: Microsoft Windows NT 6.3.9600.0
| Running As: Service
| Log Verbosity: Warn
| Target Database: MSSQL - QADEPLOY @ SPKSQL-TEMP\I22
| FA AppServer: 127.0.0.1:50420
| Mapping Enabled: True
| Mobile Licensed: True
| Uploads Path: C:\AssetWorks\FASuite\main-ms\Uploads
| Logs Base Path: C:\AssetWorks\FASuite\main-ms\Logs
| Mapping Licensed: True
| Advanced Indexing: True
| Maintain Indexes: False
| OpenSearch URL: http://10.8.0.149:9200
| OpenSearch Index Prefix: SPKQADeploySQL
Health Check
| FA AppServer: Success (144 ms)
| Database: Success (47 ms)
| OpenSearch: Success (47 ms)
| Uploads Path: Found
Database Information
| DB Vendor Info: Microsoft SQL Server 2022 (RTM-CU25-GDR) (KB5101347) - 16.0.4262.2 (X64)
Jun 18 2026 14:30:08
Copyright (C) 2022 Microsoft Corporation
Standard Edition (64-bit) on Windows Server 2022 Datacenter 10.0 <X64> (Build 20348: ) (Hypervisor)
| FA DB Version: 26.2 - step 84
| Message: MSSQL QA Instance (nightly) (Marta DB) It was a bright cold day in April and the clocks were striking thirteen.
- ==========[ 08/24/2026 07:02:58 ]==========
Bad shape for CHACO-PVMT-1001
- ==========[ 08/24/2026 07:02:58 ]==========
Bad shape for CHACO-PVMT-1008
- ==========[ 08/24/2026 07:02:58 ]==========
Bad shape for CHACO-PVMT-1015
- ==========[ 08/24/2026 07:02:58 ]==========
Bad shape for CHACO-PVMT-1002
- ==========[ 08/24/2026 07:02:58 ]==========
Bad shape for CHACO-PVMT-1009
- ==========[ 08/24/2026 07:02:58 ]==========
Bad shape for CHACO-PVMT-1016
- ==========[ 08/24/2026 07:02:58 ]==========
Bad shape for CHACO-PVMT-1003
- ==========[ 08/24/2026 07:02:58 ]==========
Bad shape for CHACO-PVMT-1004
- ==========[ 08/24/2026 07:02:58 ]==========
Bad shape for CHACO-PVMT-1018
- ==========[ 08/24/2026 07:02:58 ]==========
Bad shape for CHACO-PVMT-1036
- ==========[ 08/24/2026 07:02:58 ]==========
Bad shape for CHACO-PVMT-1006
- ==========[ 08/24/2026 07:02:58 ]==========
Bad shape for CHACO-PVMT-1013
- ==========[ 08/24/2026 07:02:58 ]==========
Bad shape for CHACO-PVMT-1032
- ==========[ 08/24/2026 07:02:58 ]==========
Bad shape for CHACO-PVMT-1037
- ==========[ 08/24/2026 07:02:58 ]==========
Bad shape for CHACO-PVMT-1014
- ==========[ 08/24/2026 07:02:58 ]==========
Bad shape for CHACO-PVMT-1026
- ==========[ 08/24/2026 07:02:58 ]==========
Bad shape for CHACO-PVMT-1033
- ==========[ 08/24/2026 07:02:58 ]==========
Bad shape for CHACO-PVMT-1050
- ==========[ 08/24/2026 07:02:58 ]==========
Bad shape for CHACO-PVMT-1027
- ==========[ 08/24/2026 07:02:58 ]==========
Bad shape for CHACO-PVMT-1034
- ==========[ 08/24/2026 07:02:58 ]==========
Bad shape for CHACO-PVMT-1045
- ==========[ 08/24/2026 07:02:58 ]==========
Bad shape for CHACO-PVMT-1039
- ==========[ 08/24/2026 07:02:58 ]==========
Bad shape for CHACO-PVMT-1028
- ==========[ 08/24/2026 07:02:58 ]==========
Bad shape for CHACO-PVMT-1046
- ==========[ 08/24/2026 07:02:58 ]==========
Bad shape for CHACO-PVMT-1035
- ==========[ 08/24/2026 07:02:58 ]==========
Bad shape for CHACO-PVMT-1047
- ==========[ 08/24/2026 07:02:58 ]==========
Bad shape for CHACO-PVMT-1041
- ==========[ 08/24/2026 07:02:58 ]==========
Bad shape for CHACO-PVMT-1042
- ==========[ 08/24/2026 07:02:58 ]==========
Bad shape for CHACO-PVMT-1048
- ==========[ 08/24/2026 07:02:58 ]==========
Bad shape for CHACO-PVMT-1049
- ==========[ 08/24/2026 07:02:58 ]==========
Bad shape for CHACO-PVMT-1022
- ==========[ 08/24/2026 07:02:58 ]==========
Bad shape for CHACO-PVMT-1023
- ==========[ 08/24/2026 07:02:58 ]==========
Bad shape for CHACO-PVMT-1030
- ==========[ 08/24/2026 07:02:58 ]==========
Bad shape for CHACO-PVMT-1019
- ==========[ 08/24/2026 07:02:58 ]==========
Bad shape for CHACO-PVMT-1020
- ==========[ 08/24/2026 07:02:58 ]==========
Bad shape for CHACO-PVMT-1038
- ==========[ 08/24/2026 07:02:59 ]==========
Bad shape for CHACO-PVMT-1010
- ==========[ 08/24/2026 07:02:59 ]==========
Bad shape for CHACO-PVMT-1017
- ==========[ 08/24/2026 07:02:59 ]==========
Bad shape for CHACO-PVMT-1011
- ==========[ 08/24/2026 07:02:59 ]==========
Bad shape for CHACO-PVMT-1024
- ==========[ 08/24/2026 07:02:59 ]==========
Bad shape for CHACO-PVMT-1031
- ==========[ 08/24/2026 07:02:59 ]==========
Bad shape for CHACO-PVMT-1025
- ==========[ 08/24/2026 07:02:59 ]==========
Bad shape for CHACO-PVMT-1043
- ==========[ 08/24/2026 07:02:59 ]==========
Bad shape for CHACO-PVMT-1007
- ==========[ 08/24/2026 07:02:59 ]==========
Bad shape for CHACO-PVMT-1021
- ==========[ 08/24/2026 07:02:59 ]==========
Bad shape for CHACO-PVMT-1040
- ==========[ 08/24/2026 07:02:59 ]==========
Bad shape for CHACO-PVMT-1029
- ==========[ 08/24/2026 07:02:59 ]==========
Bad shape for CHACO-PVMT-1005
- ==========[ 08/24/2026 07:02:59 ]==========
Bad shape for CHACO-PVMT-1012
- ==========[ 08/24/2026 07:02:59 ]==========
Bad shape for CHACO-PVMT-1044
- ==========[ 08/24/2026 07:02:59 ]==========
Bad shape for SPOKANE CT
- ==========[ 08/24/2026 07:02:59 ]==========
Bad shape for USA-IA-O'BRIEN
- ==========[ 08/24/2026 07:02:59 ]==========
Bad shape for USA-MD-PRINCE GEORGE'S
- ==========[ 08/24/2026 07:03:00 ]==========
Bad shape for USA-MD-QUEEN ANNE'S
- ==========[ 08/24/2026 07:03:00 ]==========
Bad shape for USA-MD-ST. MARY'S
- ==========[ 08/24/2026 07:03:00 ]==========
Bad shape for RR-UP-SOUTHEAST
- ==========[ 08/24/2026 07:35:12 ]==========
Log ID: 35823b5e-110c-4e8d-968c-95b9e4e053c6
UTC Timestamp: 8/24/2026 2:35:12 PM
Level: Error
Caller: Run
TargetSite: System.Data.Common.DbDataReader <ExecuteDbDataReaderAsync>b__210_0(System.Threading.Tasks.Task`1[Microsoft.Data.SqlClient.SqlDataReader])
File: C:\azure-agent\_work\19\s\src\FA.Api.Common\Events\EventLoop.cs
Line: 403
Tag: EventLoop
--- Message ---
Failed to process events | Execution Timeout Expired. The timeout period elapsed prior to completion of the operation or the server is not responding.
=>The wait operation timed out
--- StackTrace ---
at Microsoft.Data.SqlClient.SqlCommand.<>c.<ExecuteDbDataReaderAsync>b__210_0(Task`1 result)
at System.Threading.Tasks.ContinuationResultTaskFromResultTask`2.InnerInvoke()
at System.Threading.Tasks.Task.Execute()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at FASuite.Sql.Execute.<RunQueriesEnumerable>d__54.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Threading.Tasks.Sources.ManualResetValueTaskSourceCore`1.GetResult(Int16 token)
at FASuite.Sql.Execute.<RunQueriesEnumerable>d__53.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at FASuite.Sql.Execute.<RunQueriesEnumerable>d__53.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Threading.Tasks.Sources.ManualResetValueTaskSourceCore`1.GetResult(Int16 token)
at FA.Api.Common.Events.EventLoop.<FetchEvents>d__35.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at FA.Api.Common.Events.EventLoop.<FetchEvents>d__35.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Threading.Tasks.Sources.ManualResetValueTaskSourceCore`1.GetResult(Int16 token)
at FA.Api.Common.Events.EventLoop.<ProcessEvents>d__29.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at FA.Api.Common.Events.EventLoop.<ProcessEvents>d__29.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at FA.Api.Common.Events.EventLoop.<Run>d__28.MoveNext()