ODKAggregate running slow after years of working fine

1. What is the problem? Be very detailed.
ODK Aggregate has slow performance
When using briefcase, it takes a very long time for small datasets, and medium to large requests take ages. For example a recordset of 50 records (30 KB each might take 10-20 minutes). Over the past 2.5 years, this server was running fine, but now it is very sluggish.

2. What app or server are you using and on what device and operating system? Include version numbers.
This is ODKAggregate 1.4.13 running on Tomcat on a Windows 2012 server
datastore is MySQL 5.6
briefcase 1.17.3 and 1.17.4

3. What you have you tried to fix the problem?
-tried connecting from different client machines
-tried increasing the memory from 8GB to 12GB
-tried pulling only forms with small datasets
-tried looking at Tomcat logs. There are some exceptions, but I'm not sure how to interpret them. I can provide longer logs. Here is a snippet from tomcat7-stderr.2020-10-06.log:

INFO: FormCache: fetching new list of Forms
Oct 07, 2020 10:44:42 PM org.opendatakit.aggregate.util.BackendActionsTable logValues
INFO: incoming- last Fetch:              -6875 [S:     -1602103482428 Eq:            -774986 Fs:             125014] futureMillis:             125014
Oct 07, 2020 10:44:43 PM org.opendatakit.aggregate.util.BackendActionsTable logValues
INFO: -fetched- last Fetch:                  0 [S:     -1602103482428 Eq:            -774986 Fs:             125014] futureMillis:                 -1
Oct 07, 2020 10:44:43 PM org.opendatakit.aggregate.form.FormFactory internalGetForms
INFO: FormCache: using cached list of Forms
Oct 07, 2020 10:44:48 PM org.apache.commons.dbcp2.BasicDataSource onSwallowException
WARNING: An internal object pool swallowed an Exception.
org.apache.commons.dbcp2.LifetimeExceededException: The lifetime of the connection [590,018] milliseconds exceeds the maximum permitted value of [590,000] milliseconds

4. What steps can we take to reproduce the problem?
It happens whenever I connect with ODK briefcase.

5. Anything else we should know or have? If you have a test form or screenshots or logs, attach below.
Our data collectors have seen some slowness when uploading data, but they have mostly been successful

There are some large datasets on the server, the largest form is around 200,000 records. There are about 50 forms on the server. Most forms have smaller datasets from 100's to 10,000's records. The large dataset has image files attached (signatures).

Thanks for any help troubleshooting this!

This is resolved.

There was a problem with the windows server. We had to rebuild the windows server.

1 Like