I have successfully used the same aggregate server for various projects, all based on a similar, but not identical xml survey.
But now I am having trouble viewing data from the most recent deployment of the survey. When on the aggregate website I cannot view the data, and receive an error message of the format:
"Error: Problem persisting data or accessing data ([RepeatSubmissionType.getValueFromEntity] SQL: SELECT * FROM opendatakit.RHO14_95_SECTION_LIVESTOCK_LIVESTOCK_REPEAT WHERE _PARENT_AURI = uuid:f2ea042a-6a48-456d-9b32-a653735965a3 ORDER BY _PARENT_AURI exception: This request (acdebba31252a269) started at 2016/02/15 09:17:45.331 UTC and was still executing at 2016/02/15 09:18:45.194 UTC.)"
However each time the DATA_TABLE_NAME and uuid:XXXX are different. I also cannot export the data using the aggregate web interface, or download using briefcase.
I have tried the instructions posted at "https://github.com/opendatakit/opendatakit/wiki/Aggregate-AppEngine-Troubleshooting" in order to repair any broken instance, but could not find broken instances from referred to in the error messages - sometimes the instance could not be found, and sometimes the instance could be found but didn't show any duplicates.
I'm running Aggregate 1.4.5 on Google App Engine, the .csv files (when exported) are of the order 1-2 MB.
Unfortunately, sometimes the Google Data Viewer does not work very well and
will time out before it displays your data records.
This problem will prevent successful publishing and downloads until it is
resolved.
If you are having trouble figuring out what individual data records need to
be deleted to preserve the data:
The quickest solution is to remove these corrupted records on the server.
You can then go back to your devices and find the original submissions for
these corrupted rows (assuming you didn't already delete the submissions
from the devices). Then edit the submissions and change their instanceId
to some other value (e.g., append -fixed to the name). And upload the
adjusted submission via the Forms Management / Submission Admin tab's
upload submission button of the ODK Aggregate web page.
To remove the corrupted submissions, you just need to search the ..._CORE
table for the _URI = whatever the _PARENT_AURI was that was identified in
the log message. And delete the one or two records in that table. Keep
track of the _URI value that you are deleting, as that is the submission
instanceId you want to find and recover from your devices.
···
On Mon, Feb 15, 2016 at 1:57 AM, wrote:
Hello
I have successfully used the same aggregate server for various projects,
all based on a similar, but not identical xml survey.
But now I am having trouble viewing data from the most recent deployment
of the survey. When on the aggregate website I cannot view the data, and
receive an error message of the format:
"Error: Problem persisting data or accessing data
([RepeatSubmissionType.getValueFromEntity] SQL: SELECT * FROM
opendatakit.RHO14_95_SECTION_LIVESTOCK_LIVESTOCK_REPEAT WHERE _PARENT_AURI
= uuid:f2ea042a-6a48-456d-9b32-a653735965a3 ORDER BY _PARENT_AURI
exception: This request (acdebba31252a269) started at 2016/02/15
09:17:45.331 UTC and was still executing at 2016/02/15 09:18:45.194 UTC.)"
However each time the DATA_TABLE_NAME and uuid:XXXX are different. I
also cannot export the data using the aggregate web interface, or download
using briefcase.
I have tried the instructions posted at " https://github.com/opendatakit/opendatakit/wiki/Aggregate-AppEngine-Troubleshooting"
in order to repair any broken instance, but could not find broken instances
from referred to in the error messages - sometimes the instance could not
be found, and sometimes the instance could be found but didn't show any
duplicates.
I'm running Aggregate 1.4.5 on Google App Engine, the .csv files (when
exported) are of the order 1-2 MB.
I seem to be facing a similar issue. I am also using ODK Aggregate and a Google App Engine Server. I have multiple versions of my survey on ODK Aggregate and I am having trouble downloading data from one specific version. Up until a few days ago I could download the data but now the error beow is persisting. I have experience a similar error versions of my form, but on refreshing the page a few times this error would go away.
Error: Problem persisting data or accessing data (c23_1@parentAuri(uuid:171a68b1-1199-4a08-9444-0cba1400866b) valueSet is missing an entry OR has an extra copy of one)
I am sensing that the error might be with one specific variable "c23_1". Is it possible for someone using the tablet to corrupt response codes? The uuid is the same every time. We have not deleted any data on the devices and I think I have narrowed down the problem source to one specific device. How do I figure out which observation is corrupt, if that is the case here?
Any other ideas about what this could be?
Best,
Simrin
···
On Tuesday, 16 February 2016 22:40:12 UTC, Jim Hammond wrote:
> Hello
>
> I have successfully used the same aggregate server for various projects, all based on a similar, but not identical xml survey.
>
> But now I am having trouble viewing data from the most recent deployment of the survey. When on the aggregate website I cannot view the data, and receive an error message of the format:
>
> "Error: Problem persisting data or accessing data ([RepeatSubmissionType.getValueFromEntity] SQL: SELECT * FROM opendatakit.RHO14_95_SECTION_LIVESTOCK_LIVESTOCK_REPEAT WHERE _PARENT_AURI = uuid:f2ea042a-6a48-456d-9b32-a653735965a3 ORDER BY _PARENT_AURI exception: This request (acdebba31252a269) started at 2016/02/15 09:17:45.331 UTC and was still executing at 2016/02/15 09:18:45.194 UTC.)"
>
> However each time the DATA_TABLE_NAME and uuid:XXXX are different. I also cannot export the data using the aggregate web interface, or download using briefcase.
>
> I have tried the instructions posted at "https://github.com/opendatakit/opendatakit/wiki/Aggregate-AppEngine-Troubleshooting" in order to repair any broken instance, but could not find broken instances from referred to in the error messages - sometimes the instance could not be found, and sometimes the instance could be found but didn't show any duplicates.
>
> I'm running Aggregate 1.4.5 on Google App Engine, the .csv files (when exported) are of the order 1-2 MB.
>
> Thanks for your help
>
> Jim
can you send me excel questionnaire which sample that you made in order to understanding because that parts is difficult can you help me please in case you have questionnaires and excels different xusni571@gmail.com
···
On Wednesday, February 17, 2016 at 1:40:12 AM UTC+3, Jim Hammond wrote:
> Hello
>
> I have successfully used the same aggregate server for various projects, all based on a similar, but not identical xml survey.
>
> But now I am having trouble viewing data from the most recent deployment of the survey. When on the aggregate website I cannot view the data, and receive an error message of the format:
>
> "Error: Problem persisting data or accessing data ([RepeatSubmissionType.getValueFromEntity] SQL: SELECT * FROM opendatakit.RHO14_95_SECTION_LIVESTOCK_LIVESTOCK_REPEAT WHERE _PARENT_AURI = uuid:f2ea042a-6a48-456d-9b32-a653735965a3 ORDER BY _PARENT_AURI exception: This request (acdebba31252a269) started at 2016/02/15 09:17:45.331 UTC and was still executing at 2016/02/15 09:18:45.194 UTC.)"
>
> However each time the DATA_TABLE_NAME and uuid:XXXX are different. I also cannot export the data using the aggregate web interface, or download using briefcase.
>
> I have tried the instructions posted at "https://github.com/opendatakit/opendatakit/wiki/Aggregate-AppEngine-Troubleshooting" in order to repair any broken instance, but could not find broken instances from referred to in the error messages - sometimes the instance could not be found, and sometimes the instance could be found but didn't show any duplicates.
>
> I'm running Aggregate 1.4.5 on Google App Engine, the .csv files (when exported) are of the order 1-2 MB.
>
> Thanks for your help
>
> Jim
If the server fails, takes longer than 30 seconds to complete an action, or
if you run out of quota during the upload of a submission, the database
update can be partially completed. When you next try to upload that same
submission, the mix of the partial update and a successful update can lead
to this error.
This is a design flaw in how ODK Aggregate handles submissions.
We don't have the time to work on an ODK Aggregate 2.0 that would fix this
issue.
Fortunately, this happens infrequently.
See the link for how to find and fix the issue.
Unfortunately, Google's "enhancement" to use Google Cloud Platform admin
console is making the recovery from this error much more painful.
···
On Sun, Feb 21, 2016 at 11:24 AM, wrote:
On Tuesday, 16 February 2016 22:40:12 UTC, Jim Hammond wrote:
Hello
I have successfully used the same aggregate server for various
projects, all based on a similar, but not identical xml survey.
But now I am having trouble viewing data from the most recent
deployment of the survey. When on the aggregate website I cannot view the
data, and receive an error message of the format:
"Error: Problem persisting data or accessing data
([RepeatSubmissionType.getValueFromEntity] SQL: SELECT * FROM
opendatakit.RHO14_95_SECTION_LIVESTOCK_LIVESTOCK_REPEAT WHERE _PARENT_AURI
= uuid:f2ea042a-6a48-456d-9b32-a653735965a3 ORDER BY _PARENT_AURI
exception: This request (acdebba31252a269) started at 2016/02/15
09:17:45.331 UTC and was still executing at 2016/02/15 09:18:45.194 UTC.)"
However each time the DATA_TABLE_NAME and uuid:XXXX are different. I
also cannot export the data using the aggregate web interface, or download
using briefcase.
I have tried the instructions posted at " https://github.com/opendatakit/opendatakit/wiki/Aggregate-AppEngine-Troubleshooting"
in order to repair any broken instance, but could not find broken instances
from referred to in the error messages - sometimes the instance could not
be found, and sometimes the instance could be found but didn't show any
duplicates.
I'm running Aggregate 1.4.5 on Google App Engine, the .csv files (when
exported) are of the order 1-2 MB.
Thanks for your help
Jim
Dear Mitch and Jim,
I seem to be facing a similar issue. I am also using ODK Aggregate and a
Google App Engine Server. I have multiple versions of my survey on ODK
Aggregate and I am having trouble downloading data from one specific
version. Up until a few days ago I could download the data but now the
error beow is persisting. I have experience a similar error versions of my
form, but on refreshing the page a few times this error would go away.
Error: Problem persisting data or accessing data (c23_1@parentAuri(uuid:171a68b1-1199-4a08-9444-0cba1400866b)
valueSet is missing an entry OR has an extra copy of one)
I am sensing that the error might be with one specific variable "c23_1".
Is it possible for someone using the tablet to corrupt response codes? The
uuid is the same every time. We have not deleted any data on the devices
and I think I have narrowed down the problem source to one specific device.
How do I figure out which observation is corrupt, if that is the case here?