[Aggregate] Error: Problem persisting data or accessing data

Dear ODK community,

I am facing difficulties in exporting datasets from Aggregate. As I was looking for solutions for days and nobody could help me so far, I was wondering whether the ODK community might have some ideas. The situation is as follows:

First of all, when I start my virtual machine and launch and log in into Aggregate, I get the error message

"Error: Problem persisting data or accessing data (org.springframework.jdbc.UncategorizedSQLException: PreparedStatementCallback; uncategorized SQLException for SQL [SELECT "_URI", "_CREATOR_URI_USER", "_CREATION_DATE", "_LAST_UPDATE_URI_USER", "_LAST_UPDATE_DATE", "URI_MD5_FORM_ID", "AURI_SERVICE", "EXT_SERVICE_TYPE", "EXTERNAL_SERVICE_OPTION", "IS_EXTERNAL_SERVICE_PREPARED", "OPERATIONAL_STATUS", "ESTABLISHMENT_DATETIME", "UPLOAD_COMPLETED", "LAST_UPLOAD_PERSISTENCE_CURSOR", "LAST_UPLOAD_KEY", "LAST_STREAMING_PERSISTENCE_CURSOR", "LAST_STREAMING_KEY", "FORM_ID" FROM "aggregate"."_form_service_cursor" WHERE "URI_MD5_FORM_ID" = ? ORDER BY "URI_MD5_FORM_ID" ASC ;]; SQL state [XX002]; error code [0]; ERROR: index "_form_service_cursor_umfi" contains unexpected zero page at block 0
Hint: Please REINDEX it.; nested exception is org.postgresql.util.PSQLException: ERROR: index "_form_service_cursor_umfi" contains unexpected zero page at block 0
Hint: Please REINDEX it.)"

followed by the pop up

"Unable to retrieve users from server: Unable to retrieve granted authorities of USER_IS_ANONYMOUS"

Now, I have various forms and datasets (both uploaded via WiFi as well via USB-cable), but every time I try to export them as a csv, I get the error message

"Error: Problem persisting data or accessing data"

It seems that there's no way to download the data from Aggregate. As I also got an error message from the VMware player ("Binary translation is incompatible with long mode on this platform"), I thought that might have been the problem. After having changed the VT-option (Virtualization Technology) in the BIOS, the VM runs smoothly, but I'm still not able to export data from Aggregate.
I therefore don't have any ideas anymore where to look for the problem, particularly because apparently my setup is the same like other computers, where it works without any problem. Do you guys have an idea what this issue might be about?

Thanks in advance,

Michael

Hint: Please REINDEX it.; nested exception is org.postgresql.util.
PSQLException: ERROR: index "_form_service_cursor_umfi" contains unexpected
zero page at block 0
Hint: Please REINDEX it.)"

Doesn't the error message spell out exactly what you need to do?

NOTE: This is not an ODK Aggregate error message -- this is simply what the
database layer reported back to ODK Aggregate, and what it then reported on
to you.

If you don't understand what you need to do to reindex the table, you will
need to hire a PostgreSQL Database Administrator to assist you.

Mitch

··· On Mon, Aug 4, 2014 at 7:57 AM, Michael wrote:

Dear ODK community,

I am facing difficulties in exporting datasets from Aggregate. As I was
looking for solutions for days and nobody could help me so far, I was
wondering whether the ODK community might have some ideas. The situation is
as follows:

First of all, when I start my virtual machine and launch and log in into
Aggregate, I get the error message

"Error: Problem persisting data or accessing data
(org.springframework.jdbc.UncategorizedSQLException:
PreparedStatementCallback; uncategorized SQLException for SQL [SELECT
"_URI", "_CREATOR_URI_USER", "_CREATION_DATE", "_LAST_UPDATE_URI_USER",
"_LAST_UPDATE_DATE", "URI_MD5_FORM_ID", "AURI_SERVICE", "EXT_SERVICE_TYPE",
"EXTERNAL_SERVICE_OPTION", "IS_EXTERNAL_SERVICE_PREPARED",
"OPERATIONAL_STATUS", "ESTABLISHMENT_DATETIME", "UPLOAD_COMPLETED",
"LAST_UPLOAD_PERSISTENCE_CURSOR", "LAST_UPLOAD_KEY",
"LAST_STREAMING_PERSISTENCE_CURSOR", "LAST_STREAMING_KEY", "FORM_ID" FROM
"aggregate"."_form_service_cursor" WHERE "URI_MD5_FORM_ID" = ? ORDER BY
"URI_MD5_FORM_ID" ASC ;]; SQL state [XX002]; error code [0]; ERROR: index
"_form_service_cursor_umfi" contains unexpected zero page at block 0
Hint: Please REINDEX it.; nested exception is
org.postgresql.util.PSQLException: ERROR: index "_form_service_cursor_umfi"
contains unexpected zero page at block 0
Hint: Please REINDEX it.)"

followed by the pop up

"Unable to retrieve users from server: Unable to retrieve granted
authorities of USER_IS_ANONYMOUS"

Now, I have various forms and datasets (both uploaded via WiFi as well via
USB-cable), but every time I try to export them as a csv, I get the error
message

"Error: Problem persisting data or accessing data"

It seems that there's no way to download the data from Aggregate. As I
also got an error message from the VMware player ("Binary translation is
incompatible with long mode on this platform"), I thought that might have
been the problem. After having changed the VT-option (Virtualization
Technology) in the BIOS, the VM runs smoothly, but I'm still not able to
export data from Aggregate.
I therefore don't have any ideas anymore where to look for the problem,
particularly because apparently my setup is the same like other computers,
where it works without any problem. Do you guys have an idea what this
issue might be about?

Thanks in advance,

Michael

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to the Google Groups
"ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
Mitch Sundt
Software Engineer
University of Washington
mitchellsundt@gmail.com

Dear Mitch, dear Yaw,

thanks a lot for your advice. As I'm just working with ODK, I will try to
find the one who set the database up.

Thanks again and best regards,

Michael

Hint: Please REINDEX it.; nested exception is org.postgresql.util.
PSQLException: ERROR: index "_form_service_cursor_umfi" contains
unexpected zero page at block 0
Hint: Please REINDEX it.)"

Doesn't the error message spell out exactly what you need to do?

NOTE: This is not an ODK Aggregate error message -- this is simply what
the database layer reported back to ODK Aggregate, and what it then
reported on to you.

If you don't understand what you need to do to reindex the table, you will

need to hire a PostgreSQL Database Administrator to assist you.

Hello Mitch,

thanks for your feedback. I understand that's an SQL error, but indeed I
don't understand how to reindex the table. As you suggest to hire a
professional database admin, I assume there's not 'simple' option to
reindex the table?

Best,

Michael

Michael,

I don't use PostgreSQL myself, but you can search online for examples
of how to log into the database. Then from there, you'll have to run
'reindex _form_service_cursor_umfi'

You might also try logging in with one of these tools.
https://wiki.postgresql.org/wiki/Community_Guide_to_PostgreSQL_GUI_Tools

Yaw

··· -- Need ODK services? http://nafundi.com provides form design, server setup, professional support, and software development for ODK.

On Tue, Aug 5, 2014 at 10:20 PM, Michael malkiefaraway@gmail.com wrote:

Hint: Please REINDEX it.; nested exception is org.postgresql.util.
PSQLException: ERROR: index "_form_service_cursor_umfi" contains
unexpected zero page at block 0
Hint: Please REINDEX it.)"

Doesn't the error message spell out exactly what you need to do?

NOTE: This is not an ODK Aggregate error message -- this is simply what
the database layer reported back to ODK Aggregate, and what it then reported
on to you.

If you don't understand what you need to do to reindex the table, you will
need to hire a PostgreSQL Database Administrator to assist you.

Hello Mitch,

thanks for your feedback. I understand that's an SQL error, but indeed I
don't understand how to reindex the table. As you suggest to hire a
professional database admin, I assume there's not 'simple' option to reindex
the table?

Best,

Michael

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to the Google Groups
"ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

For everyone on the list -- if you are setting up your own server and
database, and do not know how to manage the database, you are playing with
fire.

For PostgreSQL, some of the maintenance activities are covered here

For MySQL, you should be doing regular backups of the database. We use the
InnoDB storage engine (not ISAM). I can't find a good summary of
maintenance tasks for just that.

In any case, at the very least, I hope you are doing routine back-ups of
your server so that when the database crashes, you have something to
restore back to.

If you value your data, and have internet access, the costs of Google
AppEngine are very minimal for the vastly higher degree of crash-protection
it affords.

Other groups, such as SurveyCTO and FormHub provide servers and supply
their own database management expertise for groups who do not possess it.

··· On Wed, Aug 6, 2014 at 6:42 AM, Yaw Anokwa wrote:

Michael,

I don't use PostgreSQL myself, but you can search online for examples
of how to log into the database. Then from there, you'll have to run
'reindex _form_service_cursor_umfi'

You might also try logging in with one of these tools.
https://wiki.postgresql.org/wiki/Community_Guide_to_PostgreSQL_GUI_Tools

Yaw

Need ODK services? http://nafundi.com provides form design, server
setup, professional support, and software development for ODK.

On Tue, Aug 5, 2014 at 10:20 PM, Michael malkiefaraway@gmail.com wrote:

Hint: Please REINDEX it.; nested exception is org.postgresql.util.
PSQLException: ERROR: index "_form_service_cursor_umfi" contains
unexpected zero page at block 0
Hint: Please REINDEX it.)"

Doesn't the error message spell out exactly what you need to do?

NOTE: This is not an ODK Aggregate error message -- this is simply what
the database layer reported back to ODK Aggregate, and what it then
reported
on to you.

If you don't understand what you need to do to reindex the table, you
will
need to hire a PostgreSQL Database Administrator to assist you.

Hello Mitch,

thanks for your feedback. I understand that's an SQL error, but indeed I
don't understand how to reindex the table. As you suggest to hire a
professional database admin, I assume there's not 'simple' option to
reindex
the table?

Best,

Michael

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to the Google Groups
"ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to the Google Groups
"ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
Mitch Sundt
Software Engineer
University of Washington
mitchellsundt@gmail.com