Cannot transfer data with ODK Briefcase v1.0 Alpha++

Hi,

we try to transfer data from one ODK Aggregate to another and/or to a
Briefcase directory on the filesystem, but we are not able to do so.
The Source is an ODK Aggregate v0.9.5 on Google App Engine. Our new
server is a local Tomcat with ODK Aggregate v1.0 RC2 and a PostgreSQL
database.

We always receive this error message on every form we have:
"Fetching form definition
preparing to retrieve instance data
Error parsing form definition: xmlns attribute for the data model is
not well-formed: 'Biodiversity' should be of the form xmlns="http://
your.domain.org/formId"
Consider defining the formId using the 'id' attribute instead of the
'xmlns' attribute (id="formId")"

How can we transfer/download data without changing every xml form?

Regards!

You DO NOT edit individual submission records to accommodate this change;
you MUST modify the form definition file.

The process for this is unfortunately manual and iterative. The steps are:

(1) download all your data to your Briefcase directory on your local
machine.

(2) manually go into this briefcase directory.

It will contain a \forms directory, and under that, it will contain a
separate directory for each form definition.
Within each of these directories, there will be one XML file that is the
form definition.

e.g., if the briefcase directory is "C:\Users\user\ODK Briefcase" and you
have a "Geo Tagger v2.xml" form, the XML file definig the form definition
would be:

C:\Users\user\ODK Briefcase\forms\Geo Tagger v2\Geo Tagger v2.xml

(3) edit this form definition file using Notepad, Notepad++, or an XML file
editor.

Change the form id definition within the instance to use id=... instead of
xmlns=... .

See
http://code.google.com/p/opendatakit/wiki/XFormDesignGuidelines#Stricter_Form_Syntax_-_Aggregate_1.0

(4) you should then try to individually, manually, upload each of these
forms into Aggregate 1.0 (through the Aggregate 1.0 webpages, NOT with
Briefcase); the webpage provides interactive feedback on other areas of the
form definition that might cause unexpected behavior, in particular, missing
data type definitions. If the fields with undefined data types can all be
treated as string values, then you can ignore the warnings. Otherwise, you
will need to make further updates to the form definition file until you get
all the data types defined appropriately (if you don't, the data will be
saved as string values and you'll get unexpected results if you use
Aggregate 1.0's filters to process your data -- for example, 88 will be less
than 9 because terms beginning with 8's appear before 9's in, e.g., book
indices).

(5) once you have updated the form appropriately for ODK Aggregate 1.0, you
should then be able to run Briefcase and choose to upload all data from the
local briefcase up into the ODK Aggregate 1.0 instance. Note that during
the upload process, it first tries to upload the form definition; you need
to ensure that this file has all the changes you made during step (4).

(6) be sure to copy and save the form definition changes (or be prepared to
download them from the Aggregate 1.0 server), as each time you download data
from any Aggregate server, it will overwrite the form definition file within
the Briefcase application. You will need to copy the revised form
definitions back when you then upload these results into the newer
Aggregate.

Also, at this time, there is no "resume where we left off" concept within
Briefcase. However, for submissions downloaded or uploaded to an ODK
Aggregate instance, those submissions have been assigned unique identifiers
and repeated uploads will not create duplicates in your datastore (though
they will confound the manual mark-as-complete actions on the 1.0 server).

Mitch

··· On Mon, Oct 17, 2011 at 3:50 AM, LETSGO CeLeKT wrote:

Hi,

we try to transfer data from one ODK Aggregate to another and/or to a
Briefcase directory on the filesystem, but we are not able to do so.
The Source is an ODK Aggregate v0.9.5 on Google App Engine. Our new
server is a local Tomcat with ODK Aggregate v1.0 RC2 and a PostgreSQL
database.

We always receive this error message on every form we have:
"Fetching form definition
preparing to retrieve instance data
Error parsing form definition: xmlns attribute for the data model is
not well-formed: 'Biodiversity' should be of the form xmlns="http://
your.domain.org/formId"
Consider defining the formId using the 'id' attribute instead of the
'xmlns' attribute (id="formId")"

How can we transfer/download data without changing every xml form?

Regards!

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

--
Mitch Sundt
Software Engineer


University of Washington
mitchellsundt@gmail.com

Also note u need to upgrade your Aggregate 0.9.5 to 0.9.8

··· On Oct 17, 2011 8:22 AM, "LETSGO CeLeKT" wrote:

Hi,

we try to transfer data from one ODK Aggregate to another and/or to a
Briefcase directory on the filesystem, but we are not able to do so.
The Source is an ODK Aggregate v0.9.5 on Google App Engine. Our new
server is a local Tomcat with ODK Aggregate v1.0 RC2 and a PostgreSQL
database.

We always receive this error message on every form we have:
"Fetching form definition
preparing to retrieve instance data
Error parsing form definition: xmlns attribute for the data model is
not well-formed: 'Biodiversity' should be of the form xmlns="http://
your.domain.org/formId"
Consider defining the formId using the 'id' attribute instead of the
'xmlns' attribute (id="formId")"

How can we transfer/download data without changing every xml form?

Regards!

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

Mitch, thank you very much for this detailed guide!

We really don't want to lose our data.
Is it possible to install the 0.9.8 Aggregate over the 0.9.5 without
any changes to the database?

··· On Oct 18, 1:39 am, "W. Brunette" wrote: > Also note u need to upgrade your Aggregate 0.9.5 to 0.9.8 > On Oct 17, 2011 8:22 AM, "LETSGO CeLeKT" wrote: > > > > > > > > > Hi, > > > we try to transfer data from one ODK Aggregate to another and/or to a > > Briefcase directory on the filesystem, but we are not able to do so. > > The Source is an ODK Aggregate v0.9.5 on Google App Engine. Our new > > server is a local Tomcat with ODK Aggregate v1.0 RC2 and a PostgreSQL > > database. > > > We always receive this error message on every form we have: > > "Fetching form definition > > preparing to retrieve instance data > > Error parsing form definition: xmlns attribute for the data model is > > not well-formed: 'Biodiversity' should be of the form xmlns="http:// > > your.domain.org/formId" > > Consider defining the formId using the 'id' attribute instead of the > > 'xmlns' attribute (id="formId")" > > > How can we transfer/download data without changing every xml form? > > > Regards! > > > -- > > Post: opendatakit@googlegroups.com > > Unsubscribe: opendatakit+unsubscribe@googlegroups.com > > Options:http://groups.google.com/group/opendatakit?hl=en

you can upgrade from .95 to .98 without loosing any data. it's only
.9x to 1.0 that requires using briefcase.

··· On Tue, Oct 18, 2011 at 00:07, LETSGO CeLeKT wrote: > Mitch, thank you very much for this detailed guide! > > We really don't want to lose our data. > Is it possible to install the 0.9.8 Aggregate over the 0.9.5 without > any changes to the database? > > > On Oct 18, 1:39 am, "W. Brunette" wrote: >> Also note u need to upgrade your Aggregate 0.9.5 to 0.9.8 >> On Oct 17, 2011 8:22 AM, "LETSGO CeLeKT" wrote: >> >> >> >> >> >> >> >> > Hi, >> >> > we try to transfer data from one ODK Aggregate to another and/or to a >> > Briefcase directory on the filesystem, but we are not able to do so. >> > The Source is an ODK Aggregate v0.9.5 on Google App Engine. Our new >> > server is a local Tomcat with ODK Aggregate v1.0 RC2 and a PostgreSQL >> > database. >> >> > We always receive this error message on every form we have: >> > "Fetching form definition >> > preparing to retrieve instance data >> > Error parsing form definition: xmlns attribute for the data model is >> > not well-formed: 'Biodiversity' should be of the form xmlns="http:// >> > your.domain.org/formId" >> > Consider defining the formId using the 'id' attribute instead of the >> > 'xmlns' attribute (id="formId")" >> >> > How can we transfer/download data without changing every xml form? >> >> > Regards! >> >> > -- >> > Post: opendatakit@googlegroups.com >> > Unsubscribe: opendatakit+unsubscribe@googlegroups.com >> > Options:http://groups.google.com/group/opendatakit?hl=en > > -- > Post: opendatakit@googlegroups.com > Unsubscribe: opendatakit+unsubscribe@googlegroups.com > Options: http://groups.google.com/group/opendatakit?hl=en >

We upgraded our Aggregate from 0.9.5 to 0.9.8 but we are still not
able to download our data with Briefcase.
Briefcase downloads the forms but all the submission data is missing!

The error is still the same (of course):
"Fetching form definition
preparing to retrieve instance data
Error parsing form definition: xmlns attribute for the data model is
not well-formed: 'WaterQuality_openhouse' should be of the form
xmlns="http://your.domain.org/formId"
Consider defining the formId using the 'id' attribute instead of the
'xmlns' attribute (id="formId")"

So right now we are not able to follow the guide Mitch suggested ("you
should then be able to run Briefcase and choose to upload all data
from the local briefcase").

Any ideas?

··· On Oct 18, 2:37 pm, Yaw Anokwa wrote: > you can upgrade from .95 to .98 without loosing any data. it's only > .9x to 1.0 that requires using briefcase. > > > > > > > > On Tue, Oct 18, 2011 at 00:07, LETSGO CeLeKT wrote: > > Mitch, thank you very much for this detailed guide! > > > We really don't want to lose our data. > > Is it possible to install the 0.9.8 Aggregate over the 0.9.5 without > > any changes to the database? > > > On Oct 18, 1:39 am, "W. Brunette" wrote: > >> Also note u need to upgrade your Aggregate 0.9.5 to 0.9.8 > >> On Oct 17, 2011 8:22 AM, "LETSGO CeLeKT" wrote: > > >> > Hi, > > >> > we try to transfer data from one ODK Aggregate to another and/or to a > >> > Briefcase directory on the filesystem, but we are not able to do so. > >> > The Source is an ODK Aggregate v0.9.5 on Google App Engine. Our new > >> > server is a local Tomcat with ODK Aggregate v1.0 RC2 and a PostgreSQL > >> > database. > > >> > We always receive this error message on every form we have: > >> > "Fetching form definition > >> > preparing to retrieve instance data > >> > Error parsing form definition: xmlns attribute for the data model is > >> > not well-formed: 'Biodiversity' should be of the form xmlns="http:// > >> > your.domain.org/formId" > >> > Consider defining the formId using the 'id' attribute instead of the > >> > 'xmlns' attribute (id="formId")" > > >> > How can we transfer/download data without changing every xml form? > > >> > Regards! > > >> > -- > >> > Post: opendatakit@googlegroups.com > >> > Unsubscribe: opendatakit+unsubscribe@googlegroups.com > >> > Options:http://groups.google.com/group/opendatakit?hl=en > > > -- > > Post: opendatakit@googlegroups.com > > Unsubscribe: opendatakit+unsubscribe@googlegroups.com > > Options:http://groups.google.com/group/opendatakit?hl=en

I'll look into this after I get RC3 out... . This is an issue within the
Briefcase App.

··· On Wed, Oct 19, 2011 at 3:03 AM, LETSGO CeLeKT wrote:

We upgraded our Aggregate from 0.9.5 to 0.9.8 but we are still not
able to download our data with Briefcase.
Briefcase downloads the forms but all the submission data is missing!

The error is still the same (of course):
"Fetching form definition
preparing to retrieve instance data
Error parsing form definition: xmlns attribute for the data model is
not well-formed: 'WaterQuality_openhouse' should be of the form
xmlns="http://your.domain.org/formId"
Consider defining the formId using the 'id' attribute instead of the
'xmlns' attribute (id="formId")"

So right now we are not able to follow the guide Mitch suggested ("you
should then be able to run Briefcase and choose to upload all data
from the local briefcase").

Any ideas?

On Oct 18, 2:37 pm, Yaw Anokwa yano...@gmail.com wrote:

you can upgrade from .95 to .98 without loosing any data. it's only
.9x to 1.0 that requires using briefcase.

On Tue, Oct 18, 2011 at 00:07, LETSGO CeLeKT letsgo.sp...@gmail.com wrote:

Mitch, thank you very much for this detailed guide!

We really don't want to lose our data.
Is it possible to install the 0.9.8 Aggregate over the 0.9.5 without
any changes to the database?

On Oct 18, 1:39 am, "W. Brunette" wbrune...@gmail.com wrote:

Also note u need to upgrade your Aggregate 0.9.5 to 0.9.8
On Oct 17, 2011 8:22 AM, "LETSGO CeLeKT" letsgo.sp...@gmail.com wrote:

Hi,

we try to transfer data from one ODK Aggregate to another and/or to
a

Briefcase directory on the filesystem, but we are not able to do so.
The Source is an ODK Aggregate v0.9.5 on Google App Engine. Our new
server is a local Tomcat with ODK Aggregate v1.0 RC2 and a
PostgreSQL

database.

We always receive this error message on every form we have:
"Fetching form definition
preparing to retrieve instance data
Error parsing form definition: xmlns attribute for the data model is
not well-formed: 'Biodiversity' should be of the form xmlns="http://
your.domain.org/formId"
Consider defining the formId using the 'id' attribute instead of the
'xmlns' attribute (id="formId")"

How can we transfer/download data without changing every xml form?

Regards!

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options:http://groups.google.com/group/opendatakit?hl=en

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options:http://groups.google.com/group/opendatakit?hl=en

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

--
Mitch Sundt
Software Engineer


University of Washington
mitchellsundt@gmail.com

I've created an issue to track this:
http://code.google.com/p/opendatakit/issues/detail?id=385

Mitch

··· On Wed, Oct 19, 2011 at 5:04 PM, Mitch Sundt wrote:

I'll look into this after I get RC3 out... . This is an issue within the
Briefcase App.

On Wed, Oct 19, 2011 at 3:03 AM, LETSGO CeLeKT letsgo.space@gmail.comwrote:

We upgraded our Aggregate from 0.9.5 to 0.9.8 but we are still not
able to download our data with Briefcase.
Briefcase downloads the forms but all the submission data is missing!

The error is still the same (of course):
"Fetching form definition
preparing to retrieve instance data
Error parsing form definition: xmlns attribute for the data model is
not well-formed: 'WaterQuality_openhouse' should be of the form
xmlns="http://your.domain.org/formId"
Consider defining the formId using the 'id' attribute instead of the
'xmlns' attribute (id="formId")"

So right now we are not able to follow the guide Mitch suggested ("you
should then be able to run Briefcase and choose to upload all data
from the local briefcase").

Any ideas?

On Oct 18, 2:37 pm, Yaw Anokwa yano...@gmail.com wrote:

you can upgrade from .95 to .98 without loosing any data. it's only
.9x to 1.0 that requires using briefcase.

On Tue, Oct 18, 2011 at 00:07, LETSGO CeLeKT letsgo.sp...@gmail.com wrote:

Mitch, thank you very much for this detailed guide!

We really don't want to lose our data.
Is it possible to install the 0.9.8 Aggregate over the 0.9.5 without
any changes to the database?

On Oct 18, 1:39 am, "W. Brunette" wbrune...@gmail.com wrote:

Also note u need to upgrade your Aggregate 0.9.5 to 0.9.8
On Oct 17, 2011 8:22 AM, "LETSGO CeLeKT" letsgo.sp...@gmail.com wrote:

Hi,

we try to transfer data from one ODK Aggregate to another and/or to
a

Briefcase directory on the filesystem, but we are not able to do
so.

The Source is an ODK Aggregate v0.9.5 on Google App Engine. Our new
server is a local Tomcat with ODK Aggregate v1.0 RC2 and a
PostgreSQL

database.

We always receive this error message on every form we have:
"Fetching form definition
preparing to retrieve instance data
Error parsing form definition: xmlns attribute for the data model
is

not well-formed: 'Biodiversity' should be of the form
xmlns="http://

your.domain.org/formId"
Consider defining the formId using the 'id' attribute instead of
the

'xmlns' attribute (id="formId")"

How can we transfer/download data without changing every xml form?

Regards!

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options:http://groups.google.com/group/opendatakit?hl=en

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options:http://groups.google.com/group/opendatakit?hl=en

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

--
Mitch Sundt
Software Engineer
http://www.OpenDataKit.org
University of Washington
mitchellsundt@gmail.com

--
Mitch Sundt
Software Engineer


University of Washington
mitchellsundt@gmail.com

Thank you for the new Briefcase Beta App.
We are now able to download the data from our two old App Engine
Aggregates (v.0.9.8). We had lots of warnings and "will be ignored"
messages in the logs, but all the data seems to be downloaded though.

We followed Mitch's guide and edited every xml form and uploaded it
manually to our new ODK Aggregate (v1.0 RC4, PostgreSQL).
The data we downloaded is from two App Engine Aggregates (both
v0.9.8).
When we try to upload the data downloaded from the first Aggregate we
receive following error messages in Briefcase for every form we
upload, but all the data seem to be there though. Except for the
"Starttime" and "Endtime". I checked and compared old and newer
submission.xml files and the date format has changed completely, e.g.
from "Tue May 25 13:55:30 UTC 2010" to
"2011-10-05 10:46:38.192" (the examples are
from different submission.xml files).

Log:
"Preparing for upload of form definition with 0 media attachments
Uploading form definition with no media attachments
Preparing for upload of submission (1 of 21) with 4 media attachments
Uploading submission (1 of 21) and media files 1 through 3 of 4 media
attachments
UPLOAD FAILED: Submission upload failed. Detailed error: Unexpected
exception: Original submission file's submissionDate does not match
that on server! C:\Users...\submission.xml
...
Uploading submission (21 of 21) and 1 remaining media attachments
UPLOAD FAILED: Submission upload failed. Detailed error: Unexpected
exception: Original submission file's submissionDate does not match
that on server! C:\Users...\submission.xml
Partially successful upload..."

But when we try to upload the second server's data we only get a "Form
does not exist" error for every form. Even though we see the forms on
the Aggregate webpage, in the PostgreSQL database AND we can download
and submit them with ODK Collect (1.1.7RC2).

Unfortunately, we don't get a more detailed error message. So we
really don't know what to do next.

··· On Oct 21, 10:53 pm, Mitch Sundt wrote: > I've created an issue to track this:http://code.google.com/p/opendatakit/issues/detail?id=385 > > Mitch > > On Wed, Oct 19, 2011 at 5:04 PM, Mitch Sundt wrote: > > > > > > > > > > > I'll look into this after I get RC3 out... . This is an issue within the > > Briefcase App. > > > On Wed, Oct 19, 2011 at 3:03 AM, LETSGO CeLeKT wrote: > > >> We upgraded our Aggregate from 0.9.5 to 0.9.8 but we are still not > >> able to download our data with Briefcase. > >> Briefcase downloads the forms but all the submission data is missing! > > >> The error is still the same (of course): > >> "Fetching form definition > >> preparing to retrieve instance data > >> Error parsing form definition: xmlns attribute for the data model is > >> not well-formed: 'WaterQuality_openhouse' should be of the form > >> xmlns="http://your.domain.org/formId" > >> Consider defining the formId using the 'id' attribute instead of the > >> 'xmlns' attribute (id="formId")" > > >> So right now we are not able to follow the guide Mitch suggested ("you > >> should then be able to run Briefcase and choose to upload all data > >> from the local briefcase"). > > >> Any ideas? > > >> On Oct 18, 2:37 pm, Yaw Anokwa wrote: > >> > you can upgrade from .95 to .98 without loosing any data. it's only > >> > .9x to 1.0 that requires using briefcase. > > >> > On Tue, Oct 18, 2011 at 00:07, LETSGO CeLeKT wrote: > >> > > Mitch, thank you very much for this detailed guide! > > >> > > We really don't want to lose our data. > >> > > Is it possible to install the 0.9.8 Aggregate over the 0.9.5 without > >> > > any changes to the database? > > >> > > On Oct 18, 1:39 am, "W. Brunette" wrote: > >> > >> Also note u need to upgrade your Aggregate 0.9.5 to 0.9.8 > >> > >> On Oct 17, 2011 8:22 AM, "LETSGO CeLeKT" wrote: > > >> > >> > Hi, > > >> > >> > we try to transfer data from one ODK Aggregate to another and/or to > >> a > >> > >> > Briefcase directory on the filesystem, but we are not able to do > >> so. > >> > >> > The Source is an ODK Aggregate v0.9.5 on Google App Engine. Our new > >> > >> > server is a local Tomcat with ODK Aggregate v1.0 RC2 and a > >> PostgreSQL > >> > >> > database. > > >> > >> > We always receive this error message on every form we have: > >> > >> > "Fetching form definition > >> > >> > preparing to retrieve instance data > >> > >> > Error parsing form definition: xmlns attribute for the data model > >> is > >> > >> > not well-formed: 'Biodiversity' should be of the form > >> xmlns="http:// > >> > >> > your.domain.org/formId" > >> > >> > Consider defining the formId using the 'id' attribute instead of > >> the > >> > >> > 'xmlns' attribute (id="formId")" > > >> > >> > How can we transfer/download data without changing every xml form? > > >> > >> > Regards! > > >> > >> > -- > >> > >> > Post: opendatakit@googlegroups.com > >> > >> > Unsubscribe: opendatakit+unsubscribe@googlegroups.com > >> > >> > Options:http://groups.google.com/group/opendatakit?hl=en > > >> > > -- > >> > > Post: opendatakit@googlegroups.com > >> > > Unsubscribe: opendatakit+unsubscribe@googlegroups.com > >> > > Options:http://groups.google.com/group/opendatakit?hl=en > > >> -- > >> Post: opendatakit@googlegroups.com > >> Unsubscribe: opendatakit+unsubscribe@googlegroups.com > >> Options:http://groups.google.com/group/opendatakit?hl=en > > > -- > > Mitch Sundt > > Software Engineer > >http://www.OpenDataKit.org > > University of Washington > > mitchellsu...@gmail.com > > -- > Mitch Sundt > Software Engineerhttp://www.OpenDataKit.org > University of Washington > mitchellsu...@gmail.com

Created this issue:
http://code.google.com/p/opendatakit/issues/detail?id=406 to track this.

I think this is the issue with the 2nd upload not going through:

Can you double-check that the form XML file is named the same as the form
directory on your local machine? I.e., that you have:

forms\Geo Tagger v2\Geo Tagger v2.xml

The form definition filename must have exactly the same name portion as the
enclosing folder. Depending upon what editor you are using, it might
append .txt and change the file type to "Text Document" rather than leave
it as "XML File".
If that happens, you will need to rename the file and remove the extra
".txt" extension.

Mitch

··· On Mon, Oct 31, 2011 at 6:34 AM, LETSGO CeLeKT wrote:

Thank you for the new Briefcase Beta App.
We are now able to download the data from our two old App Engine
Aggregates (v.0.9.8). We had lots of warnings and "will be ignored"
messages in the logs, but all the data seems to be downloaded though.

We followed Mitch's guide and edited every xml form and uploaded it
manually to our new ODK Aggregate (v1.0 RC4, PostgreSQL).
The data we downloaded is from two App Engine Aggregates (both
v0.9.8).
When we try to upload the data downloaded from the first Aggregate we
receive following error messages in Briefcase for every form we
upload, but all the data seem to be there though. Except for the
"Starttime" and "Endtime". I checked and compared old and newer
submission.xml files and the date format has changed completely, e.g.
from "Tue May 25 13:55:30 UTC 2010" to
"2011-10-05 10:46:38.192" (the examples are
from different submission.xml files).

Log:
"Preparing for upload of form definition with 0 media attachments
Uploading form definition with no media attachments
Preparing for upload of submission (1 of 21) with 4 media attachments
Uploading submission (1 of 21) and media files 1 through 3 of 4 media
attachments
UPLOAD FAILED: Submission upload failed. Detailed error: Unexpected
exception: Original submission file's submissionDate does not match
that on server! C:\Users...\submission.xml
...
Uploading submission (21 of 21) and 1 remaining media attachments
UPLOAD FAILED: Submission upload failed. Detailed error: Unexpected
exception: Original submission file's submissionDate does not match
that on server! C:\Users...\submission.xml
Partially successful upload..."

But when we try to upload the second server's data we only get a "Form
does not exist" error for every form. Even though we see the forms on
the Aggregate webpage, in the PostgreSQL database AND we can download
and submit them with ODK Collect (1.1.7RC2).

Unfortunately, we don't get a more detailed error message. So we
really don't know what to do next.

On Oct 21, 10:53 pm, Mitch Sundt msu...@cs.washington.edu wrote:

I've created an issue to track this:
http://code.google.com/p/opendatakit/issues/detail?id=385

Mitch

On Wed, Oct 19, 2011 at 5:04 PM, Mitch Sundt <msu...@cs.washington.edu wrote:

I'll look into this after I get RC3 out... . This is an issue within
the

Briefcase App.

On Wed, Oct 19, 2011 at 3:03 AM, LETSGO CeLeKT <letsgo.sp...@gmail.com wrote:

We upgraded our Aggregate from 0.9.5 to 0.9.8 but we are still not
able to download our data with Briefcase.
Briefcase downloads the forms but all the submission data is missing!

The error is still the same (of course):
"Fetching form definition
preparing to retrieve instance data
Error parsing form definition: xmlns attribute for the data model is
not well-formed: 'WaterQuality_openhouse' should be of the form
xmlns="http://your.domain.org/formId"
Consider defining the formId using the 'id' attribute instead of the
'xmlns' attribute (id="formId")"

So right now we are not able to follow the guide Mitch suggested ("you
should then be able to run Briefcase and choose to upload all data
from the local briefcase").

Any ideas?

On Oct 18, 2:37 pm, Yaw Anokwa yano...@gmail.com wrote:

you can upgrade from .95 to .98 without loosing any data. it's only
.9x to 1.0 that requires using briefcase.

On Tue, Oct 18, 2011 at 00:07, LETSGO CeLeKT < letsgo.sp...@gmail.com> wrote:

Mitch, thank you very much for this detailed guide!

We really don't want to lose our data.
Is it possible to install the 0.9.8 Aggregate over the 0.9.5
without

any changes to the database?

On Oct 18, 1:39 am, "W. Brunette" wbrune...@gmail.com wrote:

Also note u need to upgrade your Aggregate 0.9.5 to 0.9.8
On Oct 17, 2011 8:22 AM, "LETSGO CeLeKT" <letsgo.sp...@gmail.com wrote:

Hi,

we try to transfer data from one ODK Aggregate to another
and/or to

a

Briefcase directory on the filesystem, but we are not able to
do

so.

The Source is an ODK Aggregate v0.9.5 on Google App Engine.
Our new

server is a local Tomcat with ODK Aggregate v1.0 RC2 and a
PostgreSQL

database.

We always receive this error message on every form we have:
"Fetching form definition
preparing to retrieve instance data
Error parsing form definition: xmlns attribute for the data
model

is

not well-formed: 'Biodiversity' should be of the form
xmlns="http://

your.domain.org/formId"
Consider defining the formId using the 'id' attribute instead
of

the

'xmlns' attribute (id="formId")"

How can we transfer/download data without changing every xml
form?

Regards!

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options:http://groups.google.com/group/opendatakit?hl=en

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options:http://groups.google.com/group/opendatakit?hl=en

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options:http://groups.google.com/group/opendatakit?hl=en

--
Mitch Sundt
Software Engineer
http://www.OpenDataKit.org
University of Washington
mitchellsu...@gmail.com

--
Mitch Sundt
Software Engineerhttp://www.OpenDataKit.org
University of Washington
mitchellsu...@gmail.com

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

--
Mitch Sundt
Software Engineer


University of Washington
mitchellsundt@gmail.com

Thank you for this hint!
Now we could upload all of our data.
The problem was not the directory name nor the file name. But we had
to change the "form title" in the form definition to fit the directory
and file name. But we have no idea why we had to do this step now,
because we didn't have to do it for the data from the first server.
Anyway, no it worked fine. Except for the same error messages with the
dates...
I will attach the submission files for further information.

Regards!

··· On Oct 31, 5:54 pm, Mitch Sundt wrote: > Created this issue:http://code.google.com/p/opendatakit/issues/detail?id=406 to track this. > > I think this is the issue with the 2nd upload not going through: > > Can you double-check that the form XML file is named the same as the form > directory on your local machine? I.e., that you have: > > forms\Geo Tagger v2\Geo Tagger v2.xml > > The form definition filename must have exactly the same name portion as the > enclosing folder. Depending upon what editor you are using, it might > append .txt and change the file type to "Text Document" rather than leave > it as "XML File". > If that happens, you will need to rename the file and remove the extra > ".txt" extension. > > Mitch > > On Mon, Oct 31, 2011 at 6:34 AM, LETSGO CeLeKT wrote: > > > > > > > > > > > Thank you for the new Briefcase Beta App. > > We are now able to download the data from our two old App Engine > > Aggregates (v.0.9.8). We had lots of warnings and "will be ignored" > > messages in the logs, but all the data seems to be downloaded though. > > > We followed Mitch's guide and edited every xml form and uploaded it > > manually to our new ODK Aggregate (v1.0 RC4, PostgreSQL). > > The data we downloaded is from two App Engine Aggregates (both > > v0.9.8). > > When we try to upload the data downloaded from the first Aggregate we > > receive following error messages in Briefcase for every form we > > upload, but all the data seem to be there though. Except for the > > "Starttime" and "Endtime". I checked and compared old and newer > > submission.xml files and the date format has changed completely, e.g. > > from "Tue May 25 13:55:30 UTC 2010" to > > "2011-10-05 10:46:38.192" (the examples are > > from different submission.xml files). > > > Log: > > "Preparing for upload of form definition with 0 media attachments > > Uploading form definition with no media attachments > > Preparing for upload of submission (1 of 21) with 4 media attachments > > Uploading submission (1 of 21) and media files 1 through 3 of 4 media > > attachments > > UPLOAD FAILED: Submission upload failed. Detailed error: Unexpected > > exception: Original submission file's submissionDate does not match > > that on server! C:\Users\...\submission.xml > > ... > > Uploading submission (21 of 21) and 1 remaining media attachments > > UPLOAD FAILED: Submission upload failed. Detailed error: Unexpected > > exception: Original submission file's submissionDate does not match > > that on server! C:\Users\...\submission.xml > > Partially successful upload..." > > > But when we try to upload the second server's data we only get a "Form > > does not exist" error for every form. Even though we see the forms on > > the Aggregate webpage, in the PostgreSQL database AND we can download > > and submit them with ODK Collect (1.1.7RC2). > > > Unfortunately, we don't get a more detailed error message. So we > > really don't know what to do next. > > > On Oct 21, 10:53 pm, Mitch Sundt wrote: > > > I've created an issue to track this: > >http://code.google.com/p/opendatakit/issues/detail?id=385 > > > > Mitch > > > > On Wed, Oct 19, 2011 at 5:04 PM, Mitch Sundt > > > > I'll look into this after I get RC3 out... . This is an issue within > > the > > > > Briefcase App. > > > > > On Wed, Oct 19, 2011 at 3:03 AM, LETSGO CeLeKT > > > >> We upgraded our Aggregate from 0.9.5 to 0.9.8 but we are still not > > > >> able to download our data with Briefcase. > > > >> Briefcase downloads the forms but all the submission data is missing! > > > > >> The error is still the same (of course): > > > >> "Fetching form definition > > > >> preparing to retrieve instance data > > > >> Error parsing form definition: xmlns attribute for the data model is > > > >> not well-formed: 'WaterQuality_openhouse' should be of the form > > > >> xmlns="http://your.domain.org/formId" > > > >> Consider defining the formId using the 'id' attribute instead of the > > > >> 'xmlns' attribute (id="formId")" > > > > >> So right now we are not able to follow the guide Mitch suggested ("you > > > >> should then be able to run Briefcase and choose to upload all data > > > >> from the local briefcase"). > > > > >> Any ideas? > > > > >> On Oct 18, 2:37 pm, Yaw Anokwa wrote: > > > >> > you can upgrade from .95 to .98 without loosing any data. it's only > > > >> > .9x to 1.0 that requires using briefcase. > > > > >> > On Tue, Oct 18, 2011 at 00:07, LETSGO CeLeKT < letsgo.sp...@gmail.com> wrote: > > > >> > > Mitch, thank you very much for this detailed guide! > > > > >> > > We really don't want to lose our data. > > > >> > > Is it possible to install the 0.9.8 Aggregate over the 0.9.5 > > without > > > >> > > any changes to the database? > > > > >> > > On Oct 18, 1:39 am, "W. Brunette" wrote: > > > >> > >> Also note u need to upgrade your Aggregate 0.9.5 to 0.9.8 > > > >> > >> On Oct 17, 2011 8:22 AM, "LETSGO CeLeKT" > > > >> > >> > Hi, > > > > >> > >> > we try to transfer data from one ODK Aggregate to another > > and/or to > > > >> a > > > >> > >> > Briefcase directory on the filesystem, but we are not able to > > do > > > >> so. > > > >> > >> > The Source is an ODK Aggregate v0.9.5 on Google App Engine. > > Our new > > > >> > >> > server is a local Tomcat with ODK Aggregate v1.0 RC2 and a > > > >> PostgreSQL > > > >> > >> > database. > > > > >> > >> > We always receive this error message on every form we have: > > > >> > >> > "Fetching form definition > > > >> > >> > preparing to retrieve instance data > > > >> > >> > Error parsing form definition: xmlns attribute for the data > > model > > > >> is > > > >> > >> > not well-formed: 'Biodiversity' should be of the form > > > >> xmlns="http:// > > > >> > >> > your.domain.org/formId" > > > >> > >> > Consider defining the formId using the 'id' attribute instead > > of > > > >> the > > > >> > >> > 'xmlns' attribute (id="formId")" > > > > >> > >> > How can we transfer/download data without changing every xml > > form? > > > > >> > >> > Regards! > > > > >> > >> > -- > > > >> > >> > Post: opendatakit@googlegroups.com > > > >> > >> > Unsubscribe: opendatakit+unsubscribe@googlegroups.com > > > >> > >> > Options:http://groups.google.com/group/opendatakit?hl=en > > > > >> > > -- > > > >> > > Post: opendatakit@googlegroups.com > > > >> > > Unsubscribe: opendatakit+unsubscribe@googlegroups.com > > > >> > > Options:http://groups.google.com/group/opendatakit?hl=en > > > > >> -- > > > >> Post: opendatakit@googlegroups.com > > > >> Unsubscribe: opendatakit+unsubscribe@googlegroups.com > > > >> Options:http://groups.google.com/group/opendatakit?hl=en > > > > > -- > > > > Mitch Sundt > > > > Software Engineer > > > >http://www.OpenDataKit.org > > > > University of Washington > > > > mitchellsu...@gmail.com > > > > -- > > > Mitch Sundt > > > Software Engineerhttp://www.OpenDataKit.org > > > University of Washington > > > mitchellsu...@gmail.com > > > -- > > Post: opendatakit@googlegroups.com > > Unsubscribe: opendatakit+unsubscribe@googlegroups.com > > Options:http://groups.google.com/group/opendatakit?hl=en > > -- > Mitch Sundt > Software Engineerhttp://www.OpenDataKit.org > University of Washington > mitchellsu...@gmail.com