XML Data Not showing up when uploaded from tablet

Hi Guys,

We've recently encountered a problem where some of the data that was
uploaded to the server from the tablet was not showing up in the csv
file. All the data that we had uploaded said 'successful upload' but
all the data wasn't present in the csv file.

We looked at the instances folder in the tablet and got the following
error message when opening the xml data using a browser:
"XML document must have a top level element. Error processing resource
'file:///C:/Documents and Settings/ivelez/Desktop/USB..."

When opened with Notepad, the file was completely empty with a size of
0kb.

Do you know why this might be happening?

Thanks in Advance,

Sanjeev Swamy

What version of ODK Aggregate were you using?

How did you produce the CSV?

  • by choosing Export CSV on Aggregate
  • by using ODK Briefcase

Repeat groups are not emitted with Export CSV.
The ODK Briefcase 1.0 Betas have a bug where only the first repeat is
output.

Also, if using ODK Aggregate 1.0.x, look under the Form Management /
Submission Admin tab.
Are there any submissions listed here? These submissions would not be
exported to CSV.
Submissions appear under this tab if they are missing one or more image,
audio or video captures.

Mitch

··· On Fri, Jan 6, 2012 at 1:30 PM, Sanjeev wrote:

Hi Guys,

We've recently encountered a problem where some of the data that was
uploaded to the server from the tablet was not showing up in the csv
file. All the data that we had uploaded said 'successful upload' but
all the data wasn't present in the csv file.

We looked at the instances folder in the tablet and got the following
error message when opening the xml data using a browser:
"XML document must have a top level element. Error processing resource
'file:///C:/Documents and Settings/ivelez/Desktop/USB..."

When opened with Notepad, the file was completely empty with a size of
0kb.

Do you know why this might be happening?

Thanks in Advance,

Sanjeev Swamy

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

--
Mitch Sundt
Software Engineer
University of Washington
mitchellsundt@gmail.com

Hi Mitch,

We're using version 1.0.1 Production.

The csv were produced by exporting on aggregate. We did not have any
repeat groups in our survey nor videos or images. There are no
submissions under Submission Admin tab.

Now we are getting this error when sending the form:

: (Form Name) Error: Internal server error (500) at
http://(servername).appspot.com/submission

Thank You,

Sanjeev

··· On Jan 6, 6:10 pm, Mitch S wrote: > What version of ODK Aggregate were you using? > > How did you produce the CSV? > - by choosing Export CSV on Aggregate > - by using ODK Briefcase > > Repeat groups are not emitted with Export CSV. > The ODK Briefcase 1.0 Betas have a bug where only the first repeat is > output. > > Also, if using ODK Aggregate 1.0.x, look under the Form Management / > Submission Admin tab. > Are there any submissions listed here? These submissions would not be > exported to CSV. > Submissions appear under this tab if they are missing one or more image, > audio or video captures. > > Mitch > > > > > > > > > > On Fri, Jan 6, 2012 at 1:30 PM, Sanjeev wrote: > > Hi Guys, > > > We've recently encountered a problem where some of the data that was > > uploaded to the server from the tablet was not showing up in the csv > > file. All the data that we had uploaded said 'successful upload' but > > all the data wasn't present in the csv file. > > > We looked at the instances folder in the tablet and got the following > > error message when opening the xml data using a browser: > > "XML document must have a top level element. Error processing resource > > 'file:///C:/Documents and Settings/ivelez/Desktop/USB..." > > > When opened with Notepad, the file was completely empty with a size of > > 0kb. > > > Do you know why this might be happening? > > > Thanks in Advance, > > > Sanjeev Swamy > > > -- > > Post: opendatakit@googlegroups.com > > Unsubscribe: opendatakit+unsubscribe@googlegroups.com > > Options:http://groups.google.com/group/opendatakit?hl=en > > -- > Mitch Sundt > Software Engineer > University of Washington > mitchellsu...@gmail.com

Pre-1.0.2, the 500 error is generally an indication that you've exceeded
your free quota on appspot.
If you upgrade to 1.0.3, it will make more efficient use of Appspot
resources.

However, it is likely that the quota limit is also being hit when you
export, and that is causing the partial data files. You will likely need
to enable billing (via the dashboard at https://appengine.google.com/ ) or
qualify as a non-profit to get billing waived or reduced (
http://www.google.com/nonprofits/ ).

Mitch

··· On Fri, Jan 6, 2012 at 5:33 PM, Sanjeev wrote:

Hi Mitch,

We're using version 1.0.1 Production.

The csv were produced by exporting on aggregate. We did not have any
repeat groups in our survey nor videos or images. There are no
submissions under Submission Admin tab.

Now we are getting this error when sending the form:

: (Form Name) Error: Internal server error (500) at
http://(servername).appspot.com/submission

Thank You,

Sanjeev

On Jan 6, 6:10 pm, Mitch S mitchellsu...@gmail.com wrote:

What version of ODK Aggregate were you using?

How did you produce the CSV?

  • by choosing Export CSV on Aggregate
  • by using ODK Briefcase

Repeat groups are not emitted with Export CSV.
The ODK Briefcase 1.0 Betas have a bug where only the first repeat is
output.

Also, if using ODK Aggregate 1.0.x, look under the Form Management /
Submission Admin tab.
Are there any submissions listed here? These submissions would not be
exported to CSV.
Submissions appear under this tab if they are missing one or more image,
audio or video captures.

Mitch

On Fri, Jan 6, 2012 at 1:30 PM, Sanjeev swamy.sanj...@gmail.com wrote:

Hi Guys,

We've recently encountered a problem where some of the data that was
uploaded to the server from the tablet was not showing up in the csv
file. All the data that we had uploaded said 'successful upload' but
all the data wasn't present in the csv file.

We looked at the instances folder in the tablet and got the following
error message when opening the xml data using a browser:
"XML document must have a top level element. Error processing resource
'file:///C:/Documents and Settings/ivelez/Desktop/USB..."

When opened with Notepad, the file was completely empty with a size of
0kb.

Do you know why this might be happening?

Thanks in Advance,

Sanjeev Swamy

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options:http://groups.google.com/group/opendatakit?hl=en

--
Mitch Sundt
Software Engineer
University of Washington
mitchellsu...@gmail.com

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

--
Mitch Sundt
Software Engineer
University of Washington
mitchellsundt@gmail.com

Hi Mitch,

We have already enabled billing. The data sometimes shows as
successfully exported but when we open the xml data file, it is being
shown as empty which has us a little worried. We fear the data is
lost.

Could you let us know what steps we can take to remedy this?

Thank You,

Sanjeev

··· On Jan 9, 1:00 pm, Mitch S wrote: > Pre-1.0.2, the 500 error is generally an indication that you've exceeded > your free quota on appspot. > If you upgrade to 1.0.3, it will make more efficient use of Appspot > resources. > > However, it is likely that the quota limit is also being hit when you > export, and that is causing the partial data files. You will likely need > to enable billing (via the dashboard athttps://appengine.google.com/) or > qualify as a non-profit to get billing waived or reduced (http://www.google.com/nonprofits/). > > Mitch > > > > > > > > > > On Fri, Jan 6, 2012 at 5:33 PM, Sanjeev wrote: > > Hi Mitch, > > > We're using version 1.0.1 Production. > > > The csv were produced by exporting on aggregate. We did not have any > > repeat groups in our survey nor videos or images. There are no > > submissions under Submission Admin tab. > > > Now we are getting this error when sending the form: > > > : (Form Name) Error: Internal server error (500) at > > http://(servername).appspot.com/submission > > > Thank You, > > > Sanjeev > > > On Jan 6, 6:10 pm, Mitch S wrote: > > > What version of ODK Aggregate were you using? > > > > How did you produce the CSV? > > > - by choosing Export CSV on Aggregate > > > - by using ODK Briefcase > > > > Repeat groups are not emitted with Export CSV. > > > The ODK Briefcase 1.0 Betas have a bug where only the first repeat is > > > output. > > > > Also, if using ODK Aggregate 1.0.x, look under the Form Management / > > > Submission Admin tab. > > > Are there any submissions listed here? These submissions would not be > > > exported to CSV. > > > Submissions appear under this tab if they are missing one or more image, > > > audio or video captures. > > > > Mitch > > > > On Fri, Jan 6, 2012 at 1:30 PM, Sanjeev wrote: > > > > Hi Guys, > > > > > We've recently encountered a problem where some of the data that was > > > > uploaded to the server from the tablet was not showing up in the csv > > > > file. All the data that we had uploaded said 'successful upload' but > > > > all the data wasn't present in the csv file. > > > > > We looked at the instances folder in the tablet and got the following > > > > error message when opening the xml data using a browser: > > > > "XML document must have a top level element. Error processing resource > > > > 'file:///C:/Documents and Settings/ivelez/Desktop/USB..." > > > > > When opened with Notepad, the file was completely empty with a size of > > > > 0kb. > > > > > Do you know why this might be happening? > > > > > Thanks in Advance, > > > > > Sanjeev Swamy > > > > > -- > > > > Post: opendatakit@googlegroups.com > > > > Unsubscribe: opendatakit+unsubscribe@googlegroups.com > > > > Options:http://groups.google.com/group/opendatakit?hl=en > > > > -- > > > Mitch Sundt > > > Software Engineer > > > University of Washington > > > mitchellsu...@gmail.com > > > -- > > Post: opendatakit@googlegroups.com > > Unsubscribe: opendatakit+unsubscribe@googlegroups.com > > Options:http://groups.google.com/group/opendatakit?hl=en > > -- > Mitch Sundt > Software Engineer > University of Washington > mitchellsu...@gmail.com

First, upgrade to 1.0.3.
http://code.google.com/p/opendatakit/wiki/AggregateReleaseNotes

And confirm that the problem is still occurring.

Then invite me ( mitchellsundt@gmail.com ) as a developer on your appspot
instance and I'll look at the Appengine logs. See
http://code.google.com/p/opendatakit/wiki/AppEngineTroubleshooting#Inviting_Someone_to_be_a_Developer

I added much more debug logging in this area in 1.0.3, and will likely not
be able to diagnose the issue without the upgrade.

Mitch

··· On Mon, Jan 9, 2012 at 11:19 AM, Sanjeev wrote:

Hi Mitch,

We have already enabled billing. The data sometimes shows as
successfully exported but when we open the xml data file, it is being
shown as empty which has us a little worried. We fear the data is
lost.

Could you let us know what steps we can take to remedy this?

Thank You,

Sanjeev

On Jan 9, 1:00 pm, Mitch S mitchellsu...@gmail.com wrote:

Pre-1.0.2, the 500 error is generally an indication that you've exceeded
your free quota on appspot.
If you upgrade to 1.0.3, it will make more efficient use of Appspot
resources.

However, it is likely that the quota limit is also being hit when you
export, and that is causing the partial data files. You will likely need
to enable billing (via the dashboard athttps://appengine.google.com/) or
qualify as a non-profit to get billing waived or reduced (
http://www.google.com/nonprofits/).

Mitch

On Fri, Jan 6, 2012 at 5:33 PM, Sanjeev swamy.sanj...@gmail.com wrote:

Hi Mitch,

We're using version 1.0.1 Production.

The csv were produced by exporting on aggregate. We did not have any
repeat groups in our survey nor videos or images. There are no
submissions under Submission Admin tab.

Now we are getting this error when sending the form:

: (Form Name) Error: Internal server error (500) at
http://(servername).appspot.com/submission

Thank You,

Sanjeev

On Jan 6, 6:10 pm, Mitch S mitchellsu...@gmail.com wrote:

What version of ODK Aggregate were you using?

How did you produce the CSV?

  • by choosing Export CSV on Aggregate
  • by using ODK Briefcase

Repeat groups are not emitted with Export CSV.
The ODK Briefcase 1.0 Betas have a bug where only the first repeat is
output.

Also, if using ODK Aggregate 1.0.x, look under the Form Management /
Submission Admin tab.
Are there any submissions listed here? These submissions would not
be
exported to CSV.
Submissions appear under this tab if they are missing one or more
image,
audio or video captures.

Mitch

On Fri, Jan 6, 2012 at 1:30 PM, Sanjeev swamy.sanj...@gmail.com wrote:

Hi Guys,

We've recently encountered a problem where some of the data that
was
uploaded to the server from the tablet was not showing up in the
csv
file. All the data that we had uploaded said 'successful upload'
but
all the data wasn't present in the csv file.

We looked at the instances folder in the tablet and got the
following
error message when opening the xml data using a browser:
"XML document must have a top level element. Error processing
resource
'file:///C:/Documents and Settings/ivelez/Desktop/USB..."

When opened with Notepad, the file was completely empty with a
size of
0kb.

Do you know why this might be happening?

Thanks in Advance,

Sanjeev Swamy

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options:http://groups.google.com/group/opendatakit?hl=en

--
Mitch Sundt
Software Engineer
University of Washington
mitchellsu...@gmail.com

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options:http://groups.google.com/group/opendatakit?hl=en

--
Mitch Sundt
Software Engineer
University of Washington
mitchellsu...@gmail.com

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

--
Mitch Sundt
Software Engineer
University of Washington
mitchellsundt@gmail.com