[ODK Community] Trying to recover seemingly lost data - ODK Collect 1.3 (1030)

Support
1

Generally speaking, if the user just re-launches ODK Collect and re-opens
the form that they were filling out, ODK Collect will open the savepoint
file it made for that form. Generally with all the values preserved from
the preceding swipe.

··· On Mon, Jun 10, 2013 at 9:47 PM, wrote:

Hello,

I deployed 3 tablets for a survey. One operator encountered problems
(unfortunately, I cannot determine exactly what problems occurred) but she
lost access to the form. Prior to that she was able to enter data but did
not save the form during the whole time before not being able to access the
form. The remaining folders and files are as follows:

forms
TreeMeasurementEng_Repeat3.xml
instances
TreeMeasurementEng_Repeat3_2013-06-08_10-00-16
*.jpg files (multiple)
- there is no xml file in this folder
metadata
forms.db
forms.db-journal
instances.db
instances.db-journal

Can data be recovered?

The second data collector's tablet ran out of battery in the middle of
data collection. She also did not save the form during the whole time. The
folders and files are as follows:

forms
TreeMeasurementEng_Repeat3.xml
instances
TreeMeasurementEng_Repeat3_2013-06-08_09-57-43
*.jpg files (multiple)
- TreeMeasurementEng_Repeat3_2013-06-08_09-57-43.xml
TreeMeasurementEng_Repeat3_2013-06-08_14-26-35
*.jpg file (only one got saved although she took multiple photos)
TreeMeasurementEng_Repeat3_2013-06-08_14-26-35 (only 1 item
although she collected multiple readings)

metadata
forms.db
forms.db-journal
instances.db
instances.db-journal

Is there still a way to extract the collected data?

Thanks very much, and I apologize for a long writeup.

Cheers,
Regie

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

You received this message because you are subscribed to the Google Groups
"ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
Mitch Sundt
Software Engineer
University of Washington
mitchellsundt@gmail.com

2

Alas, No.

··· On Wed, Jun 12, 2013 at 12:05 AM, wrote:

I was hoping that it would do that. However, it didn't do it in this 2
cases. I also do not see the xml.save file mentioned in the following
thread
https://groups.google.com/forum/?fromgroups#!searchin/opendatakit/xml.save/opendatakit/JkNl8tdUwNw/wVzXafdp22IJ

Can anything be recovered from the Metadata folder?

Regie

On Tuesday, June 11, 2013 1:12:52 PM UTC-4, Mitch Sundt wrote:

Generally speaking, if the user just re-launches ODK Collect and
re-opens the form that they were filling out, ODK Collect will open the
savepoint file it made for that form. Generally with all the values
preserved from the preceding swipe.

On Mon, Jun 10, 2013 at 9:47 PM, regie...@gmail.com wrote:

Hello,

I deployed 3 tablets for a survey. One operator encountered problems
(unfortunately, I cannot determine exactly what problems occurred) but she
lost access to the form. Prior to that she was able to enter data but did
not save the form during the whole time before not being able to access the
form. The remaining folders and files are as follows:

forms

TreeMeasurementEng_Repeat3.xml

instances

TreeMeasurementEng_Repeat3_2013-06-08_10-00-16

  *.jpg files (multiple)

  - there is no xml file in this folder

metadata

forms.db

forms.db-journal

instances.db

instances.db-journal

Can data be recovered?

The second data collector's tablet ran out of battery in the middle of
data collection. She also did not save the form during the whole time. The
folders and files are as follows:

forms

TreeMeasurementEng_Repeat3.xml

instances

TreeMeasurementEng_Repeat3_2013-06-08_09-57-43

  *.jpg files (multiple)

  - TreeMeasurementEng_Repeat3_2013-06-08_09-57-43.xml

TreeMeasurementEng_Repeat3_2013-06-08_14-26-35

  *.jpg file (only one got saved although she took multiple photos)

   TreeMeasurementEng_Repeat3_2013-06-08_14-26-35 (only 1 item

although she collected multiple readings)

metadata

forms.db

forms.db-journal

instances.db

instances.db-journal

Is there still a way to extract the collected data?

Thanks very much, and I apologize for a long writeup.

Cheers,

Regie

--

--

Post: opend...@googlegroups.com

Unsubscribe: opendatakit...@googlegroups.com

Options: http://groups.google.com/group/opendatakit?hl=en

You received this message because you are subscribed to the Google
Groups "ODK Community" group.

To unsubscribe from this group and stop receiving emails from it, send
an email to opendatakit...@googlegroups.com.

For more options, visit https://groups.google.com/groups/opt_out.

--
Mitch Sundt
Software Engineer
University of Washington
mitche...@gmail.com

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

You received this message because you are subscribed to the Google Groups
"ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
Mitch Sundt
Software Engineer
University of Washington
mitchellsundt@gmail.com

3

More problems.

I went out to do another data collection. Added in some information in a comment field (text). Used Briefcase to export data out to a spreadsheet. However, the information on the comment field all seemed to be lost.

Anyway to recover this? Any ideas why this things are happening?

Thanks,
Regie

··· On Wednesday, June 12, 2013 1:44:25 PM UTC-4, Mitch Sundt wrote: > Alas, No. > > > > > On Wed, Jun 12, 2013 at 12:05 AM, wrote: > > I was hoping that it would do that. However, it didn't do it in this 2 cases. I also do not see the xml.save file mentioned in the following thread https://groups.google.com/forum/?fromgroups#!searchin/opendatakit/xml.save/opendatakit/JkNl8tdUwNw/wVzXafdp22IJ > > > > > Can anything be recovered from the Metadata folder? > > > > Regie > > > > > > > > > On Tuesday, June 11, 2013 1:12:52 PM UTC-4, Mitch Sundt wrote: > > > Generally speaking, if the user just re-launches ODK Collect and re-opens the form that they were filling out, ODK Collect will open the savepoint file it made for that form. Generally with all the values preserved from the preceding swipe. > > > > > > > > > > > > > > > > > > > > > > > > On Mon, Jun 10, 2013 at 9:47 PM, wrote: > > > > > > Hello, > > > > > > > > > > > > I deployed 3 tablets for a survey. One operator encountered problems (unfortunately, I cannot determine exactly what problems occurred) but she lost access to the form. Prior to that she was able to enter data but did not save the form during the whole time before not being able to access the form. The remaining folders and files are as follows: > > > > > > > > > > > > > > > > forms > > > > > > TreeMeasurementEng_Repeat3.xml > > > > > > instances > > > > > > TreeMeasurementEng_Repeat3_2013-06-08_10-00-16 > > > > > > *.jpg files (multiple) > > > > > > - there is no xml file in this folder > > > > > > metadata > > > > > > forms.db > > > > > > forms.db-journal > > > > > > instances.db > > > > > > instances.db-journal > > > > > > > > > > > > Can data be recovered? > > > > > > > > > > > > The second data collector's tablet ran out of battery in the middle of data collection. She also did not save the form during the whole time. The folders and files are as follows: > > > > > > > > > > > > forms > > > > > > TreeMeasurementEng_Repeat3.xml > > > > > > instances > > > > > > TreeMeasurementEng_Repeat3_2013-06-08_09-57-43 > > > > > > *.jpg files (multiple) > > > > > > - TreeMeasurementEng_Repeat3_2013-06-08_09-57-43.xml > > > > > > TreeMeasurementEng_Repeat3_2013-06-08_14-26-35 > > > > > > *.jpg file (only one got saved although she took multiple photos) > > > > > > TreeMeasurementEng_Repeat3_2013-06-08_14-26-35 (only 1 item although she collected multiple readings) > > > > > > > > > > > > > > > > > > metadata > > > > > > forms.db > > > > > > forms.db-journal > > > > > > instances.db > > > > > > instances.db-journal > > > > > > > > > > > > Is there still a way to extract the collected data? > > > > > > > > > > > > Thanks very much, and I apologize for a long writeup. > > > > > > > > > > > > Cheers, > > > > > > Regie > > > > > > > > > > > > -- > > > > > > -- > > > > > > Post: opend...@googlegroups.com > > > > > > Unsubscribe: opendatakit...@googlegroups.com > > > > > > > Options: http://groups.google.com/group/opendatakit?hl=en > > > > > > > > > > > > --- > > > > > > You received this message because you are subscribed to the Google Groups "ODK Community" group. > > > > > > To unsubscribe from this group and stop receiving emails from it, send an email to opendatakit...@googlegroups.com. > > > > > > > For more options, visit https://groups.google.com/groups/opt_out. > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > Mitch Sundt > > > Software Engineer > > > University of Washington > > > mitche...@gmail.com > > > > > > -- > > -- > > Post: opend...@googlegroups.com > > Unsubscribe: opendatakit...@googlegroups.com > > Options: http://groups.google.com/group/opendatakit?hl=en > > > > --- > > You received this message because you are subscribed to the Google Groups "ODK Community" group. > > To unsubscribe from this group and stop receiving emails from it, send an email to opendatakit...@googlegroups.com. > > For more options, visit https://groups.google.com/groups/opt_out. > > > > > > > > > -- > Mitch Sundt > Software Engineer > University of Washington > mitche...@gmail.com
4

Regie,

Sorry you are having problems. Unless you explicitly removed deleted
the instances, the data should still be on the SD card of your
devices. Take a look to see if the comments are in those XML files.

Did you send the data from the devices to Aggregate and then pull it
to Briefcase or did you use Briefcase to pull the data directly from
Collect?

Yaw

··· -- Need ODK help? Go to http://nafundi.com for custom features, form design, implementation support, and user training for ODK.

On Sat, Jun 29, 2013 at 10:59 PM, regie.alam@gmail.com wrote:

More problems.

I went out to do another data collection. Added in some information in a comment field (text). Used Briefcase to export data out to a spreadsheet. However, the information on the comment field all seemed to be lost.

Anyway to recover this? Any ideas why this things are happening?

Thanks,
Regie

On Wednesday, June 12, 2013 1:44:25 PM UTC-4, Mitch Sundt wrote:

Alas, No.

On Wed, Jun 12, 2013 at 12:05 AM, regie...@gmail.com wrote:

I was hoping that it would do that. However, it didn't do it in this 2 cases. I also do not see the xml.save file mentioned in the following thread https://groups.google.com/forum/?fromgroups#!searchin/opendatakit/xml.save/opendatakit/JkNl8tdUwNw/wVzXafdp22IJ

Can anything be recovered from the Metadata folder?

Regie

On Tuesday, June 11, 2013 1:12:52 PM UTC-4, Mitch Sundt wrote:

Generally speaking, if the user just re-launches ODK Collect and re-opens the form that they were filling out, ODK Collect will open the savepoint file it made for that form. Generally with all the values preserved from the preceding swipe.

On Mon, Jun 10, 2013 at 9:47 PM, regie...@gmail.com wrote:

Hello,

I deployed 3 tablets for a survey. One operator encountered problems (unfortunately, I cannot determine exactly what problems occurred) but she lost access to the form. Prior to that she was able to enter data but did not save the form during the whole time before not being able to access the form. The remaining folders and files are as follows:

forms

TreeMeasurementEng_Repeat3.xml

instances

TreeMeasurementEng_Repeat3_2013-06-08_10-00-16

  *.jpg files (multiple)

  - there is no xml file in this folder

metadata

forms.db

forms.db-journal

instances.db

instances.db-journal

Can data be recovered?

The second data collector's tablet ran out of battery in the middle of data collection. She also did not save the form during the whole time. The folders and files are as follows:

forms

TreeMeasurementEng_Repeat3.xml

instances

TreeMeasurementEng_Repeat3_2013-06-08_09-57-43

  *.jpg files (multiple)

  - TreeMeasurementEng_Repeat3_2013-06-08_09-57-43.xml

TreeMeasurementEng_Repeat3_2013-06-08_14-26-35

  *.jpg file (only one got saved although she took multiple photos)

   TreeMeasurementEng_Repeat3_2013-06-08_14-26-35 (only 1 item although she collected multiple readings)

metadata

forms.db

forms.db-journal

instances.db

instances.db-journal

Is there still a way to extract the collected data?

Thanks very much, and I apologize for a long writeup.

Cheers,

Regie

--

--

Post: opend...@googlegroups.com

Unsubscribe: opendatakit...@googlegroups.com

Options: http://groups.google.com/group/opendatakit?hl=en

You received this message because you are subscribed to the Google Groups "ODK Community" group.

To unsubscribe from this group and stop receiving emails from it, send an email to opendatakit...@googlegroups.com.

For more options, visit https://groups.google.com/groups/opt_out.

--

Mitch Sundt

Software Engineer

University of Washington

mitche...@gmail.com

--

--

Post: opend...@googlegroups.com

Unsubscribe: opendatakit...@googlegroups.com

Options: http://groups.google.com/group/opendatakit?hl=en

You received this message because you are subscribed to the Google Groups "ODK Community" group.

To unsubscribe from this group and stop receiving emails from it, send an email to opendatakit...@googlegroups.com.

For more options, visit https://groups.google.com/groups/opt_out.

--
Mitch Sundt
Software Engineer
University of Washington
mitche...@gmail.com

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

You received this message because you are subscribed to the Google Groups "ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

5

One way this could happen is if you uploaded an earlier version of the form
to ODK Aggregate, one without the comment field, then added it later, but
failed to change the form id. If you then put that newer form version
directly onto the phone (rather than downloading through ODK Aggregate),
when you submit the filled-in forms created with the newer form (the one
having the comment field), then ODK Aggregate will simply ignore the extra
field and only retain the fields it knows about from the earlier form that
was uploaded to it.

You need to be very systematic when placing forms on all the various
devices and ODK Aggregate. If you add fields to an existing survey, I
highly recommend changing the form_id for that survey. Continuing to use
the older form_id will generally lead to problems like the ones you are
having.

Mitch

··· On Sun, Jun 30, 2013 at 7:27 AM, Yaw Anokwa wrote:

Regie,

Sorry you are having problems. Unless you explicitly removed deleted
the instances, the data should still be on the SD card of your
devices. Take a look to see if the comments are in those XML files.

Did you send the data from the devices to Aggregate and then pull it
to Briefcase or did you use Briefcase to pull the data directly from
Collect?

Yaw

Need ODK help? Go to http://nafundi.com for custom features, form
design, implementation support, and user training for ODK.

On Sat, Jun 29, 2013 at 10:59 PM, regie.alam@gmail.com wrote:

More problems.

I went out to do another data collection. Added in some information in a
comment field (text). Used Briefcase to export data out to a spreadsheet.
However, the information on the comment field all seemed to be lost.

Anyway to recover this? Any ideas why this things are happening?

Thanks,
Regie

On Wednesday, June 12, 2013 1:44:25 PM UTC-4, Mitch Sundt wrote:

Alas, No.

On Wed, Jun 12, 2013 at 12:05 AM, regie...@gmail.com wrote:

I was hoping that it would do that. However, it didn't do it in this 2
cases. I also do not see the xml.save file mentioned in the following
thread
https://groups.google.com/forum/?fromgroups#!searchin/opendatakit/xml.save/opendatakit/JkNl8tdUwNw/wVzXafdp22IJ

Can anything be recovered from the Metadata folder?

Regie

On Tuesday, June 11, 2013 1:12:52 PM UTC-4, Mitch Sundt wrote:

Generally speaking, if the user just re-launches ODK Collect and
re-opens the form that they were filling out, ODK Collect will open the
savepoint file it made for that form. Generally with all the values
preserved from the preceding swipe.

On Mon, Jun 10, 2013 at 9:47 PM, regie...@gmail.com wrote:

Hello,

I deployed 3 tablets for a survey. One operator encountered
problems (unfortunately, I cannot determine exactly what problems occurred)
but she lost access to the form. Prior to that she was able to enter data
but did not save the form during the whole time before not being able to
access the form. The remaining folders and files are as follows:

forms

TreeMeasurementEng_Repeat3.xml

instances

TreeMeasurementEng_Repeat3_2013-06-08_10-00-16

  *.jpg files (multiple)

  - there is no xml file in this folder

metadata

forms.db

forms.db-journal

instances.db

instances.db-journal

Can data be recovered?

The second data collector's tablet ran out of battery in the middle
of data collection. She also did not save the form during the whole time.
The folders and files are as follows:

forms

TreeMeasurementEng_Repeat3.xml

instances

TreeMeasurementEng_Repeat3_2013-06-08_09-57-43

  *.jpg files (multiple)

  - TreeMeasurementEng_Repeat3_2013-06-08_09-57-43.xml

TreeMeasurementEng_Repeat3_2013-06-08_14-26-35

  *.jpg file (only one got saved although she took multiple

photos)

   TreeMeasurementEng_Repeat3_2013-06-08_14-26-35 (only 1 item

although she collected multiple readings)

metadata

forms.db

forms.db-journal

instances.db

instances.db-journal

Is there still a way to extract the collected data?

Thanks very much, and I apologize for a long writeup.

Cheers,

Regie

--

--

Post: opend...@googlegroups.com

Unsubscribe: opendatakit...@googlegroups.com

Options: http://groups.google.com/group/opendatakit?hl=en

You received this message because you are subscribed to the Google
Groups "ODK Community" group.

To unsubscribe from this group and stop receiving emails from it,
send an email to opendatakit...@googlegroups.com.

For more options, visit https://groups.google.com/groups/opt_out.

--

Mitch Sundt

Software Engineer

University of Washington

mitche...@gmail.com

--

--

Post: opend...@googlegroups.com

Unsubscribe: opendatakit...@googlegroups.com

Options: http://groups.google.com/group/opendatakit?hl=en

You received this message because you are subscribed to the Google
Groups "ODK Community" group.

To unsubscribe from this group and stop receiving emails from it, send
an email to opendatakit...@googlegroups.com.

For more options, visit https://groups.google.com/groups/opt_out.

--
Mitch Sundt
Software Engineer
University of Washington
mitche...@gmail.com

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

You received this message because you are subscribed to the Google
Groups "ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

You received this message because you are subscribed to the Google Groups
"ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
Mitch Sundt
Software Engineer
University of Washington
mitchellsundt@gmail.com