Survey built and submitted - how to get the data on the PC and analyse it

Hi all,

I just found out about OpenDataKit today and managed to create a form, sent
it to my phone, filled it out and submitted it.
Could someone please explain how I get the data on my laptop in order to
analyse the data?
From what I read until now, it seems really difficult.. I downloaded the
aggregate.ova and also VM, opened the aggregate-file with VM but now I am
stuck..
Is there an easier way around it?

For now, I am only after the data (that I submitted and that will be
submitted by many other users during the data collection-project) in an csv
or any other basic file sheet.

Very grateful for any help! :slight_smile:

Thanks and best regards,
Larissa

ODK Aggregate can Export data to a CSV file, or you can publish to Google
Spreadsheets or Fusion Tables.

To do this, go to the Forms Management tab (you may need to Log In to see
this tab)

And look at the Export and Publish choices. Note that publishing to Google
requires setting up Google Credentials on the Site Admin / Preferences
screen.

··· ------------------------ If you have a form with a repeat group, you will find the CSV export available on Aggregate to be awkward to use.

Instead, download and use ODK Briefcase to access your server and pull all
the submitted data down to your PC.

You can then Export CSV files from within ODK Briefcase. In this case, you
will have a CSV file for the main form and each repeat group within the
form.

You must then import them into Excel and re-assemble them using the KEY and
PARENT_KEY fields to tie the rows together.

Note that if you are using UTF-8 characters, you must set the File Origin
during the import into Excel to use UTF-8. Otherwise, your text will all be
garbled.

On Thu, Apr 3, 2014 at 11:58 PM, Larissa Leben larissa.leben@gmail.comwrote:

Hi all,

I just found out about OpenDataKit today and managed to create a form,
sent it to my phone, filled it out and submitted it.
Could someone please explain how I get the data on my laptop in order to
analyse the data?
From what I read until now, it seems really difficult.. I downloaded the
aggregate.ova and also VM, opened the aggregate-file with VM but now I am
stuck..
Is there an easier way around it?

For now, I am only after the data (that I submitted and that will be
submitted by many other users during the data collection-project) in an csv
or any other basic file sheet.

Very grateful for any help! :slight_smile:

Thanks and best regards,
Larissa

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to the Google Groups
"ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
Mitch Sundt
Software Engineer
University of Washington
mitchellsundt@gmail.com

Dear Mitch,

Thanks a lot for your quick reply and help. That is great!

Could you please tell me how to set up Aggregate (or where to find
information to do so)?
Or is there another (easier) way to export the data as CSV?
I have the submitted forms on my phone and dragged them on the PC via a
cable, converted the XLM-file into a excel-file but that will not be
possible with 1000 of submitted forms.

Very thankful for any help.
Best regards and thanks in advance,
Larissa

··· Am Freitag, 4. April 2014 18:58:33 UTC+12 schrieb Larissa Leben: > > Hi all, > > I just found out about OpenDataKit today and managed to create a form, > sent it to my phone, filled it out and submitted it. > Could someone please explain how I get the data on my laptop in order to > analyse the data? > From what I read until now, it seems really difficult.. I downloaded the > aggregate.ova and also VM, opened the aggregate-file with VM but now I am > stuck.. > Is there an easier way around it? > > For now, I am only after the data (that I submitted and that will be > submitted by many other users during the data collection-project) in an csv > or any other basic file sheet. > > Very grateful for any help! :) > > Thanks and best regards, > Larissa >

Dear Mitch,

Thanks.
I read through the websites but for some reason it does not work. It seems
that I have difficulties insalling Aggregate.
Sorry for not getting it.. I already sent this question to Yaw but maybe
you have answers as well:

I have the forms filled out and on my phone now. (During the trial 5 phones
will be used, probably 2000 forms need to be filled out and submitted in
total).
It would be great to know how can I get them on my computer.
Regarding "getting them on the computer", is it possible that the submitted
forms from the 5 phones will be send directly to the computer after being
submitted? If so, how?

I understood that the use of ODK is for free, will there occur any other *costs
*on the way to get the CSV-file (e.g. Aggregate, google engine... ) ?
Thanks a lot and best regards,
Larissa

Our user website is http://opendatakit.org/

Relevant info on ODK Aggregate: http://opendatakit.org/use/aggregate/

Info on ODK Briefcase: http://opendatakit.org/use/briefcase/

ODK Briefcase can be used to pull all the data down to your computer from
your ODK Aggregate server, and then, from there, export the data into CSV
files.

Note that if you do not have internet connectivity, you can use ODK
Briefcase to retrieve and process the data directly from ODK Collect.

··· On Fri, Apr 4, 2014 at 2:35 PM, Larissa Leben wrote:

Dear Mitch,

Thanks a lot for your quick reply and help. That is great!

Could you please tell me how to set up Aggregate (or where to find
information to do so)?
Or is there another (easier) way to export the data as CSV?
I have the submitted forms on my phone and dragged them on the PC via a
cable, converted the XLM-file into a excel-file but that will not be
possible with 1000 of submitted forms.

Very thankful for any help.
Best regards and thanks in advance,
Larissa

Am Freitag, 4. April 2014 18:58:33 UTC+12 schrieb Larissa Leben:

Hi all,

I just found out about OpenDataKit today and managed to create a form,
sent it to my phone, filled it out and submitted it.
Could someone please explain how I get the data on my laptop in order to
analyse the data?
From what I read until now, it seems really difficult.. I downloaded the
aggregate.ova and also VM, opened the aggregate-file with VM but now I am
stuck..
Is there an easier way around it?

For now, I am only after the data (that I submitted and that will be
submitted by many other users during the data collection-project) in an csv
or any other basic file sheet.

Very grateful for any help! :slight_smile:

Thanks and best regards,
Larissa

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to the Google Groups
"ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
Mitch Sundt
Software Engineer
University of Washington
mitchellsundt@gmail.com

Larissa,

As Mitch noted earlier, you can use Briefcase or Aggregate to get the
data off your devices and onto your computer. With Briefcase, you can
plug the device into your computer and pull the data that way. With
Aggregate, you can send the data from the device to your server and
then download the CSV from the server to your computer.

I'd recommend you start off with Aggregate instead of Briefcase. You
follow the instructions to install Aggregate at
http://http://opendatakit.org/use/aggregate/. I'd encourage you to
install it on App Engine first. If the instructions don't make sense,
please be very specific about what problem you are having and where
you are stuck. Without that information, the community will not be
able to help.

You can find out about costs on Aggregate at
http://opendatakit.org/use/aggregate/deployment-planning/. In general,
for small deployments, ODK Aggregate on Google App Engine is free. If
you self-host (e.g., with the VM) then there is zero cost.

Yaw

··· -- Need ODK services? http://nafundi.com provides form design, server setup, professional support, and software development for ODK.

On Fri, Apr 4, 2014 at 6:01 PM, Larissa Leben larissa.leben@gmail.com wrote:

Dear Mitch,

Thanks.
I read through the websites but for some reason it does not work. It seems
that I have difficulties insalling Aggregate.
Sorry for not getting it.. I already sent this question to Yaw but maybe you
have answers as well:

I have the forms filled out and on my phone now. (During the trial 5 phones
will be used, probably 2000 forms need to be filled out and submitted in
total).
It would be great to know how can I get them on my computer.
Regarding "getting them on the computer", is it possible that the submitted
forms from the 5 phones will be send directly to the computer after being
submitted? If so, how?

I understood that the use of ODK is for free, will there occur any other
costs on the way to get the CSV-file (e.g. Aggregate, google engine... ) ?
Thanks a lot and best regards,
Larissa

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to the Google Groups
"ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Hello,
Actually I tried to export in a CSV file, and indeed with Briefcase you will have a CSV file for the main form and each repeat group within the form.
You mentionned in your post that its possible to import them into one file by doing this:
import them into Excel and re-assemble them using the KEY and PARENT_KEY fields to tie the rows together.
Please can you explain more how to do so, what is exactly the steps we should do.

Thanks in advance

To be clear, the ODK core team does not charge for anything. The tools
are a platform for and an off-shoot of our ICTD research.

The tools give you the ability to own and manage the data you have
collected, and to extract the data to CSV or other tools for processing.

You can often do that with zero or minimal cost if you use Google AppEngine
infrastructure.

If you set up your own servers, the costs are: time, internet access,
security, power, data archiving and learning curve.

··· ---------------

If you find the tools useful, please consider a donation to the ODK
project, either by:

  • answering questions on the group lists from new users of the tools
  • contributing software changes back to the project,
  • providing language translations, or
  • monetary donations.

I recently updated the documentation on how to use ODK Briefcase; hopefully
the steps are a bit clearer, especially for non-native english speakers:

http://opendatakit.org/use/briefcase/

On Sun, Apr 6, 2014 at 9:25 PM, Yaw Anokwa yanokwa@nafundi.com wrote:

Larissa,

As Mitch noted earlier, you can use Briefcase or Aggregate to get the
data off your devices and onto your computer. With Briefcase, you can
plug the device into your computer and pull the data that way. With
Aggregate, you can send the data from the device to your server and
then download the CSV from the server to your computer.

I'd recommend you start off with Aggregate instead of Briefcase. You
follow the instructions to install Aggregate at
http://http://opendatakit.org/use/aggregate/. I'd encourage you to
install it on App Engine first. If the instructions don't make sense,
please be very specific about what problem you are having and where
you are stuck. Without that information, the community will not be
able to help.

You can find out about costs on Aggregate at
http://opendatakit.org/use/aggregate/deployment-planning/. In general,
for small deployments, ODK Aggregate on Google App Engine is free. If
you self-host (e.g., with the VM) then there is zero cost.

Yaw

Need ODK services? http://nafundi.com provides form design, server
setup, professional support, and software development for ODK.

On Fri, Apr 4, 2014 at 6:01 PM, Larissa Leben larissa.leben@gmail.com wrote:

Dear Mitch,

Thanks.
I read through the websites but for some reason it does not work. It
seems
that I have difficulties insalling Aggregate.
Sorry for not getting it.. I already sent this question to Yaw but maybe
you
have answers as well:

I have the forms filled out and on my phone now. (During the trial 5
phones
will be used, probably 2000 forms need to be filled out and submitted in
total).
It would be great to know how can I get them on my computer.
Regarding "getting them on the computer", is it possible that the
submitted
forms from the 5 phones will be send directly to the computer after being
submitted? If so, how?

I understood that the use of ODK is for free, will there occur any other
costs on the way to get the CSV-file (e.g. Aggregate, google engine... )
?
Thanks a lot and best regards,
Larissa

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to the Google Groups
"ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to the Google Groups
"ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
Mitch Sundt
Software Engineer
University of Washington
mitchellsundt@gmail.com

import each CSV into a separate worksheet (tab) within your Excel
spreadsheet.

Say you end up with these on tabs labelled:

survey -- the top-level form
group1 -- a repeat group within survey
nested2 - a repeat group within group1

The PARENT_KEY field of a row in the group1 sheet will match a KEY field
value in the survey sheet.
This indicates that this row in the group1 sheet is an answer for that
repeat group within that matching row's survey record.

Similarly, the PARENT_KEY field of a row in the nested2 sheet will match a
KEY field value in the group1 sheet.
This indicates that that row in the nested2 sheet is an answer for that
nested repeat group within that matching row's group1 record.

··· On Wed, Apr 9, 2014 at 8:12 AM, wrote:

Hello,
Actually I tried to export in a CSV file, and indeed with Briefcase you
will have a CSV file for the main form and each repeat group within the
form.
You mentionned in your post that its possible to import them into one file
by doing this:
import them into Excel and re-assemble them using the KEY and PARENT_KEY
fields to tie the rows together.
Please can you explain more how to do so, what is exactly the steps we
should do.

Thanks in advance

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to the Google Groups
"ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
Mitch Sundt
Software Engineer
University of Washington
mitchellsundt@gmail.com