KoboPP Transcription Problem

Support
1

Hi Neil, everyone,

I'm trying to set up KoBoPP for transcription (after simply dragging the
files to my computer and trying to transcribe from the instances to CSV).
The forms I've built all have 11 subsections under the instance
( etc)

When I do the transcription, the column headings in the .csv show up as
Section1, Section2, etc, and then all of the variables that had been
recorded under each section are mashed up in a long row (e.g.,'almirah
tv125002110lpg' should be the answers to 12 different questions). Also, the
section names and a few other things that showed up as column headers
(StartTime, DeviceID) are out of order.

Is this a problem with the way I've formatting the survey under various
sections? I still hadn't added the Multi tag to the multiselect variable
names, so I thought that could be causing it, but I tried this out on small
subsection of the form that didn't have any multiselects and the same thing
happened.

Thanks!
Emily

Thales,

Be sure that you have turned on USB debugging on your Android. You can't
sync unless your Android is set up to recognize the USB connection.

Home screen >> Menu >> settings >> applications >> development >> check USB
Debugging

Also, be sure that you are allowing installation of unknown source
applications (those not from Market)

Home screen >> Menu >> settings >> applications >> check Unknown sources

If it's not working, I could roll you a version of KoBo that is targeted for
Android 1.5. KoBo and ODK work the same way, and both are targetted for 1.6.

Also, be sure you have some data in your instances folder by completing a
few surveys.

Let me know if that helps.

Sorry for the slow reply, I am in Liberia.

☞§※⌘:airplane::open_umbrella:
~Neil

p.s. You can also copy the files from the SDcard to your laptop by mounting
the SDcard, and the drag&drop the files from your Android to your desktop.
Then you can use KoBoPP to transcribe those XML files into an aggregated
CSV.

p.p.s You can also install the Android SDK, so that you have the Android
Debug Bridge and copy the files on the command line.You don't have to mount
the SDcard, so It's fast and easy once you have it all set up. You use a
command like this:

adb pull /sdcard/odk/instances/ ~/desktop/sync/

that will pull all files from the instances directory and put them into a
folder on your desktop called "sync".

··· On 10/12/2010 1:30 AM, Neil Hendrick wrote:

On Fri, Oct 8, 2010 at 4:23 PM, Thales Santos thales.web@gmail.com wrote:

Hi Neil,

I finally could test Kobo, and I am having some troubles.
For now, all I could get was a Android 1.5 smartphone, but It was okay. So,
I installed ODK, downloaded a form and answered it a couple of times.
Everything went well.

So, I installed Kobo Post Processor on my Ubuntu 9.10, selected the
instance folder inside the folder odk in my SDCard. When I told the program
to sync, it didnt sync anything. I got the message "Surveys Synced: 0".

Then, I tryed to install Kobo Data Collector instead of ODK, but I got an
error that said "Capture Image couldnt be installed". Is it because of my
old android version? Do I really need Kobo Data Collector instead of ODK?

About the project, for now, it is a project to collect data about pregnancy
depression, can I give your email to the responsible doctor, so he can tell
you more?

Thanks

2010/10/4 Neil Hendrick mojotexas@gmail.com

Thales,

The java installer will install it for you just like a regular program, so
you won't need to command line things.
You will run it on your computer, you will not have to do anything on the
PDA, except to mount the SDcard.

You can adjust the settings of the KoBoPP to know what folder on your
computer to copy all of the XML into, and a folder to transcribe the CSVs
into.

There is also a cool feature that will allow you to handle Multi Select
answers in a better way. In the transcription, KoBoPP will create extra
columns in the CSV for each Multi option. It's easier to analyze that way.

Here are the instructions for the MULTI select behavior: (it's easy)

Here are some instructionsfor taking advantage of the MULTI select
behavior:

   The new Multi Select handling feature requires that you create a

select, the name of which ends "MULTI", exactly as quoted. When
processed through the CSV transcriber a new column is created for each
answer existing in the gathered survey record. The new column will be named
with the convention :questionname_answer
So, if you add a question "myquestion_MULTI_" and a record contains an
answer set "1 9 7 3" then the CSV file will have column headers reading :
myquestion_MULTI_1, myquestion_MULTI_9, myquestion_MULTI_7,
myquestion_MULTI_3
If a given survey record contains an answer for one of the multi columns
then a 1 is recorded in it's csv colum for that answer. If not, a 0 is
recorded. Proceeding with the example we'd see that the CSV file contains
something like :

myquestion_MULTI_1, myquestion_MULTI_9, myquestion_MULTI_7
1, 1, 1

If a new survey comes up with other multi answers logged by ODK, then new
columns are created and 0s are inserted where appropriate and 1s inserted
likewise where apprpriate. So if we get a second survey with answers 2 and 4
we'd end up with :

myquestion_MULTI_1, myquestion_MULTI_9, myquestion_MULTI_7,
myquestion_MULTI_2, myquestion_MULTI_4

1, 1, 1, 0, 0
0, 0, 0, 1, 1

and so on.

Catches :
If nobody ever answers a question with a given selection, then that column
will never be created. In the above example if valid answers included 1, 2,
3, 4, 5, 6, 7, 8. or 9, but we'd only received the two records previously
described, then there would never be created columns for 3, 5, 6, or 8

Finally, the only way to distinguish answers from a select is by relying
on the idea that the answers were separated by a space, so, no answers
including spaces or else the whole thing will be fucked up. Use any labels
you want, display any text to anyone at all, and use answers for other
question types with spaces and you'll be fine. But the answers that you code
for select statements must not contain spaces.

One more thing...we would love to hear more about your project and if you
use KoBoPP, list you on our website.

☞§※⌘:airplane::open_umbrella:
~Neil

On Mon, Oct 4, 2010 at 9:03 PM, Thales thales.web@gmail.com wrote:

Thank you very much Neil and Yaw!
Your answer was very fast and accurate!

I am waiting for the devide to make real tests, but I'll try Kobo on
the virtual machine.

How exactly does it work? I just didnt understand If I have to run
"java -cp KoboPostProc.jar org.oyrm.kobo.postproc.test.KoboXMLGen
" in the Device or in the computer
where the device is connected. If its in the devide, is it easy to
type this kind of command? Is possible to create a link to make it
simpler?

On Oct 4, 9:56 pm, Neil Hendrick mojote...@gmail.com wrote:

thanks, Yaw. We need to get better social lives. Clearly we are both
doing
the same thing at the same time.

Thales, let me know if I can be of any help.

☞§※⌘:airplane::open_umbrella:
~Neil

On Mon, Oct 4, 2010 at 8:46 PM, Yaw Anokwa yano...@gmail.com wrote:

sorry you are having so many problems with getting your project
started.

if you want to get the xml data converted to csv without using a
server, your best bet is the kobo post processor. our friends at the
berkeley human rights center built it as a way to get their odk data
pulled from the phone when they are in the field. check it out at
http://code.google.com/p/kobo/

hope that helps,

yaw

On Mon, Oct 4, 2010 at 17:41, Thales thales....@gmail.com wrote:

Hi everybody,

I am trying to implement ODK for a medical research in Brazil. I
could
install and run some forms in Android AVD by directly the ISO
Image.

So, I could run Aggregate on Google Appspot but I couldn't download
to
the AVD by there, and I also couldn't send my data to the aggregate
repositorie.
I tried to install ODK Manage, but It didnt run on the virtual
machine, I got erros asking to force the app close.

All I can imagine now is getting the XML from the SDCard and write
a
program to convert them to access or Excel but It seems to me too
much
reinventing the wheel...

Whats the best way to get all the data in Access or Excel
spreadsheets?

Thanks!

2

Emily,
Why don't you email me your form so I can take a look.

☞§※⌘:airplane::open_umbrella:
~Neil

··· On Sun, Oct 17, 2010 at 12:17 PM, Emily Kumpel wrote:

Hi Neil, everyone,

I'm trying to set up KoBoPP for transcription (after simply dragging the
files to my computer and trying to transcribe from the instances to CSV).
The forms I've built all have 11 subsections under the instance
( etc)

When I do the transcription, the column headings in the .csv show up as
Section1, Section2, etc, and then all of the variables that had been
recorded under each section are mashed up in a long row (e.g.,'almirah
tv125002110lpg' should be the answers to 12 different questions). Also, the
section names and a few other things that showed up as column headers
(StartTime, DeviceID) are out of order.

Is this a problem with the way I've formatting the survey under various
sections? I still hadn't added the Multi tag to the multiselect variable
names, so I thought that could be causing it, but I tried this out on small
subsection of the form that didn't have any multiselects and the same thing
happened.

Thanks!
Emily

On 10/12/2010 1:30 AM, Neil Hendrick wrote:

Thales,

Be sure that you have turned on USB debugging on your Android. You can't
sync unless your Android is set up to recognize the USB connection.

Home screen >> Menu >> settings >> applications >> development >> check USB
Debugging

Also, be sure that you are allowing installation of unknown source
applications (those not from Market)

Home screen >> Menu >> settings >> applications >> check Unknown sources

If it's not working, I could roll you a version of KoBo that is targeted
for Android 1.5. KoBo and ODK work the same way, and both are targetted for
1.6.

Also, be sure you have some data in your instances folder by completing a
few surveys.

Let me know if that helps.

Sorry for the slow reply, I am in Liberia.

☞§※⌘:airplane::open_umbrella:
~Neil

p.s. You can also copy the files from the SDcard to your laptop by mounting
the SDcard, and the drag&drop the files from your Android to your desktop.
Then you can use KoBoPP to transcribe those XML files into an aggregated
CSV.

p.p.s You can also install the Android SDK, so that you have the Android
Debug Bridge and copy the files on the command line.You don't have to mount
the SDcard, so It's fast and easy once you have it all set up. You use a
command like this:

adb pull /sdcard/odk/instances/ ~/desktop/sync/

that will pull all files from the instances directory and put them into a
folder on your desktop called "sync".

On Fri, Oct 8, 2010 at 4:23 PM, Thales Santos thales.web@gmail.comwrote:

Hi Neil,

I finally could test Kobo, and I am having some troubles.
For now, all I could get was a Android 1.5 smartphone, but It was okay.
So, I installed ODK, downloaded a form and answered it a couple of times.
Everything went well.

So, I installed Kobo Post Processor on my Ubuntu 9.10, selected the
instance folder inside the folder odk in my SDCard. When I told the program
to sync, it didnt sync anything. I got the message "Surveys Synced: 0".

Then, I tryed to install Kobo Data Collector instead of ODK, but I got an
error that said "Capture Image couldnt be installed". Is it because of my
old android version? Do I really need Kobo Data Collector instead of ODK?

About the project, for now, it is a project to collect data about
pregnancy depression, can I give your email to the responsible doctor, so he
can tell you more?

Thanks

2010/10/4 Neil Hendrick mojotexas@gmail.com

Thales,

The java installer will install it for you just like a regular program,
so you won't need to command line things.
You will run it on your computer, you will not have to do anything on the
PDA, except to mount the SDcard.

You can adjust the settings of the KoBoPP to know what folder on your
computer to copy all of the XML into, and a folder to transcribe the CSVs
into.

There is also a cool feature that will allow you to handle Multi Select
answers in a better way. In the transcription, KoBoPP will create extra
columns in the CSV for each Multi option. It's easier to analyze that way.

Here are the instructions for the MULTI select behavior: (it's easy)

Here are some instructionsfor taking advantage of the MULTI select
behavior:

   The new Multi Select handling feature requires that you create a

select, the name of which ends "MULTI", exactly as quoted. When
processed through the CSV transcriber a new column is created for each
answer existing in the gathered survey record. The new column will be named
with the convention :questionname_answer
So, if you add a question "myquestion_MULTI_" and a record contains an
answer set "1 9 7 3" then the CSV file will have column headers reading :
myquestion_MULTI_1, myquestion_MULTI_9, myquestion_MULTI_7,
myquestion_MULTI_3
If a given survey record contains an answer for one of the multi columns
then a 1 is recorded in it's csv colum for that answer. If not, a 0 is
recorded. Proceeding with the example we'd see that the CSV file contains
something like :

myquestion_MULTI_1, myquestion_MULTI_9, myquestion_MULTI_7
1, 1, 1

If a new survey comes up with other multi answers logged by ODK, then new
columns are created and 0s are inserted where appropriate and 1s inserted
likewise where apprpriate. So if we get a second survey with answers 2 and 4
we'd end up with :

myquestion_MULTI_1, myquestion_MULTI_9, myquestion_MULTI_7,
myquestion_MULTI_2, myquestion_MULTI_4

1, 1, 1, 0, 0
0, 0, 0, 1, 1

and so on.

Catches :
If nobody ever answers a question with a given selection, then that
column will never be created. In the above example if valid answers included
1, 2, 3, 4, 5, 6, 7, 8. or 9, but we'd only received the two records
previously described, then there would never be created columns for 3, 5, 6,
or 8

Finally, the only way to distinguish answers from a select is by relying
on the idea that the answers were separated by a space, so, no answers
including spaces or else the whole thing will be fucked up. Use any labels
you want, display any text to anyone at all, and use answers for other
question types with spaces and you'll be fine. But the answers that you code
for select statements must not contain spaces.

One more thing...we would love to hear more about your project and if you
use KoBoPP, list you on our website.

☞§※⌘:airplane::open_umbrella:
~Neil

On Mon, Oct 4, 2010 at 9:03 PM, Thales thales.web@gmail.com wrote:

Thank you very much Neil and Yaw!
Your answer was very fast and accurate!

I am waiting for the devide to make real tests, but I'll try Kobo on
the virtual machine.

How exactly does it work? I just didnt understand If I have to run
"java -cp KoboPostProc.jar org.oyrm.kobo.postproc.test.KoboXMLGen
" in the Device or in the computer
where the device is connected. If its in the devide, is it easy to
type this kind of command? Is possible to create a link to make it
simpler?

On Oct 4, 9:56 pm, Neil Hendrick mojote...@gmail.com wrote:

thanks, Yaw. We need to get better social lives. Clearly we are both
doing
the same thing at the same time.

Thales, let me know if I can be of any help.

☞§※⌘:airplane::open_umbrella:
~Neil

On Mon, Oct 4, 2010 at 8:46 PM, Yaw Anokwa yano...@gmail.com wrote:

sorry you are having so many problems with getting your project
started.

if you want to get the xml data converted to csv without using a
server, your best bet is the kobo post processor. our friends at the
berkeley human rights center built it as a way to get their odk data
pulled from the phone when they are in the field. check it out at
http://code.google.com/p/kobo/

hope that helps,

yaw

On Mon, Oct 4, 2010 at 17:41, Thales thales....@gmail.com wrote:

Hi everybody,

I am trying to implement ODK for a medical research in Brazil. I
could
install and run some forms in Android AVD by directly the ISO
Image.

So, I could run Aggregate on Google Appspot but I couldn't
download to
the AVD by there, and I also couldn't send my data to the
aggregate
repositorie.
I tried to install ODK Manage, but It didnt run on the virtual
machine, I got erros asking to force the app close.

All I can imagine now is getting the XML from the SDCard and write
a
program to convert them to access or Excel but It seems to me too
much
reinventing the wheel...

Whats the best way to get all the data in Access or Excel
spreadsheets?

Thanks!