Can a survey be too long for ODK?

I coded my survey in Excel, and used XLSForm
(http://opendatakit.org/use/xlsform/) to convert it into an XForm. I copied
the XForm into the "Form" folder on the SD card to my PDA, as I always do.
But when I choose the "Fill blank form" option on the PDA, the screen says
that the form is loading, but after several attempts and waiting as long as
20 minutes for the form to load, it still hasn't loaded.

The main "survey" sheet on Excel is just over 2,600 lines. There is one
very small repeat group and one very large repeat group-- these two are
separate, not repeats within repeats.

I tried splitting the survey into 2 smaller pieces (one about 1,700 lines,
the other about 900), and while they still took a while to load when I hit
"Fill Blank Form," each finally loaded and I was able to fill out the
survey.

Could it be that the 2,600 line survey is too long? Could there be another
problem? Any suggestions on how to solve this in order to have the complete
survey on one form and able to load in a reasonable amount of time?

THANKS!

Sam,

What happens if you run the big form through ODK Validate?

And what does 'adb logcat' show when you process the form?
See https://code.google.com/p/opendatakit/wiki/CollectTroubleshooting
if you need help with adb.

And finally, what device and Android OS are you using?

Instead of sending these logs over email, use dpaste.com or attach it
to an issue at http://code.google.com/p/opendatakit/issues/list

Yaw

··· On Thu, Feb 7, 2013 at 9:00 AM, Sam wrote: > I coded my survey in Excel, and used XLSForm > (http://opendatakit.org/use/xlsform/) to convert it into an XForm. I copied > the XForm into the "Form" folder on the SD card to my PDA, as I always do. > But when I choose the "Fill blank form" option on the PDA, the screen says > that the form is loading, but after several attempts and waiting as long as > 20 minutes for the form to load, it still hasn't loaded. > > The main "survey" sheet on Excel is just over 2,600 lines. There is one very > small repeat group and one very large repeat group-- these two are separate, > not repeats within repeats. > > I tried splitting the survey into 2 smaller pieces (one about 1,700 lines, > the other about 900), and while they still took a while to load when I hit > "Fill Blank Form," each finally loaded and I was able to fill out the > survey. > > Could it be that the 2,600 line survey is too long? Could there be another > problem? Any suggestions on how to solve this in order to have the complete > survey on one form and able to load in a reasonable amount of time? > > THANKS! > > -- > -- > Post: opendatakit@googlegroups.com > Unsubscribe: opendatakit+unsubscribe@googlegroups.com > Options: http://groups.google.com/group/opendatakit?hl=en > > --- > You received this message because you are subscribed to the Google Groups > "ODK Community" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to opendatakit+unsubscribe@googlegroups.com. > For more options, visit https://groups.google.com/groups/opt_out. > >

We've definitely hit this issue when running big forms on phones with
little internal memory like the ideos.

··· On Thursday, February 7, 2013, Yaw Anokwa wrote:

Sam,

What happens if you run the big form through ODK Validate?

And what does 'adb logcat' show when you process the form?
See https://code.google.com/p/opendatakit/wiki/CollectTroubleshooting
if you need help with adb.

And finally, what device and Android OS are you using?

Instead of sending these logs over email, use dpaste.com or attach it
to an issue at http://code.google.com/p/opendatakit/issues/list

Yaw

On Thu, Feb 7, 2013 at 9:00 AM, Sam <samantha.elghanayan@gmail.com<javascript:;>> wrote:

I coded my survey in Excel, and used XLSForm
(http://opendatakit.org/use/xlsform/) to convert it into an XForm. I
copied
the XForm into the "Form" folder on the SD card to my PDA, as I always
do.
But when I choose the "Fill blank form" option on the PDA, the screen
says
that the form is loading, but after several attempts and waiting as long
as
20 minutes for the form to load, it still hasn't loaded.

The main "survey" sheet on Excel is just over 2,600 lines. There is one
very
small repeat group and one very large repeat group-- these two are
separate,
not repeats within repeats.

I tried splitting the survey into 2 smaller pieces (one about 1,700
lines,
the other about 900), and while they still took a while to load when I
hit
"Fill Blank Form," each finally loaded and I was able to fill out the
survey.

Could it be that the 2,600 line survey is too long? Could there be
another
problem? Any suggestions on how to solve this in order to have the
complete
survey on one form and able to load in a reasonable amount of time?

THANKS!

--

Post: opendatakit@googlegroups.com <javascript:;>
Unsubscribe: opendatakit+unsubscribe@googlegroups.com <javascript:;>
Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to the Google Groups
"ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to opendatakit+unsubscribe@googlegroups.com <javascript:;>.
For more options, visit https://groups.google.com/groups/opt_out.

--

Post: opendatakit@googlegroups.com <javascript:;>
Unsubscribe: opendatakit+unsubscribe@googlegroups.com <javascript:;>
Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to the Google Groups
"ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to opendatakit+unsubscribe@googlegroups.com <javascript:;>.
For more options, visit https://groups.google.com/groups/opt_out.

Hi Yaw,

*1. When I put the XForm through Validate, I get this *(I removed spaces
for ease of reading):
Parsing form...
Title: "Nerica-Endline Survey-In-Progress-1"

Xform parsing completed! See above for any warnings.
Xform is valid! See above for any warnings.

2. Loading ADT-Bundle to instal SDK (but I'm working out of Sierra Leone,
so it shows the download will take 1 day)

I will happily download these logs and post an issue as soon as the bundle
is installed and I have the logs.
However, if it's at all possible for you to run the form this time, I am
attaching the XForm to this email.

3. Device

Thanks!

··· On Thursday, February 7, 2013 5:39:46 PM UTC, Yaw Anokwa wrote: > > Sam, > > What happens if you run the big form through ODK Validate? > > And what does 'adb logcat' show when you process the form? > See https://code.google.com/p/opendatakit/wiki/CollectTroubleshooting > if you need help with adb. > > And finally, what device and Android OS are you using? > > Instead of sending these logs over email, use dpaste.com or attach it > to an issue at http://code.google.com/p/opendatakit/issues/list > > Yaw > > On Thu, Feb 7, 2013 at 9:00 AM, Sam <samantha....@gmail.com > wrote: > > I coded my survey in Excel, and used XLSForm > > (http://opendatakit.org/use/xlsform/) to convert it into an XForm. I > copied > > the XForm into the "Form" folder on the SD card to my PDA, as I always > do. > > But when I choose the "Fill blank form" option on the PDA, the screen > says > > that the form is loading, but after several attempts and waiting as long > as > > 20 minutes for the form to load, it still hasn't loaded. > > > > The main "survey" sheet on Excel is just over 2,600 lines. There is one > very > > small repeat group and one very large repeat group-- these two are > separate, > > not repeats within repeats. > > > > I tried splitting the survey into 2 smaller pieces (one about 1,700 > lines, > > the other about 900), and while they still took a while to load when I > hit > > "Fill Blank Form," each finally loaded and I was able to fill out the > > survey. > > > > Could it be that the 2,600 line survey is too long? Could there be > another > > problem? Any suggestions on how to solve this in order to have the > complete > > survey on one form and able to load in a reasonable amount of time? > > > > THANKS! > > > > -- > > -- > > Post: opend...@googlegroups.com > > Unsubscribe: opendatakit...@googlegroups.com > > Options: http://groups.google.com/group/opendatakit?hl=en > > > > --- > > You received this message because you are subscribed to the Google > Groups > > "ODK Community" group. > > To unsubscribe from this group and stop receiving emails from it, send > an > > email to opendatakit...@googlegroups.com . > > For more options, visit https://groups.google.com/groups/opt_out. > > > > >

Sam,

Please don't attach large files to messages. Many people on this list
are in places where bandwidth is at a premium, so either attach large
files to an issue or use dpaste.com and send a link to the list
instead.

This form is big, but it should still work. It has opened on a
Motorola Milestone XT720
(http://www.phonearena.com/phones/Motorola-MILESTONE-XT720_id4256)
which is has similar specs to your device
(http://www.phonearena.com/phones/LG-Optimus-Chic_id4887).

On the Milestone, it takes 2m15s to load the first time. Form loads
after that take about 15s. This increased speed on the second load is
by design.

More SD cards will not help. This likely a RAM/Processor issue.

Uninstall ODK Collect and then reboot. Then delete the /odk folder on
the SD card. Re-install Collect and then try the form again.

We'll do my best to help, but there are no guarantees that we'll solve
this problem in time. Plan accordingly.

Yaw

··· -- Need more help? Go to http://nafundi.com for custom development, professional support, form design, implementation advice, and user training for ODK.

On Fri, Feb 8, 2013 at 9:00 AM, Sam samantha.elghanayan@gmail.com wrote:

Hi Yaw,

  1. When I put the XForm through Validate, I get this (I removed spaces for
    ease of reading):
    Parsing form...
    Title: "Nerica-Endline Survey-In-Progress-1"

Xform parsing completed! See above for any warnings.
Xform is valid! See above for any warnings.

  1. Loading ADT-Bundle to instal SDK (but I'm working out of Sierra Leone, so
    it shows the download will take 1 day)
    I will happily download these logs and post an issue as soon as the bundle
    is installed and I have the logs.
    However, if it's at all possible for you to run the form this time, I am
    attaching the XForm to this email.

  2. Device

  • “LG Optimus Chic E720 Black 3G WI-FI 5-Megapixel Touchscreen Android 2.2
    GSM Phones” (details here.)

  • Micro SD cards are 2GB (we could buy cards with more memory if that would
    help?)

Thanks!

On Thursday, February 7, 2013 5:39:46 PM UTC, Yaw Anokwa wrote:

Sam,

What happens if you run the big form through ODK Validate?

And what does 'adb logcat' show when you process the form?
See https://code.google.com/p/opendatakit/wiki/CollectTroubleshooting
if you need help with adb.

And finally, what device and Android OS are you using?

Instead of sending these logs over email, use dpaste.com or attach it
to an issue at http://code.google.com/p/opendatakit/issues/list

Yaw

On Thu, Feb 7, 2013 at 9:00 AM, Sam samantha....@gmail.com wrote:

I coded my survey in Excel, and used XLSForm
(http://opendatakit.org/use/xlsform/) to convert it into an XForm. I
copied
the XForm into the "Form" folder on the SD card to my PDA, as I always
do.
But when I choose the "Fill blank form" option on the PDA, the screen
says
that the form is loading, but after several attempts and waiting as long
as
20 minutes for the form to load, it still hasn't loaded.

The main "survey" sheet on Excel is just over 2,600 lines. There is one
very
small repeat group and one very large repeat group-- these two are
separate,
not repeats within repeats.

I tried splitting the survey into 2 smaller pieces (one about 1,700
lines,
the other about 900), and while they still took a while to load when I
hit
"Fill Blank Form," each finally loaded and I was able to fill out the
survey.

Could it be that the 2,600 line survey is too long? Could there be
another
problem? Any suggestions on how to solve this in order to have the
complete
survey on one form and able to load in a reasonable amount of time?

THANKS!

--

Post: opend...@googlegroups.com
Unsubscribe: opendatakit...@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to the Google
Groups
"ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send
an
email to opendatakit...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to the Google Groups
"ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

Hi Yaw,

Thank you for your help. I've gotten the survey to load by just turning the
phone on and off a few times after trying to load it initially.

Apologies for the massive file. I had tried to delete that post as soon as
I realized it went to the group.

Thanks
Sam

··· On Friday, February 8, 2013 5:22:12 PM UTC, Yaw Anokwa wrote: > > Sam, > > Please don't attach large files to messages. Many people on this list > are in places where bandwidth is at a premium, so either attach large > files to an issue or use dpaste.com and send a link to the list > instead. > > This form is big, but it should still work. It has opened on a > Motorola Milestone XT720 > (http://www.phonearena.com/phones/Motorola-MILESTONE-XT720_id4256) > which is has similar specs to your device > (http://www.phonearena.com/phones/LG-Optimus-Chic_id4887). > > On the Milestone, it takes 2m15s to load the first time. Form loads > after that take about 15s. This increased speed on the second load is > by design. > > More SD cards will not help. This likely a RAM/Processor issue. > > Uninstall ODK Collect and then reboot. Then delete the /odk folder on > the SD card. Re-install Collect and then try the form again. > > We'll do my best to help, but there are no guarantees that we'll solve > this problem in time. Plan accordingly. > > Yaw > -- > Need more help? Go to http://nafundi.com for custom development, > professional support, form design, implementation advice, and user > training for ODK. > > > On Fri, Feb 8, 2013 at 9:00 AM, Sam <samantha....@gmail.com > wrote: > > Hi Yaw, > > > > 1. When I put the XForm through Validate, I get this (I removed spaces > for > > ease of reading): > > Parsing form... > > Title: "Nerica-Endline Survey-In-Progress-1" > >>> Xform parsing completed! See above for any warnings. > >>> Xform is valid! See above for any warnings. > > > > 2. Loading ADT-Bundle to instal SDK (but I'm working out of Sierra > Leone, so > > it shows the download will take 1 day) > > I will happily download these logs and post an issue as soon as the > bundle > > is installed and I have the logs. > > However, if it's at all possible for you to run the form this time, I am > > attaching the XForm to this email. > > > > 3. Device > > > > - “LG Optimus Chic E720 Black 3G WI-FI 5-Megapixel Touchscreen Android > 2.2 > > GSM Phones” (details here.) > > > > - Micro SD cards are 2GB (we could buy cards with more memory if that > would > > help?) > > > > Thanks! > > > > On Thursday, February 7, 2013 5:39:46 PM UTC, Yaw Anokwa wrote: > >> > >> Sam, > >> > >> What happens if you run the big form through ODK Validate? > >> > >> And what does 'adb logcat' show when you process the form? > >> See https://code.google.com/p/opendatakit/wiki/CollectTroubleshooting > >> if you need help with adb. > >> > >> And finally, what device and Android OS are you using? > >> > >> Instead of sending these logs over email, use dpaste.com or attach it > >> to an issue at http://code.google.com/p/opendatakit/issues/list > >> > >> Yaw > >> > >> On Thu, Feb 7, 2013 at 9:00 AM, Sam wrote: > >> > I coded my survey in Excel, and used XLSForm > >> > (http://opendatakit.org/use/xlsform/) to convert it into an XForm. I > >> > copied > >> > the XForm into the "Form" folder on the SD card to my PDA, as I > always > >> > do. > >> > But when I choose the "Fill blank form" option on the PDA, the screen > >> > says > >> > that the form is loading, but after several attempts and waiting as > long > >> > as > >> > 20 minutes for the form to load, it still hasn't loaded. > >> > > >> > The main "survey" sheet on Excel is just over 2,600 lines. There is > one > >> > very > >> > small repeat group and one very large repeat group-- these two are > >> > separate, > >> > not repeats within repeats. > >> > > >> > I tried splitting the survey into 2 smaller pieces (one about 1,700 > >> > lines, > >> > the other about 900), and while they still took a while to load when > I > >> > hit > >> > "Fill Blank Form," each finally loaded and I was able to fill out the > >> > survey. > >> > > >> > Could it be that the 2,600 line survey is too long? Could there be > >> > another > >> > problem? Any suggestions on how to solve this in order to have the > >> > complete > >> > survey on one form and able to load in a reasonable amount of time? > >> > > >> > THANKS! > >> > > >> > -- > >> > -- > >> > Post: opend...@googlegroups.com > >> > Unsubscribe: opendatakit...@googlegroups.com > >> > Options: http://groups.google.com/group/opendatakit?hl=en > >> > > >> > --- > >> > You received this message because you are subscribed to the Google > >> > Groups > >> > "ODK Community" group. > >> > To unsubscribe from this group and stop receiving emails from it, > send > >> > an > >> > email to opendatakit...@googlegroups.com. > >> > For more options, visit https://groups.google.com/groups/opt_out. > >> > > >> > > > > > -- > > -- > > Post: opend...@googlegroups.com > > Unsubscribe: opendatakit...@googlegroups.com > > Options: http://groups.google.com/group/opendatakit?hl=en > > > > --- > > You received this message because you are subscribed to the Google > Groups > > "ODK Community" group. > > To unsubscribe from this group and stop receiving emails from it, send > an > > email to opendatakit...@googlegroups.com . > > For more options, visit https://groups.google.com/groups/opt_out. > > > > >

Glad it's working. My guess is that the phone ran out of memory during
an initial form processing pass and corrupted the cached version of
the form we load.

··· On Sat, Feb 9, 2013 at 1:21 PM, Sam wrote: > Hi Yaw, > > Thank you for your help. I've gotten the survey to load by just turning the > phone on and off a few times after trying to load it initially. > > Apologies for the massive file. I had tried to delete that post as soon as I > realized it went to the group. > > Thanks > Sam > > > On Friday, February 8, 2013 5:22:12 PM UTC, Yaw Anokwa wrote: >> >> Sam, >> >> Please don't attach large files to messages. Many people on this list >> are in places where bandwidth is at a premium, so either attach large >> files to an issue or use dpaste.com and send a link to the list >> instead. >> >> This form is big, but it should still work. It has opened on a >> Motorola Milestone XT720 >> (http://www.phonearena.com/phones/Motorola-MILESTONE-XT720_id4256) >> which is has similar specs to your device >> (http://www.phonearena.com/phones/LG-Optimus-Chic_id4887). >> >> On the Milestone, it takes 2m15s to load the first time. Form loads >> after that take about 15s. This increased speed on the second load is >> by design. >> >> More SD cards will not help. This likely a RAM/Processor issue. >> >> Uninstall ODK Collect and then reboot. Then delete the /odk folder on >> the SD card. Re-install Collect and then try the form again. >> >> We'll do my best to help, but there are no guarantees that we'll solve >> this problem in time. Plan accordingly. >> >> Yaw >> -- >> Need more help? Go to http://nafundi.com for custom development, >> professional support, form design, implementation advice, and user >> training for ODK. >> >> >> On Fri, Feb 8, 2013 at 9:00 AM, Sam wrote: >> > Hi Yaw, >> > >> > 1. When I put the XForm through Validate, I get this (I removed spaces >> > for >> > ease of reading): >> > Parsing form... >> > Title: "Nerica-Endline Survey-In-Progress-1" >> >>> Xform parsing completed! See above for any warnings. >> >>> Xform is valid! See above for any warnings. >> > >> > 2. Loading ADT-Bundle to instal SDK (but I'm working out of Sierra >> > Leone, so >> > it shows the download will take 1 day) >> > I will happily download these logs and post an issue as soon as the >> > bundle >> > is installed and I have the logs. >> > However, if it's at all possible for you to run the form this time, I am >> > attaching the XForm to this email. >> > >> > 3. Device >> > >> > - “LG Optimus Chic E720 Black 3G WI-FI 5-Megapixel Touchscreen Android >> > 2.2 >> > GSM Phones” (details here.) >> > >> > - Micro SD cards are 2GB (we could buy cards with more memory if that >> > would >> > help?) >> > >> > Thanks! >> > >> > On Thursday, February 7, 2013 5:39:46 PM UTC, Yaw Anokwa wrote: >> >> >> >> Sam, >> >> >> >> What happens if you run the big form through ODK Validate? >> >> >> >> And what does 'adb logcat' show when you process the form? >> >> See https://code.google.com/p/opendatakit/wiki/CollectTroubleshooting >> >> if you need help with adb. >> >> >> >> And finally, what device and Android OS are you using? >> >> >> >> Instead of sending these logs over email, use dpaste.com or attach it >> >> to an issue at http://code.google.com/p/opendatakit/issues/list >> >> >> >> Yaw >> >> >> >> On Thu, Feb 7, 2013 at 9:00 AM, Sam wrote: >> >> > I coded my survey in Excel, and used XLSForm >> >> > (http://opendatakit.org/use/xlsform/) to convert it into an XForm. I >> >> > copied >> >> > the XForm into the "Form" folder on the SD card to my PDA, as I >> >> > always >> >> > do. >> >> > But when I choose the "Fill blank form" option on the PDA, the screen >> >> > says >> >> > that the form is loading, but after several attempts and waiting as >> >> > long >> >> > as >> >> > 20 minutes for the form to load, it still hasn't loaded. >> >> > >> >> > The main "survey" sheet on Excel is just over 2,600 lines. There is >> >> > one >> >> > very >> >> > small repeat group and one very large repeat group-- these two are >> >> > separate, >> >> > not repeats within repeats. >> >> > >> >> > I tried splitting the survey into 2 smaller pieces (one about 1,700 >> >> > lines, >> >> > the other about 900), and while they still took a while to load when >> >> > I >> >> > hit >> >> > "Fill Blank Form," each finally loaded and I was able to fill out the >> >> > survey. >> >> > >> >> > Could it be that the 2,600 line survey is too long? Could there be >> >> > another >> >> > problem? Any suggestions on how to solve this in order to have the >> >> > complete >> >> > survey on one form and able to load in a reasonable amount of time? >> >> > >> >> > THANKS! >> >> > >> >> > -- >> >> > -- >> >> > Post: opend...@googlegroups.com >> >> > Unsubscribe: opendatakit...@googlegroups.com >> >> > Options: http://groups.google.com/group/opendatakit?hl=en >> >> > >> >> > --- >> >> > You received this message because you are subscribed to the Google >> >> > Groups >> >> > "ODK Community" group. >> >> > To unsubscribe from this group and stop receiving emails from it, >> >> > send >> >> > an >> >> > email to opendatakit...@googlegroups.com. >> >> > For more options, visit https://groups.google.com/groups/opt_out. >> >> > >> >> > >> > >> > -- >> > -- >> > Post: opend...@googlegroups.com >> > Unsubscribe: opendatakit...@googlegroups.com >> > Options: http://groups.google.com/group/opendatakit?hl=en >> > >> > --- >> > You received this message because you are subscribed to the Google >> > Groups >> > "ODK Community" group. >> > To unsubscribe from this group and stop receiving emails from it, send >> > an >> > email to opendatakit...@googlegroups.com. >> > For more options, visit https://groups.google.com/groups/opt_out. >> > >> > > > -- > -- > Post: opendatakit@googlegroups.com > Unsubscribe: opendatakit+unsubscribe@googlegroups.com > Options: http://groups.google.com/group/opendatakit?hl=en > > --- > You received this message because you are subscribed to the Google Groups > "ODK Community" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to opendatakit+unsubscribe@googlegroups.com. > For more options, visit https://groups.google.com/groups/opt_out. > >