Odk forms load very slowly with large csv data attached

Hello team,
Working on odk for survey in a district, having large data of village, block etc. Uploaded media files as .csv, it increased form loading time, how can I optimize this time to reduce, form definition reading time.

Thanks in advance.
Seema

Hi Seema,

Form load is slow on the first load and faster on second load because
the device serializes and caches that form definition.

We build a lot of enormous forms and Nafundi and they work well on
modern devices with the techniques below.

If you are using large lists (e.g., tens of thousands villages), use
external itemsets. http://xlsform.org/#external and
https://opendatakit.org/help/form-design/external-itemsets/ are good
places to learn more.

If you are using very complex calculations/constraints/relevance, try
to break those into chunks. If you have a huge list of questions
(thousands) and you are using multiple languages, you can increase
performance by having a language per form.

Good luck,

Yaw

··· -- Need ODK consultants? Nafundi provides form design, server setup, in-field training, and software development for ODK. Go to https://nafundi.com to get started.

On Tue, Feb 9, 2016 at 5:08 PM, Seema Rani seema@vartulz.com wrote:

Hello team,
Working on odk for survey in a district, having large data of village, block etc. Uploaded media files as .csv, it increased form loading time, how can I optimize this time to reduce, form definition reading time.

Thanks in advance.
Seema

--
You received this message because you are subscribed to the Google Groups "ODK Developers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to opendatakit-developers+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Thanks Yaw,
I have already used external csv n itemsets, still it is taking too long
time to read from definition as well as to submit on the server.

··· On Sunday, February 14, 2016 at 1:35:53 PM UTC+5:30, Yaw Anokwa wrote: > > Hi Seema, > > Form load is slow on the first load and faster on second load because > the device serializes and caches that form definition. > > We build a lot of enormous forms and Nafundi and they work well on > modern devices with the techniques below. > > If you are using large lists (e.g., tens of thousands villages), use > external itemsets. http://xlsform.org/#external and > https://opendatakit.org/help/form-design/external-itemsets/ are good > places to learn more. > > If you are using very complex calculations/constraints/relevance, try > to break those into chunks. If you have a huge list of questions > (thousands) and you are using multiple languages, you can increase > performance by having a language per form. > > Good luck, > > Yaw > -- > Need ODK consultants? Nafundi provides form design, server setup, > in-field training, and software development for ODK. Go to > https://nafundi.com to get started. > > On Tue, Feb 9, 2016 at 5:08 PM, Seema Rani <se...@vartulz.com > wrote: > > Hello team, > > Working on odk for survey in a district, having large data of village, > block etc. Uploaded media files as .csv, it increased form loading time, > how can I optimize this time to reduce, form definition reading time. > > > > Thanks in advance. > > Seema > > > > -- > > You received this message because you are subscribed to the Google > Groups "ODK Developers" group. > > To unsubscribe from this group and stop receiving emails from it, send > an email to opendatakit-developers+unsubscribe@googlegroups.com > . > > For more options, visit https://groups.google.com/d/optout. >

Hi Seema,

How many nodes does the form itself has? And how many languages? And
how much RAM/CPU does the device have?

As far as submissions, how big is the average submission and what is
your connection speed? Those are the things that drive submission
speed.

Yaw

··· -- Need ODK consultants? Nafundi provides form design, server setup, in-field training, and software development for ODK. Go to https://nafundi.com to get started.

On Wed, Apr 6, 2016 at 1:06 PM, Seema Rani seema@vartulz.com wrote:

Thanks Yaw,
I have already used external csv n itemsets, still it is taking too long
time to read from definition as well as to submit on the server.

On Sunday, February 14, 2016 at 1:35:53 PM UTC+5:30, Yaw Anokwa wrote:

Hi Seema,

Form load is slow on the first load and faster on second load because
the device serializes and caches that form definition.

We build a lot of enormous forms and Nafundi and they work well on
modern devices with the techniques below.

If you are using large lists (e.g., tens of thousands villages), use
external itemsets. http://xlsform.org/#external and
https://opendatakit.org/help/form-design/external-itemsets/ are good
places to learn more.

If you are using very complex calculations/constraints/relevance, try
to break those into chunks. If you have a huge list of questions
(thousands) and you are using multiple languages, you can increase
performance by having a language per form.

Good luck,

Yaw

Need ODK consultants? Nafundi provides form design, server setup,
in-field training, and software development for ODK. Go to
https://nafundi.com to get started.

On Tue, Feb 9, 2016 at 5:08 PM, Seema Rani se...@vartulz.com wrote:

Hello team,
Working on odk for survey in a district, having large data of village,
block etc. Uploaded media files as .csv, it increased form loading time, how
can I optimize this time to reduce, form definition reading time.

Thanks in advance.
Seema

--
You received this message because you are subscribed to the Google
Groups "ODK Developers" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to opendatakit-developers+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups
"ODK Developers" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to opendatakit-developers+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

And are you using the very latest ODK Collect?

There were significant performance improvements in ODK Collect 1.4.5

··· On Tue, May 3, 2016 at 1:34 AM, Yaw Anokwa wrote:

Hi Seema,

How many nodes does the form itself has? And how many languages? And
how much RAM/CPU does the device have?

As far as submissions, how big is the average submission and what is
your connection speed? Those are the things that drive submission
speed.

Yaw

Need ODK consultants? Nafundi provides form design, server setup,
in-field training, and software development for ODK. Go to
https://nafundi.com to get started.

On Wed, Apr 6, 2016 at 1:06 PM, Seema Rani seema@vartulz.com wrote:

Thanks Yaw,
I have already used external csv n itemsets, still it is taking too long
time to read from definition as well as to submit on the server.

On Sunday, February 14, 2016 at 1:35:53 PM UTC+5:30, Yaw Anokwa wrote:

Hi Seema,

Form load is slow on the first load and faster on second load because
the device serializes and caches that form definition.

We build a lot of enormous forms and Nafundi and they work well on
modern devices with the techniques below.

If you are using large lists (e.g., tens of thousands villages), use
external itemsets. http://xlsform.org/#external and
https://opendatakit.org/help/form-design/external-itemsets/ are good
places to learn more.

If you are using very complex calculations/constraints/relevance, try
to break those into chunks. If you have a huge list of questions
(thousands) and you are using multiple languages, you can increase
performance by having a language per form.

Good luck,

Yaw

Need ODK consultants? Nafundi provides form design, server setup,
in-field training, and software development for ODK. Go to
https://nafundi.com to get started.

On Tue, Feb 9, 2016 at 5:08 PM, Seema Rani se...@vartulz.com wrote:

Hello team,
Working on odk for survey in a district, having large data of village,
block etc. Uploaded media files as .csv, it increased form loading
time, how

can I optimize this time to reduce, form definition reading time.

Thanks in advance.
Seema

--
You received this message because you are subscribed to the Google
Groups "ODK Developers" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to opendatakit-developers+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups
"ODK Developers" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to opendatakit-developers+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups
"ODK Developers" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to opendatakit-developers+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
Mitch Sundt
Software Engineer
University of Washington
mitchellsundt@gmail.com