Thoughts/experiences on improving/automating Briefcase workflow?

Hey group,
I'm working on a project to use 30 or so tablets (Samsung Tab 3s) to
collect hospital data across a country. For the first year or so, our
partner wants everything to run completely offline so we're using
Briefcase. I've found that how I've chosen to use Briefcase involves a lot
of manual steps which are laborious and prone to human error. As I will
be training an overworked data manager on this, I'd like to make the steps
as simple and short as possible. Below are the current steps I have along
with some question/comments. If anyone has pro-tips on how to
automate/skip/simplify I'd be grateful. I'm also going to research and if
I come up with anything will post back to this thread.

Copying instances off tablet onto computer, into briefcase and exported out
as a csv

  1. Reset tablet and connect tablet to computer via cable
  2. Copy "odk" folder from tablet1 to C:/TabletData/Tablet1, and so on for
    each tablet.
  3. Open ODK Briefcase and one by one, pull instances from every C:/TabletData/
    folder.
  4. Export data to csv

*based on previous responses in this group, it seems step 2 is an annoying
but necessary step
*i was hoping to at least bypass step #3 by copying the instances from each
"C:/TabletData/Tabletwhatever/odk/forms/instances" directly into the "C:\ODK
Briefcase Storage\forms\GrilledeSupervisionTest\instances" but this failed

··· -- "Starting Export... Submission not found for instance directory: C:\ODK Briefcase Storage\forms\GrilledeSupervisionTest\instances\grilledesupervision2 (4)_2013-08-07_12-58-42 FAILED!"

In the unfortunate event that an instance needs to be modified after it has
already been imported, I have the following steps.

  1. Delete all instances from ODK Briefcase
  2. Delete all instances from appropriate tablet folder on C:/TabletData/
  3. Open relevant instance on tablet and modify and save.
  4. Reset tablet and connect tablet to computer via cable
  5. Copy "odk" folder from tablet to appropriate folder on C:/TabletData/
  6. Open ODK Briefcase and one by one, pull instances from every C:/TabletData/
    folder.
  7. Export data to csv

I'm hoping someone out there has already figured out a smarter way. HELP!

Respect,
Bill

Hi Bill,

Sorry to hear about your data collection troubles.

If you can setup a WiFi connection between the tablets and the
computers, you can install Aggregate on the laptop and skip much of
importing.

As far as editing data goes, that probably shouldn't be done on the
tablet. Once you've submitted the data, consider it final. Export it
into some master file and make those changes there.

Have you tried pushing back on your partner? If you explain that the
offline requirement results in a laborious and error prone, they might
change their mind.

I understand that you have some process that you need to follow, but a
little bit of flexibility will save you a lot of heartache. And if you
can't be flexible in the process, then you'll just have to find some
way to write software (or find some software) that does exactly what
you need.

Good luck,

Yaw

··· -- Need ODK services? http://nafundi.com provides form design, server setup, professional support, and software development for ODK.

On Mon, Mar 17, 2014 at 5:48 AM, Bill Olander billyolander@gmail.com wrote:

Hey group,
I'm working on a project to use 30 or so tablets (Samsung Tab 3s) to
collect hospital data across a country. For the first year or so, our
partner wants everything to run completely offline so we're using Briefcase.
I've found that how I've chosen to use Briefcase involves a lot of manual
steps which are laborious and prone to human error. As I will be training
an overworked data manager on this, I'd like to make the steps as simple and
short as possible. Below are the current steps I have along with some
question/comments. If anyone has pro-tips on how to automate/skip/simplify
I'd be grateful. I'm also going to research and if I come up with anything
will post back to this thread.

Copying instances off tablet onto computer, into briefcase and exported out
as a csv

  1. Reset tablet and connect tablet to computer via cable
  2. Copy "odk" folder from tablet1 to C:/TabletData/Tablet1, and so on for
    each tablet.
  3. Open ODK Briefcase and one by one, pull instances from every
    C:/TabletData/ folder.
  4. Export data to csv

*based on previous responses in this group, it seems step 2 is an annoying
but necessary step
*i was hoping to at least bypass step #3 by copying the instances from each
"C:/TabletData/Tabletwhatever/odk/forms/instances" directly into the "C:\ODK
Briefcase Storage\forms\GrilledeSupervisionTest\instances" but this failed

"Starting Export...
Submission not found for instance directory: C:\ODK Briefcase
Storage\forms\GrilledeSupervisionTest\instances\grilledesupervision2
(4)_2013-08-07_12-58-42
FAILED!"

In the unfortunate event that an instance needs to be modified after it has
already been imported, I have the following steps.

  1. Delete all instances from ODK Briefcase
  2. Delete all instances from appropriate tablet folder on C:/TabletData/
  3. Open relevant instance on tablet and modify and save.
  4. Reset tablet and connect tablet to computer via cable
  5. Copy "odk" folder from tablet to appropriate folder on C:/TabletData/
  6. Open ODK Briefcase and one by one, pull instances from every
    C:/TabletData/ folder.
  7. Export data to csv

I'm hoping someone out there has already figured out a smarter way. HELP!

Respect,
Bill

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to the Google Groups
"ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Hey Yaw,
Thanks for replying back to me.
I realize I never quite understood AggregateVM (thanks for building it),
but now will try to push for it to be used. Using that will skip a number
of steps.
Much Respect!
Bill

··· On Tuesday, March 18, 2014 4:39:26 AM UTC, Yaw Anokwa wrote: > > Hi Bill, > > Sorry to hear about your data collection troubles. > > If you can setup a WiFi connection between the tablets and the > computers, you can install Aggregate on the laptop and skip much of > importing. > > As far as editing data goes, that probably shouldn't be done on the > tablet. Once you've submitted the data, consider it final. Export it > into some master file and make those changes there. > > Have you tried pushing back on your partner? If you explain that the > offline requirement results in a laborious and error prone, they might > change their mind. > > I understand that you have some process that you need to follow, but a > little bit of flexibility will save you a lot of heartache. And if you > can't be flexible in the process, then you'll just have to find some > way to write software (or find some software) that does exactly what > you need. > > Good luck, > > Yaw > -- > Need ODK services? http://nafundi.com provides form design, server > setup, professional support, and software development for ODK. > > On Mon, Mar 17, 2014 at 5:48 AM, Bill Olander <billyo...@gmail.com> wrote: > > Hey group, > > I'm working on a project to use 30 or so tablets (Samsung Tab 3s) to > > collect hospital data across a country. For the first year or so, our > > partner wants everything to run completely offline so we're using > Briefcase. > > I've found that how I've chosen to use Briefcase involves a lot of > manual > > steps which are laborious and prone to human error. As I will be > training > > an overworked data manager on this, I'd like to make the steps as simple > and > > short as possible. Below are the current steps I have along with some > > question/comments. If anyone has pro-tips on how to > automate/skip/simplify > > I'd be grateful. I'm also going to research and if I come up with > anything > > will post back to this thread. > > > > Copying instances off tablet onto computer, into briefcase and exported > out > > as a csv > > 1. Reset tablet and connect tablet to computer via cable > > 2. Copy "odk" folder from tablet1 to C:/TabletData/Tablet1, and so on > for > > each tablet. > > 3. Open ODK Briefcase and one by one, pull instances from every > > C:/TabletData/ folder. > > 4. Export data to csv > > > > *based on previous responses in this group, it seems step 2 is an > annoying > > but necessary step > > *i was hoping to at least bypass step #3 by copying the instances from > each > > "C:/TabletData/Tabletwhatever/odk/forms/instances" directly into the > "C:\ODK > > Briefcase Storage\forms\GrilledeSupervisionTest\instances" but this > failed > > -- > > "Starting Export... > > Submission not found for instance directory: C:\ODK Briefcase > > Storage\forms\GrilledeSupervisionTest\instances\grilledesupervision2 > > (4)_2013-08-07_12-58-42 > > FAILED!" > > > > In the unfortunate event that an instance needs to be modified after it > has > > already been imported, I have the following steps. > > 1. Delete all instances from ODK Briefcase > > 2. Delete all instances from appropriate tablet folder on > C:/TabletData/ > > 3. Open relevant instance on tablet and modify and save. > > 4. Reset tablet and connect tablet to computer via cable > > 5. Copy "odk" folder from tablet to appropriate folder on > C:/TabletData/ > > 3. Open ODK Briefcase and one by one, pull instances from every > > C:/TabletData/ folder. > > 4. Export data to csv > > > > I'm hoping someone out there has already figured out a smarter way. > HELP! > > > > Respect, > > Bill > > > > -- > > -- > > Post: opend...@googlegroups.com > > Unsubscribe: opendatakit...@googlegroups.com > > Options: http://groups.google.com/group/opendatakit?hl=en > > > > --- > > You received this message because you are subscribed to the Google > Groups > > "ODK Community" group. > > To unsubscribe from this group and stop receiving emails from it, send > an > > email to opendatakit...@googlegroups.com . > > For more options, visit https://groups.google.com/d/optout. >

Hi Bill,

The VM is not without its warts, but if you can make sure it's on the
same network as your devices, and that its IP does not change, it
should work for you.

Yaw

··· -- Need ODK services? http://nafundi.com provides form design, server setup, professional support, and software development for ODK.

On Fri, Mar 21, 2014 at 3:04 AM, Bill Olander billyolander@gmail.com wrote:

Hey Yaw,
Thanks for replying back to me.
I realize I never quite understood AggregateVM (thanks for building it),
but now will try to push for it to be used. Using that will skip a number
of steps.
Much Respect!
Bill

On Tuesday, March 18, 2014 4:39:26 AM UTC, Yaw Anokwa wrote:

Hi Bill,

Sorry to hear about your data collection troubles.

If you can setup a WiFi connection between the tablets and the
computers, you can install Aggregate on the laptop and skip much of
importing.

As far as editing data goes, that probably shouldn't be done on the
tablet. Once you've submitted the data, consider it final. Export it
into some master file and make those changes there.

Have you tried pushing back on your partner? If you explain that the
offline requirement results in a laborious and error prone, they might
change their mind.

I understand that you have some process that you need to follow, but a
little bit of flexibility will save you a lot of heartache. And if you
can't be flexible in the process, then you'll just have to find some
way to write software (or find some software) that does exactly what
you need.

Good luck,

Yaw

Need ODK services? http://nafundi.com provides form design, server
setup, professional support, and software development for ODK.

On Mon, Mar 17, 2014 at 5:48 AM, Bill Olander billyo...@gmail.com wrote:

Hey group,
I'm working on a project to use 30 or so tablets (Samsung Tab 3s) to
collect hospital data across a country. For the first year or so, our
partner wants everything to run completely offline so we're using
Briefcase.
I've found that how I've chosen to use Briefcase involves a lot of
manual
steps which are laborious and prone to human error. As I will be
training
an overworked data manager on this, I'd like to make the steps as simple
and
short as possible. Below are the current steps I have along with some
question/comments. If anyone has pro-tips on how to
automate/skip/simplify
I'd be grateful. I'm also going to research and if I come up with
anything
will post back to this thread.

Copying instances off tablet onto computer, into briefcase and exported
out
as a csv

  1. Reset tablet and connect tablet to computer via cable
  2. Copy "odk" folder from tablet1 to C:/TabletData/Tablet1, and so on
    for
    each tablet.
  3. Open ODK Briefcase and one by one, pull instances from every
    C:/TabletData/ folder.
  4. Export data to csv

*based on previous responses in this group, it seems step 2 is an
annoying
but necessary step
*i was hoping to at least bypass step #3 by copying the instances from
each
"C:/TabletData/Tabletwhatever/odk/forms/instances" directly into the
"C:\ODK
Briefcase Storage\forms\GrilledeSupervisionTest\instances" but this
failed

"Starting Export...
Submission not found for instance directory: C:\ODK Briefcase
Storage\forms\GrilledeSupervisionTest\instances\grilledesupervision2
(4)_2013-08-07_12-58-42
FAILED!"

In the unfortunate event that an instance needs to be modified after it
has
already been imported, I have the following steps.

  1. Delete all instances from ODK Briefcase
  2. Delete all instances from appropriate tablet folder on
    C:/TabletData/
  3. Open relevant instance on tablet and modify and save.
  4. Reset tablet and connect tablet to computer via cable
  5. Copy "odk" folder from tablet to appropriate folder on
    C:/TabletData/
  6. Open ODK Briefcase and one by one, pull instances from every
    C:/TabletData/ folder.
  7. Export data to csv

I'm hoping someone out there has already figured out a smarter way.
HELP!

Respect,
Bill

--

Post: opend...@googlegroups.com
Unsubscribe: opendatakit...@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to the Google
Groups
"ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send
an
email to opendatakit...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to the Google Groups
"ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Hi Yaw,
It took a little playing around, but i finally found it was easy enough
to assign a fixed ip adress via the router's settings menu.
Is there any thing else, any "warts" to be wary of when using
AggregateVM? With the ip adress fixed, its been smooth sailing.
Thanks,
Bill

··· On Friday, March 21, 2014 1:48:55 PM UTC, Yaw Anokwa wrote: > > Hi Bill, > > The VM is not without its warts, but if you can make sure it's on the > same network as your devices, and that its IP does not change, it > should work for you. > > Yaw > -- > Need ODK services? http://nafundi.com provides form design, server > setup, professional support, and software development for ODK. > > On Fri, Mar 21, 2014 at 3:04 AM, Bill Olander <billyo...@gmail.com> wrote: > > Hey Yaw, > > Thanks for replying back to me. > > I realize I never quite understood AggregateVM (thanks for building > it), > > but now will try to push for it to be used. Using that will skip a > number > > of steps. > > Much Respect! > > Bill > > > > > > On Tuesday, March 18, 2014 4:39:26 AM UTC, Yaw Anokwa wrote: > >> > >> Hi Bill, > >> > >> Sorry to hear about your data collection troubles. > >> > >> If you can setup a WiFi connection between the tablets and the > >> computers, you can install Aggregate on the laptop and skip much of > >> importing. > >> > >> As far as editing data goes, that probably shouldn't be done on the > >> tablet. Once you've submitted the data, consider it final. Export it > >> into some master file and make those changes there. > >> > >> Have you tried pushing back on your partner? If you explain that the > >> offline requirement results in a laborious and error prone, they might > >> change their mind. > >> > >> I understand that you have some process that you need to follow, but a > >> little bit of flexibility will save you a lot of heartache. And if you > >> can't be flexible in the process, then you'll just have to find some > >> way to write software (or find some software) that does exactly what > >> you need. > >> > >> Good luck, > >> > >> Yaw > >> -- > >> Need ODK services? http://nafundi.com provides form design, server > >> setup, professional support, and software development for ODK. > >> > >> On Mon, Mar 17, 2014 at 5:48 AM, Bill Olander wrote: > >> > Hey group, > >> > I'm working on a project to use 30 or so tablets (Samsung Tab 3s) > to > >> > collect hospital data across a country. For the first year or so, > our > >> > partner wants everything to run completely offline so we're using > >> > Briefcase. > >> > I've found that how I've chosen to use Briefcase involves a lot of > >> > manual > >> > steps which are laborious and prone to human error. As I will be > >> > training > >> > an overworked data manager on this, I'd like to make the steps as > simple > >> > and > >> > short as possible. Below are the current steps I have along with > some > >> > question/comments. If anyone has pro-tips on how to > >> > automate/skip/simplify > >> > I'd be grateful. I'm also going to research and if I come up with > >> > anything > >> > will post back to this thread. > >> > > >> > Copying instances off tablet onto computer, into briefcase and > exported > >> > out > >> > as a csv > >> > 1. Reset tablet and connect tablet to computer via cable > >> > 2. Copy "odk" folder from tablet1 to C:/TabletData/Tablet1, and so > on > >> > for > >> > each tablet. > >> > 3. Open ODK Briefcase and one by one, pull instances from every > >> > C:/TabletData/ folder. > >> > 4. Export data to csv > >> > > >> > *based on previous responses in this group, it seems step 2 is an > >> > annoying > >> > but necessary step > >> > *i was hoping to at least bypass step #3 by copying the instances > from > >> > each > >> > "C:/TabletData/Tabletwhatever/odk/forms/instances" directly into the > >> > "C:\ODK > >> > Briefcase Storage\forms\GrilledeSupervisionTest\instances" but this > >> > failed > >> > -- > >> > "Starting Export... > >> > Submission not found for instance directory: C:\ODK Briefcase > >> > Storage\forms\GrilledeSupervisionTest\instances\grilledesupervision2 > >> > (4)_2013-08-07_12-58-42 > >> > FAILED!" > >> > > >> > In the unfortunate event that an instance needs to be modified after > it > >> > has > >> > already been imported, I have the following steps. > >> > 1. Delete all instances from ODK Briefcase > >> > 2. Delete all instances from appropriate tablet folder on > >> > C:/TabletData/ > >> > 3. Open relevant instance on tablet and modify and save. > >> > 4. Reset tablet and connect tablet to computer via cable > >> > 5. Copy "odk" folder from tablet to appropriate folder on > >> > C:/TabletData/ > >> > 3. Open ODK Briefcase and one by one, pull instances from every > >> > C:/TabletData/ folder. > >> > 4. Export data to csv > >> > > >> > I'm hoping someone out there has already figured out a smarter way. > >> > HELP! > >> > > >> > Respect, > >> > Bill > >> > > >> > -- > >> > -- > >> > Post: opend...@googlegroups.com > >> > Unsubscribe: opendatakit...@googlegroups.com > >> > Options: http://groups.google.com/group/opendatakit?hl=en > >> > > >> > --- > >> > You received this message because you are subscribed to the Google > >> > Groups > >> > "ODK Community" group. > >> > To unsubscribe from this group and stop receiving emails from it, > send > >> > an > >> > email to opendatakit...@googlegroups.com. > >> > For more options, visit https://groups.google.com/d/optout. > > > > -- > > -- > > Post: opend...@googlegroups.com > > Unsubscribe: opendatakit...@googlegroups.com > > Options: http://groups.google.com/group/opendatakit?hl=en > > > > --- > > You received this message because you are subscribed to the Google > Groups > > "ODK Community" group. > > To unsubscribe from this group and stop receiving emails from it, send > an > > email to opendatakit...@googlegroups.com . > > For more options, visit https://groups.google.com/d/optout. >

Bill,

What we know about is what is in the read me and at
https://bitbucket.org/nafundi/odk-aggregate-vm/issues.

Yaw

··· -- Need ODK services? http://nafundi.com provides form design, server setup, professional support, and software development for ODK.

On Sun, Apr 6, 2014 at 3:10 AM, Bill Olander billyolander@gmail.com wrote:

Hi Yaw,
It took a little playing around, but i finally found it was easy enough to
assign a fixed ip adress via the router's settings menu.
Is there any thing else, any "warts" to be wary of when using AggregateVM?
With the ip adress fixed, its been smooth sailing.
Thanks,
Bill

On Friday, March 21, 2014 1:48:55 PM UTC, Yaw Anokwa wrote:

Hi Bill,

The VM is not without its warts, but if you can make sure it's on the
same network as your devices, and that its IP does not change, it
should work for you.

Yaw

Need ODK services? http://nafundi.com provides form design, server
setup, professional support, and software development for ODK.

On Fri, Mar 21, 2014 at 3:04 AM, Bill Olander billyo...@gmail.com wrote:

Hey Yaw,
Thanks for replying back to me.
I realize I never quite understood AggregateVM (thanks for building
it),
but now will try to push for it to be used. Using that will skip a
number
of steps.
Much Respect!
Bill

On Tuesday, March 18, 2014 4:39:26 AM UTC, Yaw Anokwa wrote:

Hi Bill,

Sorry to hear about your data collection troubles.

If you can setup a WiFi connection between the tablets and the
computers, you can install Aggregate on the laptop and skip much of
importing.

As far as editing data goes, that probably shouldn't be done on the
tablet. Once you've submitted the data, consider it final. Export it
into some master file and make those changes there.

Have you tried pushing back on your partner? If you explain that the
offline requirement results in a laborious and error prone, they might
change their mind.

I understand that you have some process that you need to follow, but a
little bit of flexibility will save you a lot of heartache. And if you
can't be flexible in the process, then you'll just have to find some
way to write software (or find some software) that does exactly what
you need.

Good luck,

Yaw

Need ODK services? http://nafundi.com provides form design, server
setup, professional support, and software development for ODK.

On Mon, Mar 17, 2014 at 5:48 AM, Bill Olander billyo...@gmail.com wrote:

Hey group,
I'm working on a project to use 30 or so tablets (Samsung Tab 3s)
to
collect hospital data across a country. For the first year or so,
our
partner wants everything to run completely offline so we're using
Briefcase.
I've found that how I've chosen to use Briefcase involves a lot of
manual
steps which are laborious and prone to human error. As I will be
training
an overworked data manager on this, I'd like to make the steps as
simple
and
short as possible. Below are the current steps I have along with
some
question/comments. If anyone has pro-tips on how to
automate/skip/simplify
I'd be grateful. I'm also going to research and if I come up with
anything
will post back to this thread.

Copying instances off tablet onto computer, into briefcase and
exported
out
as a csv

  1. Reset tablet and connect tablet to computer via cable
  2. Copy "odk" folder from tablet1 to C:/TabletData/Tablet1, and so
    on
    for
    each tablet.
  3. Open ODK Briefcase and one by one, pull instances from every
    C:/TabletData/ folder.
  4. Export data to csv

*based on previous responses in this group, it seems step 2 is an
annoying
but necessary step
*i was hoping to at least bypass step #3 by copying the instances
from
each
"C:/TabletData/Tabletwhatever/odk/forms/instances" directly into the
"C:\ODK
Briefcase Storage\forms\GrilledeSupervisionTest\instances" but this
failed

"Starting Export...
Submission not found for instance directory: C:\ODK Briefcase
Storage\forms\GrilledeSupervisionTest\instances\grilledesupervision2
(4)_2013-08-07_12-58-42
FAILED!"

In the unfortunate event that an instance needs to be modified after
it
has
already been imported, I have the following steps.

  1. Delete all instances from ODK Briefcase
  2. Delete all instances from appropriate tablet folder on
    C:/TabletData/
  3. Open relevant instance on tablet and modify and save.
  4. Reset tablet and connect tablet to computer via cable
  5. Copy "odk" folder from tablet to appropriate folder on
    C:/TabletData/
  6. Open ODK Briefcase and one by one, pull instances from every
    C:/TabletData/ folder.
  7. Export data to csv

I'm hoping someone out there has already figured out a smarter way.
HELP!

Respect,
Bill

--

Post: opend...@googlegroups.com
Unsubscribe: opendatakit...@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to the Google
Groups
"ODK Community" group.
To unsubscribe from this group and stop receiving emails from it,
send
an
email to opendatakit...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Post: opend...@googlegroups.com
Unsubscribe: opendatakit...@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to the Google
Groups
"ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send
an
email to opendatakit...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to the Google Groups
"ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.