Urgent help with Briefcase as in field with a problem

Hi

I am in the field in Guyana and struggling with getting forms to send data
through a satelite internet service that is giving me 250k down and 40k up.
The phons simply error and timmout when sending completed forms.

I have tested with an older beta version of briefcase and it successfully
sends the data, because the computer I am using has a satelite compression
software on that help bring data down to size before sending and this has
successfully sent data.

But I have now downloaded the new version and it has allowed me to pull the
data off the phone but when i go into push it doesnt show the data to allow
me to select it and push it. Has anone got any ideas how to help.

I am looking to get the data up to agregate tommorow to show the crew the
results of their work, before I fly back to the UK, hence the request for
urgent help.

thanks

Jon

Hey Jon,

Just as a heads up, it's unlikely this issue will get sorted before you leave.

Sounds like the older beta works? Why not use it?
http://code.google.com/p/opendatakit/downloads/list?can=1&q=&sort=-filename
has a list of all the old versions.

Yaw

··· On Wed, Apr 25, 2012 at 15:39, Jon Parsons wrote: > Hi > > I am in the field in Guyana and struggling with getting forms to send data > through a satelite internet service that is giving me 250k down and 40k up. > The phons simply error and timmout when sending completed forms. > > I have tested with an older beta version of briefcase and it successfully > sends the data, because the computer I am using has a satelite compression > software on that help bring data down to size before sending and this has > successfully sent data. > > But I have now downloaded the new version and it has allowed me to pull the > data off the phone but when i go into push it doesnt show the data to allow > me to select it and push it. Has anone got any ideas how to help. > > I am looking to get the data up to agregate tommorow to show the crew the > results of their work, before I fly back to the UK, hence the request for > urgent help. > > thanks > > Jon > > -- > Post: opendatakit@googlegroups.com > Unsubscribe: opendatakit+unsubscribe@googlegroups.com > Options: http://groups.google.com/group/opendatakit?hl=en

There was a data folder name-change between the Beta and the production
versions.

If you used the beta to pull the data, then you need to rename the folder
containing the the beta's /form and /scratch directories to the
production's "ODK Briefcase Storage" naming convention. i.e., the
production version creates a folder named "ODK Briefcase Storage" that
holds the /forms directory (same structure as in the Beta). The beta
allowed you to name the containing directory anything and created a /forms
and /scratch within that. Once you do that, you'll need to choose the
directory containing this "ODK Briefcase Storage" directory as the Storage
Location. Then you should see your files.

For best push/pull results, first browse to your server instance and verify
that it is spun up (especially if you are using AppEngine).

Then use Briefcase to push to it. The latest Briefcase has a 60-second
upload timeout.

To improve the transmission speed and reduce the bytes transmitted, If your
form definition has a lot of media files, after pulling the data to your
laptop, you should go into the /forms directory, into the directory for
each form definition, and delete any form-media folder. That prevents
Briefcase from sending any of those media files to the server Otherwise,
during a push, Briefcase first pushes the form definition (including all
its media files) and then pushes all the submissions. By deleting the
media folder, you avoid uploading all those files before beginning the
transmissions of the submissions that you're interested in. The upload of
the form definition file is required, as the server uses that file to
verify that it has the same form definition as the one you're attempting to
upload (and rejects the upload otherwise).

Mitch

··· On Wed, Apr 25, 2012 at 3:59 PM, Yaw Anokwa wrote:

Hey Jon,

Just as a heads up, it's unlikely this issue will get sorted before you
leave.

Sounds like the older beta works? Why not use it?
http://code.google.com/p/opendatakit/downloads/list?can=1&q=&sort=-filename
has a list of all the old versions.

Yaw

On Wed, Apr 25, 2012 at 15:39, Jon Parsons j.parsons@globalcanopy.org wrote:

Hi

I am in the field in Guyana and struggling with getting forms to send
data
through a satelite internet service that is giving me 250k down and 40k
up.
The phons simply error and timmout when sending completed forms.

I have tested with an older beta version of briefcase and it successfully
sends the data, because the computer I am using has a satelite
compression
software on that help bring data down to size before sending and this has
successfully sent data.

But I have now downloaded the new version and it has allowed me to pull
the
data off the phone but when i go into push it doesnt show the data to
allow
me to select it and push it. Has anone got any ideas how to help.

I am looking to get the data up to agregate tommorow to show the crew the
results of their work, before I fly back to the UK, hence the request for
urgent help.

thanks

Jon

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

--
Mitch Sundt
Software Engineer
University of Washington
mitchellsundt@gmail.com

Because the internet is so bad at this end (working on the same project
with Jon) and reading you explain that there is a 60-second time
out....what are the possibilities of increasing this to lets say
a minute or more???

R.

··· On Wed, Apr 25, 2012 at 8:31 PM, Mitch S wrote:

There was a data folder name-change between the Beta and the production
versions.

If you used the beta to pull the data, then you need to rename the folder
containing the the beta's /form and /scratch directories to the
production's "ODK Briefcase Storage" naming convention. i.e., the
production version creates a folder named "ODK Briefcase Storage" that
holds the /forms directory (same structure as in the Beta). The beta
allowed you to name the containing directory anything and created a /forms
and /scratch within that. Once you do that, you'll need to choose the
directory containing this "ODK Briefcase Storage" directory as the Storage
Location. Then you should see your files.

For best push/pull results, first browse to your server instance and
verify that it is spun up (especially if you are using AppEngine).

Then use Briefcase to push to it. The latest Briefcase has a 60-second
upload timeout.

To improve the transmission speed and reduce the bytes transmitted, If
your form definition has a lot of media files, after pulling the data to
your laptop, you should go into the /forms directory, into the directory
for each form definition, and delete any form-media folder. That prevents
Briefcase from sending any of those media files to the server Otherwise,
during a push, Briefcase first pushes the form definition (including all
its media files) and then pushes all the submissions. By deleting the
media folder, you avoid uploading all those files before beginning the
transmissions of the submissions that you're interested in. The upload of
the form definition file is required, as the server uses that file to
verify that it has the same form definition as the one you're attempting to
upload (and rejects the upload otherwise).

Mitch

On Wed, Apr 25, 2012 at 3:59 PM, Yaw Anokwa yanokwa@gmail.com wrote:

Hey Jon,

Just as a heads up, it's unlikely this issue will get sorted before you
leave.

Sounds like the older beta works? Why not use it?

http://code.google.com/p/opendatakit/downloads/list?can=1&q=&sort=-filename
has a list of all the old versions.

Yaw

On Wed, Apr 25, 2012 at 15:39, Jon Parsons j.parsons@globalcanopy.org wrote:

Hi

I am in the field in Guyana and struggling with getting forms to send
data
through a satelite internet service that is giving me 250k down and 40k
up.
The phons simply error and timmout when sending completed forms.

I have tested with an older beta version of briefcase and it
successfully
sends the data, because the computer I am using has a satelite
compression
software on that help bring data down to size before sending and this
has
successfully sent data.

But I have now downloaded the new version and it has allowed me to pull
the
data off the phone but when i go into push it doesnt show the data to
allow
me to select it and push it. Has anone got any ideas how to help.

I am looking to get the data up to agregate tommorow to show the crew
the
results of their work, before I fly back to the UK, hence the request
for
urgent help.

thanks

Jon

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

--
Mitch Sundt
Software Engineer
University of Washington
mitchellsundt@gmail.com

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

--
Play it forward and Have a good one!

"Like a camera I use the negative to develop..uDig"
"Success is the ability to go from one failure to another with no loss of
enthusiasm"
---------------------------------------------------------------------------------------------------------->
OutSourceRox*
*
Roxroy K. Bollers
GIS and IT Consultant
tel. 592.685.2737
.........................................................
Follow Us On
Facebook http://www.facebook.com/OutSourceRox
Google+ https://plus.google.com/114064153117817313312
Web http://twitinternational.com/outsourcerox.htm

You have two issues -- the timeout in Briefcase, which is easy to change,
and the request timeout enforced by the server. If you are sending data to
AppEngine, it has a request timer that aborts requests that take longer
than 60 seconds (
https://developers.google.com/appengine/docs/java/runtime#The_Request_Timer).
Tomcat hosts also have a request timeout (see the Tomcat 6
documentation for how to change that).

As the AppEngine documentation states, you can perform an AppEngine
deployment that runs everything as a "backend", but I've never tried that.
This would require knowledge of AppEngine deployments, how to modify java
jars, and manually editing the ODK
Aggregate\ODKAggregate\WEB-INF\appengine-web.xml, backends.xml and
lib\ODKAggregate-settings.jar before deploying up to AppEngine. At a
minimum, you need to change the backend to be a public backend and, in the
jar, update the security-properties file to have the
security.server.hostname refer to the backend instance.

For ODK Briefcase, it is easy to change the timeout and recompile. The
setting is here:

http://code.google.com/p/opendatakit/source/browse/src/org/opendatakit/briefcase/util/AggregateUtils.java?repo=briefcase#61

Change SERVER_CONNECTION_TIMEOUT and recompile.

Mitch

··· On Thu, Apr 26, 2012 at 6:06 AM, Roxroy Bollers wrote:

Because the internet is so bad at this end (working on the same project
with Jon) and reading you explain that there is a 60-second time
out....what are the possibilities of increasing this to lets say
a minute or more???

R.

On Wed, Apr 25, 2012 at 8:31 PM, Mitch S mitchellsundt@gmail.com wrote:

There was a data folder name-change between the Beta and the production
versions.

If you used the beta to pull the data, then you need to rename the folder
containing the the beta's /form and /scratch directories to the
production's "ODK Briefcase Storage" naming convention. i.e., the
production version creates a folder named "ODK Briefcase Storage" that
holds the /forms directory (same structure as in the Beta). The beta
allowed you to name the containing directory anything and created a /forms
and /scratch within that. Once you do that, you'll need to choose the
directory containing this "ODK Briefcase Storage" directory as the Storage
Location. Then you should see your files.

For best push/pull results, first browse to your server instance and
verify that it is spun up (especially if you are using AppEngine).

Then use Briefcase to push to it. The latest Briefcase has a 60-second
upload timeout.

To improve the transmission speed and reduce the bytes transmitted, If
your form definition has a lot of media files, after pulling the data to
your laptop, you should go into the /forms directory, into the directory
for each form definition, and delete any form-media folder. That prevents
Briefcase from sending any of those media files to the server Otherwise,
during a push, Briefcase first pushes the form definition (including all
its media files) and then pushes all the submissions. By deleting the
media folder, you avoid uploading all those files before beginning the
transmissions of the submissions that you're interested in. The upload of
the form definition file is required, as the server uses that file to
verify that it has the same form definition as the one you're attempting to
upload (and rejects the upload otherwise).

Mitch

On Wed, Apr 25, 2012 at 3:59 PM, Yaw Anokwa yanokwa@gmail.com wrote:

Hey Jon,

Just as a heads up, it's unlikely this issue will get sorted before you
leave.

Sounds like the older beta works? Why not use it?

http://code.google.com/p/opendatakit/downloads/list?can=1&q=&sort=-filename
has a list of all the old versions.

Yaw

On Wed, Apr 25, 2012 at 15:39, Jon Parsons j.parsons@globalcanopy.org wrote:

Hi

I am in the field in Guyana and struggling with getting forms to send
data
through a satelite internet service that is giving me 250k down and
40k up.
The phons simply error and timmout when sending completed forms.

I have tested with an older beta version of briefcase and it
successfully
sends the data, because the computer I am using has a satelite
compression
software on that help bring data down to size before sending and this
has
successfully sent data.

But I have now downloaded the new version and it has allowed me to
pull the
data off the phone but when i go into push it doesnt show the data to
allow
me to select it and push it. Has anone got any ideas how to help.

I am looking to get the data up to agregate tommorow to show the crew
the
results of their work, before I fly back to the UK, hence the request
for
urgent help.

thanks

Jon

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

--
Mitch Sundt
Software Engineer
University of Washington
mitchellsundt@gmail.com

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

--
Play it forward and Have a good one!

"Like a camera I use the negative to develop..uDig"
"Success is the ability to go from one failure to another with no loss of
enthusiasm"

---------------------------------------------------------------------------------------------------------->
OutSourceRox*
*
Roxroy K. Bollers
GIS and IT Consultant
tel. 592.685.2737
.........................................................
Follow Us On
Facebook http://www.facebook.com/OutSourceRox
Google+ https://plus.google.com/114064153117817313312
Web http://twitinternational.com/outsourcerox.htm

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

--
Mitch Sundt
Software Engineer
University of Washington
mitchellsundt@gmail.com

Thanks for that Mitch.... I guess for now, we will just have to up the
speed of our internet to make this work for us.

R.

··· On Thu, Apr 26, 2012 at 12:10 PM, Mitch S wrote:

You have two issues -- the timeout in Briefcase, which is easy to change,
and the request timeout enforced by the server. If you are sending data to
AppEngine, it has a request timer that aborts requests that take longer
than 60 seconds (
https://developers.google.com/appengine/docs/java/runtime#The_Request_Timer). Tomcat hosts also have a request timeout (see the Tomcat 6
documentation for how to change that).

As the AppEngine documentation states, you can perform an AppEngine
deployment that runs everything as a "backend", but I've never tried that.
This would require knowledge of AppEngine deployments, how to modify java
jars, and manually editing the ODK
Aggregate\ODKAggregate\WEB-INF\appengine-web.xml, backends.xml and
lib\ODKAggregate-settings.jar before deploying up to AppEngine. At a
minimum, you need to change the backend to be a public backend and, in the
jar, update the security-properties file to have the
security.server.hostname refer to the backend instance.

For ODK Briefcase, it is easy to change the timeout and recompile. The
setting is here:

http://code.google.com/p/opendatakit/source/browse/src/org/opendatakit/briefcase/util/AggregateUtils.java?repo=briefcase#61

Change SERVER_CONNECTION_TIMEOUT and recompile.

Mitch

On Thu, Apr 26, 2012 at 6:06 AM, Roxroy Bollers rkbollers@gmail.comwrote:

Because the internet is so bad at this end (working on the same project
with Jon) and reading you explain that there is a 60-second time
out....what are the possibilities of increasing this to lets say
a minute or more???

R.

On Wed, Apr 25, 2012 at 8:31 PM, Mitch S mitchellsundt@gmail.com wrote:

There was a data folder name-change between the Beta and the production
versions.

If you used the beta to pull the data, then you need to rename the
folder containing the the beta's /form and /scratch directories to the
production's "ODK Briefcase Storage" naming convention. i.e., the
production version creates a folder named "ODK Briefcase Storage" that
holds the /forms directory (same structure as in the Beta). The beta
allowed you to name the containing directory anything and created a /forms
and /scratch within that. Once you do that, you'll need to choose the
directory containing this "ODK Briefcase Storage" directory as the Storage
Location. Then you should see your files.

For best push/pull results, first browse to your server instance and
verify that it is spun up (especially if you are using AppEngine).

Then use Briefcase to push to it. The latest Briefcase has a 60-second
upload timeout.

To improve the transmission speed and reduce the bytes transmitted, If
your form definition has a lot of media files, after pulling the data to
your laptop, you should go into the /forms directory, into the directory
for each form definition, and delete any form-media folder. That prevents
Briefcase from sending any of those media files to the server Otherwise,
during a push, Briefcase first pushes the form definition (including all
its media files) and then pushes all the submissions. By deleting the
media folder, you avoid uploading all those files before beginning the
transmissions of the submissions that you're interested in. The upload of
the form definition file is required, as the server uses that file to
verify that it has the same form definition as the one you're attempting to
upload (and rejects the upload otherwise).

Mitch

On Wed, Apr 25, 2012 at 3:59 PM, Yaw Anokwa yanokwa@gmail.com wrote:

Hey Jon,

Just as a heads up, it's unlikely this issue will get sorted before you
leave.

Sounds like the older beta works? Why not use it?

http://code.google.com/p/opendatakit/downloads/list?can=1&q=&sort=-filename
has a list of all the old versions.

Yaw

On Wed, Apr 25, 2012 at 15:39, Jon Parsons j.parsons@globalcanopy.org wrote:

Hi

I am in the field in Guyana and struggling with getting forms to send
data
through a satelite internet service that is giving me 250k down and
40k up.
The phons simply error and timmout when sending completed forms.

I have tested with an older beta version of briefcase and it
successfully
sends the data, because the computer I am using has a satelite
compression
software on that help bring data down to size before sending and this
has
successfully sent data.

But I have now downloaded the new version and it has allowed me to
pull the
data off the phone but when i go into push it doesnt show the data to
allow
me to select it and push it. Has anone got any ideas how to help.

I am looking to get the data up to agregate tommorow to show the crew
the
results of their work, before I fly back to the UK, hence the request
for
urgent help.

thanks

Jon

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

--
Mitch Sundt
Software Engineer
University of Washington
mitchellsundt@gmail.com

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

--
Play it forward and Have a good one!

"Like a camera I use the negative to develop..uDig"
"Success is the ability to go from one failure to another with no loss of
enthusiasm"

---------------------------------------------------------------------------------------------------------->
OutSourceRox*
*
Roxroy K. Bollers
GIS and IT Consultant
tel. 592.685.2737
.........................................................
Follow Us On
Facebook http://www.facebook.com/OutSourceRox
Google+ https://plus.google.com/114064153117817313312
Web http://twitinternational.com/outsourcerox.htm

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

--
Mitch Sundt
Software Engineer
University of Washington
mitchellsundt@gmail.com

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

--
Play it forward and Have a good one!

"Like a camera I use the negative to develop..uDig"
"Success is the ability to go from one failure to another with no loss of
enthusiasm"
---------------------------------------------------------------------------------------------------------->
OutSourceRox*
*
Roxroy K. Bollers
GIS and IT Consultant
tel. 592.685.2737
.........................................................
Follow Us On
Facebook http://www.facebook.com/OutSourceRox
Google+ https://plus.google.com/114064153117817313312
Web http://twitinternational.com/outsourcerox.htm