AppEngine Application Problem. Billing already enabled! What else could it be?

Support
1

Hello all,

We are running a survey in South Sudan with the World Bank and the National
Bureau of Statistics, using ODK with Aggregator installed on AppEngine as
our back-end.

Over the past couple of days we have experienced a lot of instability with
the server and got the "AppEngine Application Problem" screen several
times. Yesterday, we enabled billing, and the problem seem to have been
resolved for a while, but today we faced the same problem once again,
unable to upload or download any data/forms through ODK collect and getting
the "AppEngine Application Problem" when trying to log in to Aggregate.

Any advice on this?

Many thanks,
Espen

2

Espen,

If you want a free hosted backend for odk collect similar to aggregate feel
free to checkout formhub.org.
It's very stable at the point with a number of large scale data gathering
efforts underway on it.

Feel free to email me directly if you have any questions.

Aggregate will serve you very well too though.

Thanks,

Matt

··· On May 9, 2012 2:31 PM, "Espen Beer Prydz" wrote:

Hello all,

We are running a survey in South Sudan with the World Bank and the
National Bureau of Statistics, using ODK with Aggregator installed on
AppEngine as our back-end.

Over the past couple of days we have experienced a lot of instability with
the server and got the "AppEngine Application Problem" screen several
times. Yesterday, we enabled billing, and the problem seem to have been
resolved for a while, but today we faced the same problem once again,
unable to upload or download any data/forms through ODK collect and getting
the "AppEngine Application Problem" when trying to log in to Aggregate.

Any advice on this?

Many thanks,
Espen

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

3

espen. what is your internet speed like? I got a similar problem with the
"Get Form" and "Send Form" via odk collect a few weeks back - but I think
my main problem was low bandwidth. That I think times out the connections
in the back causing it to give weird errors....

··· On Wed, May 9, 2012 at 2:40 PM, Matt Berg wrote:

Espen,

If you want a free hosted backend for odk collect similar to aggregate
feel free to checkout formhub.org.
It's very stable at the point with a number of large scale data gathering
efforts underway on it.

Feel free to email me directly if you have any questions.

Aggregate will serve you very well too though.

Thanks,

Matt
On May 9, 2012 2:31 PM, "Espen Beer Prydz" espen.prydz@gmail.com wrote:

Hello all,

We are running a survey in South Sudan with the World Bank and the
National Bureau of Statistics, using ODK with Aggregator installed on
AppEngine as our back-end.

Over the past couple of days we have experienced a lot of instability
with the server and got the "AppEngine Application Problem" screen several
times. Yesterday, we enabled billing, and the problem seem to have been
resolved for a while, but today we faced the same problem once again,
unable to upload or download any data/forms through ODK collect and getting
the "AppEngine Application Problem" when trying to log in to Aggregate.

Any advice on this?

Many thanks,
Espen

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

--
Play it forward and Have a good one!

"Like a camera I use the negative to develop..uDig"
"Success is the ability to go from one failure to another with no loss of
enthusiasm"
---------------------------------------------------------------------------------------------------------->
OutSourceRox*
*
Roxroy K. Bollers
GIS and IT Consultant
tel. 592.685.2737
.........................................................
Follow Us On
Facebook http://www.facebook.com/OutSourceRox
Google+ https://plus.google.com/114064153117817313312
Web http://twitinternational.com/outsourcerox.htm

4

Yes, the first question is whether you're accessing Aggregate from a very
slow connection, and, if so, how big are the forms and submissions you're
trying to transfer, and are there any images/audio/video associated with
the forms or submissions. There is a 60-second timeout on Google AppEngine
which you may be encountering.

Aggregate 1.0 has been used for a number of large deployments with good
success. If you determine that slow connection speed is or is not the
problem, please let us know, as your experiences will be factored into
future designs and/or changes to the AppEngine installer to allow for
relaxed timeouts.

You should also look at the appEngine logs to see if there are any
unexpected warnings or errors -- https://appengine.google.com/ choose your
application id, select "Logs" in the left sidebar, and choose to view "Logs
with minimum severity: " Warning.

You will want to look for log entries (the bold heading lines) referring to
/formList, */formXml, /xformsManifest *or /submission
These are the actions that will be exercised by ODK Collect.

Typically, you will see warnings ('W' with yellow background lines) when
the AppEngine instance is started (e.g., deprecated configuration), and
occasional "ExecutionTimeLogger" entries when there are unexpectedly slow
data fetch actions (the number is the milliseconds taken by the query;
anything over 120 milliseconds is logged).

Mitch

··· On Wed, May 9, 2012 at 11:45 AM, Roxroy Bollers wrote:

espen. what is your internet speed like? I got a similar problem with the
"Get Form" and "Send Form" via odk collect a few weeks back - but I think
my main problem was low bandwidth. That I think times out the connections
in the back causing it to give weird errors....

On Wed, May 9, 2012 at 2:40 PM, Matt Berg mlberg@gmail.com wrote:

Espen,

If you want a free hosted backend for odk collect similar to aggregate
feel free to checkout formhub.org.
It's very stable at the point with a number of large scale data gathering
efforts underway on it.

Feel free to email me directly if you have any questions.

Aggregate will serve you very well too though.

Thanks,

Matt
On May 9, 2012 2:31 PM, "Espen Beer Prydz" espen.prydz@gmail.com wrote:

Hello all,

We are running a survey in South Sudan with the World Bank and the
National Bureau of Statistics, using ODK with Aggregator installed on
AppEngine as our back-end.

Over the past couple of days we have experienced a lot of instability
with the server and got the "AppEngine Application Problem" screen several
times. Yesterday, we enabled billing, and the problem seem to have been
resolved for a while, but today we faced the same problem once again,
unable to upload or download any data/forms through ODK collect and getting
the "AppEngine Application Problem" when trying to log in to Aggregate.

Any advice on this?

Many thanks,
Espen

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

--
Play it forward and Have a good one!

"Like a camera I use the negative to develop..uDig"
"Success is the ability to go from one failure to another with no loss of
enthusiasm"

---------------------------------------------------------------------------------------------------------->
OutSourceRox*
*
Roxroy K. Bollers
GIS and IT Consultant
tel. 592.685.2737
.........................................................
Follow Us On
Facebook http://www.facebook.com/OutSourceRox
Google+ https://plus.google.com/114064153117817313312
Web http://twitinternational.com/outsourcerox.htm

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

--
Mitch Sundt
Software Engineer
University of Washington
mitchellsundt@gmail.com

5

Thanks for the responses. Bandwidth is not the issue. We have problems
accessing ODK Aggregate and submitting forms through ODK Collect also from
DC with very good connection.

I have found errors in the log of the type you describe, though they don't
tell me much. I paste a screenshot of two such errors below.

Can you make anything more from this?

[image: Inline image 2]

image
image1072×531 46.5 KB

··· On Wed, May 9, 2012 at 3:56 PM, Mitch S wrote:

Yes, the first question is whether you're accessing Aggregate from a very
slow connection, and, if so, how big are the forms and submissions you're
trying to transfer, and are there any images/audio/video associated with
the forms or submissions. There is a 60-second timeout on Google AppEngine
which you may be encountering.

Aggregate 1.0 has been used for a number of large deployments with good
success. If you determine that slow connection speed is or is not the
problem, please let us know, as your experiences will be factored into
future designs and/or changes to the AppEngine installer to allow for
relaxed timeouts.

You should also look at the appEngine logs to see if there are any
unexpected warnings or errors -- https://appengine.google.com/ choose
your application id, select "Logs" in the left sidebar, and choose to view
"Logs with minimum severity: " Warning.

You will want to look for log entries (the bold heading lines) referring
to /formList, */formXml, /xformsManifest *or /submission
These are the actions that will be exercised by ODK Collect.

Typically, you will see warnings ('W' with yellow background lines) when
the AppEngine instance is started (e.g., deprecated configuration), and
occasional "ExecutionTimeLogger" entries when there are unexpectedly slow
data fetch actions (the number is the milliseconds taken by the query;
anything over 120 milliseconds is logged).

Mitch

On Wed, May 9, 2012 at 11:45 AM, Roxroy Bollers rkbollers@gmail.comwrote:

espen. what is your internet speed like? I got a similar problem with the
"Get Form" and "Send Form" via odk collect a few weeks back - but I think
my main problem was low bandwidth. That I think times out the connections
in the back causing it to give weird errors....

On Wed, May 9, 2012 at 2:40 PM, Matt Berg mlberg@gmail.com wrote:

Espen,

If you want a free hosted backend for odk collect similar to aggregate
feel free to checkout formhub.org.
It's very stable at the point with a number of large scale data
gathering efforts underway on it.

Feel free to email me directly if you have any questions.

Aggregate will serve you very well too though.

Thanks,

Matt
On May 9, 2012 2:31 PM, "Espen Beer Prydz" espen.prydz@gmail.com wrote:

Hello all,

We are running a survey in South Sudan with the World Bank and the
National Bureau of Statistics, using ODK with Aggregator installed on
AppEngine as our back-end.

Over the past couple of days we have experienced a lot of instability
with the server and got the "AppEngine Application Problem" screen several
times. Yesterday, we enabled billing, and the problem seem to have been
resolved for a while, but today we faced the same problem once again,
unable to upload or download any data/forms through ODK collect and getting
the "AppEngine Application Problem" when trying to log in to Aggregate.

Any advice on this?

Many thanks,
Espen

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

--
Play it forward and Have a good one!

"Like a camera I use the negative to develop..uDig"
"Success is the ability to go from one failure to another with no loss of
enthusiasm"

---------------------------------------------------------------------------------------------------------->
OutSourceRox*
*
Roxroy K. Bollers
GIS and IT Consultant
tel. 592.685.2737
.........................................................
Follow Us On
Facebook http://www.facebook.com/OutSourceRox
Google+ https://plus.google.com/114064153117817313312
Web http://twitinternational.com/outsourcerox.htm

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

--
Mitch Sundt
Software Engineer
University of Washington
mitchellsundt@gmail.com

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

6

This looks like you are building from source, rather than using the
installer. Is that true?

image
image1072×531 46.5 KB

··· On Wed, May 9, 2012 at 1:52 PM, Espen Beer Prydz wrote:

Thanks for the responses. Bandwidth is not the issue. We have problems
accessing ODK Aggregate and submitting forms through ODK Collect also from
DC with very good connection.

I have found errors in the log of the type you describe, though they don't
tell me much. I paste a screenshot of two such errors below.

Can you make anything more from this?

[image: Inline image 2]

On Wed, May 9, 2012 at 3:56 PM, Mitch S mitchellsundt@gmail.com wrote:

Yes, the first question is whether you're accessing Aggregate from a very
slow connection, and, if so, how big are the forms and submissions you're
trying to transfer, and are there any images/audio/video associated with
the forms or submissions. There is a 60-second timeout on Google AppEngine
which you may be encountering.

Aggregate 1.0 has been used for a number of large deployments with good
success. If you determine that slow connection speed is or is not the
problem, please let us know, as your experiences will be factored into
future designs and/or changes to the AppEngine installer to allow for
relaxed timeouts.

You should also look at the appEngine logs to see if there are any
unexpected warnings or errors -- https://appengine.google.com/ choose
your application id, select "Logs" in the left sidebar, and choose to view
"Logs with minimum severity: " Warning.

You will want to look for log entries (the bold heading lines) referring
to /formList, */formXml, /xformsManifest *or /submission
These are the actions that will be exercised by ODK Collect.

Typically, you will see warnings ('W' with yellow background lines) when
the AppEngine instance is started (e.g., deprecated configuration), and
occasional "ExecutionTimeLogger" entries when there are unexpectedly slow
data fetch actions (the number is the milliseconds taken by the query;
anything over 120 milliseconds is logged).

Mitch

On Wed, May 9, 2012 at 11:45 AM, Roxroy Bollers rkbollers@gmail.comwrote:

espen. what is your internet speed like? I got a similar problem with
the "Get Form" and "Send Form" via odk collect a few weeks back - but I
think my main problem was low bandwidth. That I think times out the
connections in the back causing it to give weird errors....

On Wed, May 9, 2012 at 2:40 PM, Matt Berg mlberg@gmail.com wrote:

Espen,

If you want a free hosted backend for odk collect similar to aggregate
feel free to checkout formhub.org.
It's very stable at the point with a number of large scale data
gathering efforts underway on it.

Feel free to email me directly if you have any questions.

Aggregate will serve you very well too though.

Thanks,

Matt
On May 9, 2012 2:31 PM, "Espen Beer Prydz" espen.prydz@gmail.com wrote:

Hello all,

We are running a survey in South Sudan with the World Bank and the
National Bureau of Statistics, using ODK with Aggregator installed on
AppEngine as our back-end.

Over the past couple of days we have experienced a lot of instability
with the server and got the "AppEngine Application Problem" screen several
times. Yesterday, we enabled billing, and the problem seem to have been
resolved for a while, but today we faced the same problem once again,
unable to upload or download any data/forms through ODK collect and getting
the "AppEngine Application Problem" when trying to log in to Aggregate.

Any advice on this?

Many thanks,
Espen

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

--
Play it forward and Have a good one!

"Like a camera I use the negative to develop..uDig"
"Success is the ability to go from one failure to another with no loss
of enthusiasm"

---------------------------------------------------------------------------------------------------------->
OutSourceRox*
*
Roxroy K. Bollers
GIS and IT Consultant
tel. 592.685.2737
.........................................................
Follow Us On
Facebook http://www.facebook.com/OutSourceRox
Google+ https://plus.google.com/114064153117817313312
Web http://twitinternational.com/outsourcerox.htm

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

--
Mitch Sundt
Software Engineer
University of Washington
mitchellsundt@gmail.com

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

--
Mitch Sundt
Software Engineer
University of Washington
mitchellsundt@gmail.com

7

If not, can you invite me as a developer for your instance
http://code.google.com/p/opendatakit/wiki/AppEngineTroubleshooting
Or, if you can't do that, click on the "+" by these entries and take a
bigger snapshot of the full log details for them.

Mitch

image
image1072×531 46.5 KB

··· On Wed, May 9, 2012 at 5:20 PM, Mitch S wrote:

This looks like you are building from source, rather than using the
installer. Is that true?

On Wed, May 9, 2012 at 1:52 PM, Espen Beer Prydz espen.prydz@gmail.comwrote:

Thanks for the responses. Bandwidth is not the issue. We have problems
accessing ODK Aggregate and submitting forms through ODK Collect also from
DC with very good connection.

I have found errors in the log of the type you describe, though they
don't tell me much. I paste a screenshot of two such errors below.

Can you make anything more from this?

[image: Inline image 2]

On Wed, May 9, 2012 at 3:56 PM, Mitch S mitchellsundt@gmail.com wrote:

Yes, the first question is whether you're accessing Aggregate from a
very slow connection, and, if so, how big are the forms and submissions
you're trying to transfer, and are there any images/audio/video associated
with the forms or submissions. There is a 60-second timeout on Google
AppEngine which you may be encountering.

Aggregate 1.0 has been used for a number of large deployments with good
success. If you determine that slow connection speed is or is not the
problem, please let us know, as your experiences will be factored into
future designs and/or changes to the AppEngine installer to allow for
relaxed timeouts.

You should also look at the appEngine logs to see if there are any
unexpected warnings or errors -- https://appengine.google.com/ choose
your application id, select "Logs" in the left sidebar, and choose to view
"Logs with minimum severity: " Warning.

You will want to look for log entries (the bold heading lines) referring
to /formList, */formXml, /xformsManifest *or /submission
These are the actions that will be exercised by ODK Collect.

Typically, you will see warnings ('W' with yellow background lines) when
the AppEngine instance is started (e.g., deprecated configuration), and
occasional "ExecutionTimeLogger" entries when there are unexpectedly slow
data fetch actions (the number is the milliseconds taken by the query;
anything over 120 milliseconds is logged).

Mitch

On Wed, May 9, 2012 at 11:45 AM, Roxroy Bollers rkbollers@gmail.comwrote:

espen. what is your internet speed like? I got a similar problem with
the "Get Form" and "Send Form" via odk collect a few weeks back - but I
think my main problem was low bandwidth. That I think times out the
connections in the back causing it to give weird errors....

On Wed, May 9, 2012 at 2:40 PM, Matt Berg mlberg@gmail.com wrote:

Espen,

If you want a free hosted backend for odk collect similar to aggregate
feel free to checkout formhub.org.
It's very stable at the point with a number of large scale data
gathering efforts underway on it.

Feel free to email me directly if you have any questions.

Aggregate will serve you very well too though.

Thanks,

Matt
On May 9, 2012 2:31 PM, "Espen Beer Prydz" espen.prydz@gmail.com wrote:

Hello all,

We are running a survey in South Sudan with the World Bank and the
National Bureau of Statistics, using ODK with Aggregator installed on
AppEngine as our back-end.

Over the past couple of days we have experienced a lot of instability
with the server and got the "AppEngine Application Problem" screen several
times. Yesterday, we enabled billing, and the problem seem to have been
resolved for a while, but today we faced the same problem once again,
unable to upload or download any data/forms through ODK collect and getting
the "AppEngine Application Problem" when trying to log in to Aggregate.

Any advice on this?

Many thanks,
Espen

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

--
Play it forward and Have a good one!

"Like a camera I use the negative to develop..uDig"
"Success is the ability to go from one failure to another with no loss
of enthusiasm"

---------------------------------------------------------------------------------------------------------->
OutSourceRox*
*
Roxroy K. Bollers
GIS and IT Consultant
tel. 592.685.2737
.........................................................
Follow Us On
Facebook http://www.facebook.com/OutSourceRox
Google+ https://plus.google.com/114064153117817313312
Web http://twitinternational.com/outsourcerox.htm

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

--
Mitch Sundt
Software Engineer
University of Washington
mitchellsundt@gmail.com

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

--
Mitch Sundt
Software Engineer
University of Washington
mitchellsundt@gmail.com

--
Mitch Sundt
Software Engineer
University of Washington
mitchellsundt@gmail.com