Aggregate Instance on Appspot Maxing out on Datastore Write Operations

Hi all,

I set up an ODK Aggregate instance on AppSpot (free account) a few weeks
ago and have prepping/testing it to deploy an ODK Collect survey next week.
Today I got the "AppEngine Application Problem" error notifying me that my
application has exceeded its per-minute or per-day usage quotas. When I
signed in to my application dashboard, I saw that the operation I am maxed
out on is the Datastore Write Operations (0.05 Million Ops).

Does this seem right? I'm trying to figure out if this is maxed out from
something I've been doing or if it's a bug on the Google side. In addition,
some buggy stuff happened right before the error and I want to see if
anyone knows what that's about. Here is what happened right before the
error occurred:

  1. Deleted one ODK Collect form from Aggregate instance, uploaded 3 more,
    deleted another one.
  2. My Aggregate instance page started refreshing itself over and over again
    and wouldn't stop. I closed Chrome.
  3. Opened Chrome again and went to Aggregate, it was still doing the same
    refreshing thing.
  4. Quit Chrome completely. When I launched it again and went to my
    Aggregate instance I got the "AppEngine Application Problem" error. (Copy
    pasted below.)

Has anyone else experienced this problem? It seems strange to me that I
would have reached my Write quota simply from the actions I've taken today.
Advice? Also, it's clear to me that if these (minimal) actions are enough
to take me over the quota I'm going to have to upgrade my account to avoid
running into the same problem again. Any recommendations?

Thanks,
Rachel

AppEngine Application Problem

A problem has occurred that prevents your AppEngine application from
responding. Your application may have exceeded its per-minute or daily
usage quotas.

Please visit your application dashboard at Google AppEngine
https://appengine.google.com/. The Billing Status section will indicate
what daily or per-minute usage limits your application has exceeded.

If your application's usage limits have not been exceeded, then look for
performance issues within Google AppEngine cloud services. From your
application dashboard, click on the the System Status link on the left
sidebar under the Resources heading. This will report problems with
Google AppEngine cloud services.

If neither of those indicate any problems, then your application's Logs
may; these are reachable from the dashboard via the Logs link on the left
sidebar under the Main heading.

Go to the Site Admin / Preferences screen and check the Checkbox for:

Disable faster background actions (exports, publishing, form deletion)
(slows quota usage on Google AppEngine)

You are likely suffering from a problem others are intermittently having.

If you are uploading and destroying forms, or viewing forms, you will
generally hit the Datastore Read Operations limit before you hit the
write limit.

See https://opendatakit.org/use/aggregate/deployment-planning/ which
discusses estimated costs at the bottom.

And, in general, to minimize costs, you should not leave your browser open
to the Submissions tab to "watch results as the trickle in". The website
will refresh whatever tab you are on every 30 seconds to several minutes.
If you are sitting on a page with 100 submissions, this can rapidly consume
your free quota.

Mitch

ยทยทยท On Fri, Oct 31, 2014 at 2:19 PM, Rachel Powers wrote:

Hi all,

I set up an ODK Aggregate instance on AppSpot (free account) a few weeks
ago and have prepping/testing it to deploy an ODK Collect survey next week.
Today I got the "AppEngine Application Problem" error notifying me that my
application has exceeded its per-minute or per-day usage quotas. When I
signed in to my application dashboard, I saw that the operation I am maxed
out on is the Datastore Write Operations (0.05 Million Ops).

Does this seem right? I'm trying to figure out if this is maxed out from
something I've been doing or if it's a bug on the Google side. In addition,
some buggy stuff happened right before the error and I want to see if
anyone knows what that's about. Here is what happened right before the
error occurred:

  1. Deleted one ODK Collect form from Aggregate instance, uploaded 3 more,
    deleted another one.
  2. My Aggregate instance page started refreshing itself over and over
    again and wouldn't stop. I closed Chrome.
  3. Opened Chrome again and went to Aggregate, it was still doing the same
    refreshing thing.
  4. Quit Chrome completely. When I launched it again and went to my
    Aggregate instance I got the "AppEngine Application Problem" error. (Copy
    pasted below.)

Has anyone else experienced this problem? It seems strange to me that I
would have reached my Write quota simply from the actions I've taken today.
Advice? Also, it's clear to me that if these (minimal) actions are enough
to take me over the quota I'm going to have to upgrade my account to avoid
running into the same problem again. Any recommendations?

Thanks,
Rachel

AppEngine Application Problem

A problem has occurred that prevents your AppEngine application from
responding. Your application may have exceeded its per-minute or daily
usage quotas.

Please visit your application dashboard at Google AppEngine
https://appengine.google.com/. The Billing Status section will
indicate what daily or per-minute usage limits your application has
exceeded.

If your application's usage limits have not been exceeded, then look for
performance issues within Google AppEngine cloud services. From your
application dashboard, click on the the System Status link on the left
sidebar under the Resources heading. This will report problems with
Google AppEngine cloud services.

If neither of those indicate any problems, then your application's Logs
may; these are reachable from the dashboard via the Logs link on the
left sidebar under the Main heading.

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to the Google Groups
"ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
Mitch Sundt
Software Engineer
University of Washington
mitchellsundt@gmail.com