AppEngine Application Problem - Have I exceeded its per-minute or daily usage quotas?

Hello,

I'm not able to access my Aggregate due to this issue, but I'm not sure if
I've exceeded the quota.

I'm sending attached a screenshot of my Google App Engine, would be great
if you can help me, I need to get this data as soon as possible.

I can't even access the data using ODK Briefcase:

"Unable to fetch formList: Internal Server Error (500) while accessing:
https://nespampufpr.appspot.com/formList
Please verify that the URL, your user credentials and your permissions are
all correct."

I'm sure that I filling the right URL and credentials.

Thank you!

Regards,
Gustavo

It looks like your operaciones de leitura are maxed out.

You might want to try setting up billing to see if that resolves the issue.
Once billing is set up, then you won't have a limit on read and write
operations. When you go to ODK Aggregate, what does the prompt say?

··· On Tuesday, August 2, 2016 at 12:09:17 PM UTC-6, Gustavo Zanfra Paitch wrote: > > Hello, > > I'm not able to access my Aggregate due to this issue, but I'm not sure if > I've exceeded the quota. > > I'm sending attached a screenshot of my Google App Engine, would be great > if you can help me, I need to get this data as soon as possible. > > I can't even access the data using ODK Briefcase: > > "Unable to fetch formList: Internal Server Error (500) while accessing: > https://nespampufpr.appspot.com/formList > Please verify that the URL, your user credentials and your permissions are > all correct." > > I'm sure that I filling the right URL and credentials. > > Thank you! > > Regards, > Gustavo >

Hello Gustavo, Yes, it seems you have. Your quotas will be reset in 24hrs and you will be able to access the system again. Would also be good to follow advice from Jefferson Francisco to avoid the issue happening again.

Hello,

Thank your for your attention!

I haven't used ODK since I created this post, however the ODK Aggregate
still not working and the same problem still there.

I don't know what I need to do.

If you are willing to help me, I can give you all infos as
username/password.

Thank you!

Regards,
Gustavo

··· Em terça-feira, 2 de agosto de 2016 15:09:17 UTC-3, Gustavo Zanfra Paitch escreveu: > > Hello, > > I'm not able to access my Aggregate due to this issue, but I'm not sure if > I've exceeded the quota. > > I'm sending attached a screenshot of my Google App Engine, would be great > if you can help me, I need to get this data as soon as possible. > > I can't even access the data using ODK Briefcase: > > "Unable to fetch formList: Internal Server Error (500) while accessing: > https://nespampufpr.appspot.com/formList > Please verify that the URL, your user credentials and your permissions are > all correct." > > I'm sure that I filling the right URL and credentials. > > Thank you! > > Regards, > Gustavo >

Gustavo,

I had a similar problem. However, uploading to 1.4.9 resolved my issue.
Here is a link to my conversation with ODK specialist Mitch,

https://groups.google.com/forum/#!searchin/opendatakit/quota|sort:relevance/opendatakit/ReNyi7TJYAY/YrkLUwHABgAJ

However, you are running your Aggregate on 1.4.9. So, the Oauth issue is
probably not the cause.

The best solution to this issue is to set up billing. I am not 100% for
certain, but I believe that you will not have read/write limitations once
you set up billing. Once billing is set up, Google Apps Engine offers a
quite extensive range of quota review options and debugging tools.

Mitch and the ODK team seem to be quite on top of things. So, I doubt that
it is a bug. Setting up billing will not cost you anything, and Google will
offer you a $300 voucher to start you off. I just set my billing up and it
has been working great so far. I was only charged $0.15 for a day that I
was uploading and downloading lots of forms to Aggregate.

I highly recommend reading this thoroughly. It helped me a lot.
https://opendatakit.org/use/aggregate/deployment-planning/

··· On Tuesday, August 2, 2016 at 12:09:17 PM UTC-6, Gustavo Zanfra Paitch wrote: > > Hello, > > I'm not able to access my Aggregate due to this issue, but I'm not sure if > I've exceeded the quota. > > I'm sending attached a screenshot of my Google App Engine, would be great > if you can help me, I need to get this data as soon as possible. > > I can't even access the data using ODK Briefcase: > > "Unable to fetch formList: Internal Server Error (500) while accessing: > https://nespampufpr.appspot.com/formList > Please verify that the URL, your user credentials and your permissions are > all correct." > > I'm sure that I filling the right URL and credentials. > > Thank you! > > Regards, > Gustavo >

Note that the last link on the error page provides information on how to
identify the cause of the problem.

The free quota counters reset at midnight Los Angeles, CA USA time.
For some issues, you may need to debug them right after midnight when the
quota resets.
The Google Cloud Platform console operates with the same quota limits as
the site, so once your quota is exhausted, you cannot use the console to
investigate the cause (beyond looking at the logging).

··· On Thu, Aug 11, 2016 at 9:47 AM, Gustavo Zanfra Paitch wrote:

Hello,

Thank your for your attention!

I haven't used ODK since I created this post, however the ODK Aggregate
still not working and the same problem still there.

I don't know what I need to do.

If you are willing to help me, I can give you all infos as
username/password.

Thank you!

Regards,
Gustavo

Em terça-feira, 2 de agosto de 2016 15:09:17 UTC-3, Gustavo Zanfra Paitch escreveu:

Hello,

I'm not able to access my Aggregate due to this issue, but I'm not sure
if I've exceeded the quota.

I'm sending attached a screenshot of my Google App Engine, would be great
if you can help me, I need to get this data as soon as possible.

I can't even access the data using ODK Briefcase:

"Unable to fetch formList: Internal Server Error (500) while accessing:
https://nespampufpr.appspot.com/formList
Please verify that the URL, your user credentials and your permissions
are all correct."

I'm sure that I filling the right URL and credentials.

Thank you!

Regards,
Gustavo

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to the Google Groups
"ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
Mitch Sundt
Software Engineer
University of Washington
mitchellsundt@gmail.com

Thanks Jefferson,

I've followed your instructions and I did set up billing, but the problem
continues. I don't know if it needs time to take effect, let see.

I'm attaching a screen of the errors. Hopefully this will give you more
information.

Thanks again!

Regards,
Gus

Gustavo,

··· > > I had a similar problem. However, uploading to 1.4.9 resolved my issue. > Here is a link to my conversation with ODK specialist Mitch, > > > https://groups.google.com/forum/#!searchin/opendatakit/quota%7Csort:relevance/opendatakit/ReNyi7TJYAY/YrkLUwHABgAJ > > However, you are running your Aggregate on 1.4.9. So, the Oauth issue is > probably not the cause. > > The best solution to this issue is to set up billing. I am not 100% for > certain, but I believe that you will not have read/write limitations once > you set up billing. Once billing is set up, Google Apps Engine offers a > quite extensive range of quota review options and debugging tools. > > Mitch and the ODK team seem to be quite on top of things. So, I doubt that > it is a bug. Setting up billing will not cost you anything, and Google will > offer you a $300 voucher to start you off. I just set my billing up and it > has been working great so far. I was only charged $0.15 for a day that I > was uploading and downloading lots of forms to Aggregate. > > I highly recommend reading this thoroughly. It helped me a lot. > https://opendatakit.org/use/aggregate/deployment-planning/ > > On Tuesday, August 2, 2016 at 12:09:17 PM UTC-6, Gustavo Zanfra Paitch wrote: >> >> Hello, >> >> I'm not able to access my Aggregate due to this issue, but I'm not sure >> if I've exceeded the quota. >> >> I'm sending attached a screenshot of my Google App Engine, would be great >> if you can help me, I need to get this data as soon as possible. >> >> I can't even access the data using ODK Briefcase: >> >> "Unable to fetch formList: Internal Server Error (500) while accessing: >> https://nespampufpr.appspot.com/formList >> Please verify that the URL, your user credentials and your permissions >> are all correct." >> >> I'm sure that I filling the right URL and credentials. >> >> Thank you! >> >> Regards, >> Gustavo >> >

We are experiencing a similar problem right now. Unlikely that we exceeded our quota, we have an account with GC. Logs show:

105.186.98.167 - - [12/Aug/2016:11:56:26 +0200] "POST /aggregateui/servicesadminservice HTTP/1.1" 500 - - "Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/52.0.2743.116 Safari/537.36" "vpuumapping2.appspot.com" ms=42226 cpu_ms=0 cpm_usd=0 loading_request=0 instance=00c61b117cf22136f5f71be125309776c6ce8da2693f3d6382bd0a3a4c25 app_engine_release=1.9.42 trace_id=-
{
metadata: {…}
protoPayload: {…}
insertId: "2016-08-12|02:57:13.227532-07|10.94.33.10|-1476095845"
log: "appengine.googleapis.com/request_log"
httpRequest: {…}
operation: {…}
}A problem was encountered with the process that handled this request, causing it to exit. This is likely to cause a new process to be used for the next request to your application. If you see this message frequently, you may be throwing exceptions during the initialization of your application. (Error code 104)

··· On Thursday, August 11, 2016 at 7:18:17 PM UTC+2, Mitch Sundt wrote: > Note that the last link on the error page provides information on how to identify the cause of the problem. > > > The free quota counters reset at midnight Los Angeles, CA USA time. > For some issues, you may need to debug them right after midnight when the quota resets. > The Google Cloud Platform console operates with the same quota limits as the site, so once your quota is exhausted, you cannot use the console to investigate the cause (beyond looking at the logging). > > > > > > On Thu, Aug 11, 2016 at 9:47 AM, Gustavo Zanfra Paitch wrote: > > Hello, > > Thank your for your attention! > > I haven't used ODK since I created this post, however the ODK Aggregate still not working and the same problem still there. > > I don't know what I need to do. > > If you are willing to help me, I can give you all infos as username/password. > > Thank you! > > Regards, > Gustavo > > > > Em terça-feira, 2 de agosto de 2016 15:09:17 UTC-3, Gustavo Zanfra Paitch escreveu: > > Hello, > > > I'm not able to access my Aggregate due to this issue, but I'm not sure if I've exceeded the quota. > > > > I'm sending attached a screenshot of my Google App Engine, would be great if you can help me, I need to get this data as soon as possible. > > > I can't even access the data using ODK Briefcase: > > "Unable to fetch formList: Internal Server Error (500) while accessing: https://nespampufpr.appspot.com/formList > Please verify that the URL, your user credentials and your permissions are all correct." > > > I'm sure that I filling the right URL and credentials. > > > Thank you! > > > Regards, > Gustavo > > > > > > > -- > > -- > > Post: opend...@googlegroups.com > > Unsubscribe: opendatakit...@googlegroups.com > > Options: http://groups.google.com/group/opendatakit?hl=en > > > > --- > > You received this message because you are subscribed to the Google Groups "ODK Community" group. > > To unsubscribe from this group and stop receiving emails from it, send an email to opendatakit...@googlegroups.com. > > For more options, visit https://groups.google.com/d/optout. > > > > > > -- > > Mitch Sundt > Software Engineer > University of Washington > mitche...@gmail.com

Here is how to check your version. I would check to make 100% sure you are
running at least 1.4.9 and preferably at least 1.4.11 also, here is the
documentation for form troubleshooting

see below for checking your version:
Determining your ODK Aggregate Version

If are able to log onto the server as a Site Administrator, the ODK
Aggregate version is displayed at the top of the Site Admin / Preferences
sub-tab. If no version information is displayed on that page, then you are
running an extremely old version of ODK Aggregate; in that case, scroll
down to the very bottom of this wiki to see additional instructions for
identifying your ODK Aggregate version.

If you are unable to log onto your server, you will need to search for the
version in the application logs. To do that,

  1. open a browser to https://appengine.google.com
  2. choose the application id for your ODK Aggregate server
  3. click on the "Logs" link in the left sidebar
  4. pop open "Options"
  5. type afterPropertiesSet in the Filter text field
  6. hit "Search"
  7. now, find the occurrences of afterPropertiesSet on your webpage.

The first one will generally report the version. E.g.,

2015-09-22 08:19:12.855 org.opendatakit.common.security.Realm
afterPropertiesSet: Version: v1.4.5 Production

Jefferson Francisco
K & F Consulting
www.dataconsulta.com http://www.dataconsulta.com
San Salvador, El Salvador
(503) 2563-0512
cel. (503) 7908-2710
U.S. cel. (304) 741-9169
Skype: jeffersont.francisco

··· On Wed, Aug 17, 2016 at 8:20 PM, Gustavo Zanfra Paitch wrote:

Thanks Jefferson,

I've followed your instructions and I did set up billing, but the problem
continues. I don't know if it needs time to take effect, let see.

I'm attaching a screen of the errors. Hopefully this will give you more
information.

Thanks again!

Regards,
Gus

Gustavo,

I had a similar problem. However, uploading to 1.4.9 resolved my issue.
Here is a link to my conversation with ODK specialist Mitch,

https://groups.google.com/forum/#!searchin/opendatakit/quota
%7Csort:relevance/opendatakit/ReNyi7TJYAY/YrkLUwHABgAJ

However, you are running your Aggregate on 1.4.9. So, the Oauth issue is
probably not the cause.

The best solution to this issue is to set up billing. I am not 100% for
certain, but I believe that you will not have read/write limitations once
you set up billing. Once billing is set up, Google Apps Engine offers a
quite extensive range of quota review options and debugging tools.

Mitch and the ODK team seem to be quite on top of things. So, I doubt
that it is a bug. Setting up billing will not cost you anything, and Google
will offer you a $300 voucher to start you off. I just set my billing up
and it has been working great so far. I was only charged $0.15 for a day
that I was uploading and downloading lots of forms to Aggregate.

I highly recommend reading this thoroughly. It helped me a lot.
https://opendatakit.org/use/aggregate/deployment-planning/

On Tuesday, August 2, 2016 at 12:09:17 PM UTC-6, Gustavo Zanfra Paitch wrote:

Hello,

I'm not able to access my Aggregate due to this issue, but I'm not sure
if I've exceeded the quota.

I'm sending attached a screenshot of my Google App Engine, would be
great if you can help me, I need to get this data as soon as possible.

I can't even access the data using ODK Briefcase:

"Unable to fetch formList: Internal Server Error (500) while accessing:
https://nespampufpr.appspot.com/formList
Please verify that the URL, your user credentials and your permissions
are all correct."

I'm sure that I filling the right URL and credentials.

Thank you!

Regards,
Gustavo

--
--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to a topic in the
Google Groups "ODK Community" group.
To unsubscribe from this topic, visit https://groups.google.com/d/
topic/opendatakit/OD7pC-WN3ic/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

hey guys, i think had a similar issue with the previous version of ODK
Aggregate that was causing my instance hours to exceed my quota. Since I
was testing I didn't set up billing. The fix was to install the latest
version of Aggregate that had a fix for the bug. Then, when i went into
production, I went ahead and set up billing. Once billing is set up, then
you can really evaluate your cost. I think that Google gives you a $300
credit for the first three months. I would recommend 1) making sure you
have the latest version of Aggregate installed, and 2) Setting up billing
to prevent data loss.

··· On Friday, August 12, 2016 at 4:11:39 AM UTC-6, chris....@sundevelopment.co.za wrote: > > We are experiencing a similar problem right now. Unlikely that we exceeded > our quota, we have an account with GC. Logs show: > > 105.186.98.167 - - [12/Aug/2016:11:56:26 +0200] "POST > /aggregateui/servicesadminservice HTTP/1.1" 500 - - "Mozilla/5.0 (Windows > NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/52.0.2743.116 > Safari/537.36" "vpuumapping2.appspot.com" ms=42226 cpu_ms=0 cpm_usd=0 > loading_request=0 > instance=00c61b117cf22136f5f71be125309776c6ce8da2693f3d6382bd0a3a4c25 > app_engine_release=1.9.42 trace_id=- > { > metadata: {…} > protoPayload: {…} > insertId: "2016-08-12|02:57:13.227532-07|10.94.33.10|-1476095845" > log: "appengine.googleapis.com/request_log" > httpRequest: {…} > operation: {…} > }A problem was encountered with the process that handled this request, > causing it to exit. This is likely to cause a new process to be used for > the next request to your application. If you see this message frequently, > you may be throwing exceptions during the initialization of your > application. (Error code 104) > > > On Thursday, August 11, 2016 at 7:18:17 PM UTC+2, Mitch Sundt wrote: > > Note that the last link on the error page provides information on how to > identify the cause of the problem. > > > > > > The free quota counters reset at midnight Los Angeles, CA USA time. > > For some issues, you may need to debug them right after midnight when > the quota resets. > > The Google Cloud Platform console operates with the same quota limits as > the site, so once your quota is exhausted, you cannot use the console to > investigate the cause (beyond looking at the logging). > > > > > > > > > > > > On Thu, Aug 11, 2016 at 9:47 AM, Gustavo Zanfra Paitch wrote: > > > > Hello, > > > > Thank your for your attention! > > > > I haven't used ODK since I created this post, however the ODK Aggregate > still not working and the same problem still there. > > > > I don't know what I need to do. > > > > If you are willing to help me, I can give you all infos as > username/password. > > > > Thank you! > > > > Regards, > > Gustavo > > > > > > > > Em terça-feira, 2 de agosto de 2016 15:09:17 UTC-3, Gustavo Zanfra Paitch escreveu: > > > > Hello, > > > > > > I'm not able to access my Aggregate due to this issue, but I'm not sure > if I've exceeded the quota. > > > > > > > > I'm sending attached a screenshot of my Google App Engine, would be > great if you can help me, I need to get this data as soon as possible. > > > > > > I can't even access the data using ODK Briefcase: > > > > "Unable to fetch formList: Internal Server Error (500) while accessing: > https://nespampufpr.appspot.com/formList > > Please verify that the URL, your user credentials and your permissions > are all correct." > > > > > > I'm sure that I filling the right URL and credentials. > > > > > > Thank you! > > > > > > Regards, > > Gustavo > > > > > > > > > > > > > > -- > > > > -- > > > > Post: opend...@googlegroups.com > > > > Unsubscribe: opendatakit...@googlegroups.com > > > > Options: http://groups.google.com/group/opendatakit?hl=en > > > > > > > > --- > > > > You received this message because you are subscribed to the Google > Groups "ODK Community" group. > > > > To unsubscribe from this group and stop receiving emails from it, send > an email to opendatakit...@googlegroups.com. > > > > For more options, visit https://groups.google.com/d/optout. > > > > > > > > > > > > -- > > > > Mitch Sundt > > Software Engineer > > University of Washington > > mitche...@gmail.com > >

Hi Chris,

You'll need to provide more information before anyone can help.

What version of Aggregate are you running?
When did the problem start?
What, if anything has changed since the problem started?
Can you reliably reproduce the problem?
Are you absolutely sure you haven't run out of quota?
Are there more and different errors that you can share (maybe use dpaste.com).

Yaw

··· -- Need ODK consultants? Nafundi provides form design, server setup, in-field training, and software development for ODK. Go to https://nafundi.com to get started.

On Fri, Aug 12, 2016 at 10:11 AM, chris.berens@sundevelopment.co.za wrote:

We are experiencing a similar problem right now. Unlikely that we exceeded our quota, we have an account with GC. Logs show:

105.186.98.167 - - [12/Aug/2016:11:56:26 +0200] "POST /aggregateui/servicesadminservice HTTP/1.1" 500 - - "Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/52.0.2743.116 Safari/537.36" "vpuumapping2.appspot.com" ms=42226 cpu_ms=0 cpm_usd=0 loading_request=0 instance=00c61b117cf22136f5f71be125309776c6ce8da2693f3d6382bd0a3a4c25 app_engine_release=1.9.42 trace_id=-
{
metadata: {…}
protoPayload: {…}
insertId: "2016-08-12|02:57:13.227532-07|10.94.33.10|-1476095845"
log: "appengine.googleapis.com/request_log"
httpRequest: {…}
operation: {…}
}A problem was encountered with the process that handled this request, causing it to exit. This is likely to cause a new process to be used for the next request to your application. If you see this message frequently, you may be throwing exceptions during the initialization of your application. (Error code 104)

On Thursday, August 11, 2016 at 7:18:17 PM UTC+2, Mitch Sundt wrote:

Note that the last link on the error page provides information on how to identify the cause of the problem.

The free quota counters reset at midnight Los Angeles, CA USA time.
For some issues, you may need to debug them right after midnight when the quota resets.
The Google Cloud Platform console operates with the same quota limits as the site, so once your quota is exhausted, you cannot use the console to investigate the cause (beyond looking at the logging).

On Thu, Aug 11, 2016 at 9:47 AM, Gustavo Zanfra Paitch gpa...@gmail.com wrote:

Hello,

Thank your for your attention!

I haven't used ODK since I created this post, however the ODK Aggregate still not working and the same problem still there.

I don't know what I need to do.

If you are willing to help me, I can give you all infos as username/password.

Thank you!

Regards,
Gustavo

Em terça-feira, 2 de agosto de 2016 15:09:17 UTC-3, Gustavo Zanfra Paitch escreveu:

Hello,

I'm not able to access my Aggregate due to this issue, but I'm not sure if I've exceeded the quota.

I'm sending attached a screenshot of my Google App Engine, would be great if you can help me, I need to get this data as soon as possible.

I can't even access the data using ODK Briefcase:

"Unable to fetch formList: Internal Server Error (500) while accessing: https://nespampufpr.appspot.com/formList
Please verify that the URL, your user credentials and your permissions are all correct."

I'm sure that I filling the right URL and credentials.

Thank you!

Regards,
Gustavo

--

--

Post: opend...@googlegroups.com

Unsubscribe: opendatakit...@googlegroups.com

Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to the Google Groups "ODK Community" group.

To unsubscribe from this group and stop receiving emails from it, send an email to opendatakit...@googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--

Mitch Sundt
Software Engineer
University of Washington
mitche...@gmail.com

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to the Google Groups "ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Gustavo,

If you are still having problems, please add 'yanokwa@nafundi.com' as
an owner on your App Engine instance and I'm glad to take a quick look
to see what the problem is.

Yaw

··· -- Need ODK consultants? Nafundi provides form design, server setup, in-field training, and software development for ODK. Go to https://nafundi.com to get started.

On Thu, Aug 18, 2016 at 3:33 AM, Jefferson Francisco jeffersont.francisco@gmail.com wrote:

Here is how to check your version. I would check to make 100% sure you are
running at least 1.4.9 and preferably at least 1.4.11 also, here is the
documentation for form troubleshooting

https://github.com/opendatakit/opendatakit/wiki/Aggregate-AppEngine-Troubleshooting

see below for checking your version:

Determining your ODK Aggregate Version

If are able to log onto the server as a Site Administrator, the ODK
Aggregate version is displayed at the top of the Site Admin / Preferences
sub-tab. If no version information is displayed on that page, then you are
running an extremely old version of ODK Aggregate; in that case, scroll down
to the very bottom of this wiki to see additional instructions for
identifying your ODK Aggregate version.

If you are unable to log onto your server, you will need to search for the
version in the application logs. To do that,

open a browser to https://appengine.google.com
choose the application id for your ODK Aggregate server
click on the "Logs" link in the left sidebar
pop open "Options"
type afterPropertiesSet in the Filter text field
hit "Search"
now, find the occurrences of afterPropertiesSet on your webpage.

The first one will generally report the version. E.g.,

2015-09-22 08:19:12.855 org.opendatakit.common.security.Realm
afterPropertiesSet: Version: v1.4.5 Production

Jefferson Francisco
K & F Consulting
www.dataconsulta.com
San Salvador, El Salvador
(503) 2563-0512
cel. (503) 7908-2710
U.S. cel. (304) 741-9169
Skype: jeffersont.francisco

On Wed, Aug 17, 2016 at 8:20 PM, Gustavo Zanfra Paitch gpaitch@gmail.com wrote:

Thanks Jefferson,

I've followed your instructions and I did set up billing, but the problem
continues. I don't know if it needs time to take effect, let see.

I'm attaching a screen of the errors. Hopefully this will give you more
information.

Thanks again!

Regards,
Gus

Gustavo,

I had a similar problem. However, uploading to 1.4.9 resolved my issue.
Here is a link to my conversation with ODK specialist Mitch,

https://groups.google.com/forum/#!searchin/opendatakit/quota|sort:relevance/opendatakit/ReNyi7TJYAY/YrkLUwHABgAJ

However, you are running your Aggregate on 1.4.9. So, the Oauth issue is
probably not the cause.

The best solution to this issue is to set up billing. I am not 100% for
certain, but I believe that you will not have read/write limitations once
you set up billing. Once billing is set up, Google Apps Engine offers a
quite extensive range of quota review options and debugging tools.

Mitch and the ODK team seem to be quite on top of things. So, I doubt
that it is a bug. Setting up billing will not cost you anything, and Google
will offer you a $300 voucher to start you off. I just set my billing up and
it has been working great so far. I was only charged $0.15 for a day that I
was uploading and downloading lots of forms to Aggregate.

I highly recommend reading this thoroughly. It helped me a lot.
https://opendatakit.org/use/aggregate/deployment-planning/

On Tuesday, August 2, 2016 at 12:09:17 PM UTC-6, Gustavo Zanfra Paitch wrote:

Hello,

I'm not able to access my Aggregate due to this issue, but I'm not sure
if I've exceeded the quota.

I'm sending attached a screenshot of my Google App Engine, would be
great if you can help me, I need to get this data as soon as possible.

I can't even access the data using ODK Briefcase:

"Unable to fetch formList: Internal Server Error (500) while accessing:
https://nespampufpr.appspot.com/formList
Please verify that the URL, your user credentials and your permissions
are all correct."

I'm sure that I filling the right URL and credentials.

Thank you!

Regards,
Gustavo

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to a topic in the
Google Groups "ODK Community" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/opendatakit/OD7pC-WN3ic/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to the Google Groups
"ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

And 1.4.3 is EXTREMELY old.

See https://github.com/opendatakit/opendatakit/wiki/Aggregate-Release-Notes

For how to upgrade.

It is important to upgrade to newer ODK Aggregate versions as they come
out
(not necessarily immediately, but this should be something you do at
least once a year
).

There are several reasons for this:

  1. Security vulnerabilities -- we (and Google) are constantly upgrading
    the libraries we use with newer, safer, versions. The older your software,
    the greater the number of vulnerabilities in it.
  2. Google AppEngine is a managed environment, unlike, say, AWS or other
    "bare-box" hosting services. Google is continuously updating features and
    removing support for older features in this environment. If you don't
    upgrade, there may not be an upgrade path that works due to these changes
    -- unlike "bare-box" hosting, you, and the ODK team, only have partial
    control over the software and hardware environment.
  3. Performance revisions -- as we find performance issues and address
    them, the tools get better and faster.
  4. Enhanced capabilities -- the form-processing library (javarosa) has
    roughly-annual updates to add new functions (e.g., sin(), cos()) and
    occasionally data types. And new features are slowly added to ODK
    Aggregate, too.
··· On Fri, Aug 12, 2016 at 7:55 AM, Jefferson Francisco < jeffersont.francisco@gmail.com> wrote:

hey guys, i think had a similar issue with the previous version of ODK
Aggregate that was causing my instance hours to exceed my quota. Since I
was testing I didn't set up billing. The fix was to install the latest
version of Aggregate that had a fix for the bug. Then, when i went into
production, I went ahead and set up billing. Once billing is set up, then
you can really evaluate your cost. I think that Google gives you a $300
credit for the first three months. I would recommend 1) making sure you
have the latest version of Aggregate installed, and 2) Setting up billing
to prevent data loss.

On Friday, August 12, 2016 at 4:11:39 AM UTC-6, chris....@sundevelopment.co.za wrote:

We are experiencing a similar problem right now. Unlikely that we
exceeded our quota, we have an account with GC. Logs show:

105.186.98.167 - - [12/Aug/2016:11:56:26 +0200] "POST
/aggregateui/servicesadminservice HTTP/1.1" 500 - - "Mozilla/5.0
(Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko)
Chrome/52.0.2743.116 Safari/537.36" "vpuumapping2.appspot.com" ms=42226
cpu_ms=0 cpm_usd=0 loading_request=0 instance=00c61b117cf22136f5f71
be125309776c6ce8da2693f3d6382bd0a3a4c25 app_engine_release=1.9.42
trace_id=-
{
metadata: {…}
protoPayload: {…}
insertId: "2016-08-12|02:57:13.227532-07|10.94.33.10|-1476095845"
log: "appengine.googleapis.com/request_log"
httpRequest: {…}
operation: {…}
}A problem was encountered with the process that handled this request,
causing it to exit. This is likely to cause a new process to be used for
the next request to your application. If you see this message frequently,
you may be throwing exceptions during the initialization of your
application. (Error code 104)

On Thursday, August 11, 2016 at 7:18:17 PM UTC+2, Mitch Sundt wrote:

Note that the last link on the error page provides information on how
to identify the cause of the problem.

The free quota counters reset at midnight Los Angeles, CA USA time.
For some issues, you may need to debug them right after midnight when
the quota resets.
The Google Cloud Platform console operates with the same quota limits
as the site, so once your quota is exhausted, you cannot use the console to
investigate the cause (beyond looking at the logging).

On Thu, Aug 11, 2016 at 9:47 AM, Gustavo Zanfra Paitch < gpa...@gmail.com> wrote:

Hello,

Thank your for your attention!

I haven't used ODK since I created this post, however the ODK Aggregate
still not working and the same problem still there.

I don't know what I need to do.

If you are willing to help me, I can give you all infos as
username/password.

Thank you!

Regards,
Gustavo

Em terça-feira, 2 de agosto de 2016 15:09:17 UTC-3, Gustavo Zanfra Paitch escreveu:

Hello,

I'm not able to access my Aggregate due to this issue, but I'm not sure
if I've exceeded the quota.

I'm sending attached a screenshot of my Google App Engine, would be
great if you can help me, I need to get this data as soon as possible.

I can't even access the data using ODK Briefcase:

"Unable to fetch formList: Internal Server Error (500) while accessing:
https://nespampufpr.appspot.com/formList
Please verify that the URL, your user credentials and your permissions
are all correct."

I'm sure that I filling the right URL and credentials.

Thank you!

Regards,
Gustavo

--

--

Post: opend...@googlegroups.com

Unsubscribe: opendatakit...@googlegroups.com

Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to the Google
Groups "ODK Community" group.

To unsubscribe from this group and stop receiving emails from it, send
an email to opendatakit...@googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--

Mitch Sundt
Software Engineer
University of Washington
mitche...@gmail.com

--
--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to the Google Groups
"ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
Mitch Sundt
Software Engineer
University of Washington
mitchellsundt@gmail.com

Agreed that backing up your data with Briefcase and doing an upgrade
(https://github.com/opendatakit/opendatakit/wiki/Aggregate-Release-Notes)
would be a good idea.

Are the errors occuring when you try to do a particular activity (e.g., export).

Yaw

··· -- Need ODK consultants? Nafundi provides form design, server setup, in-field training, and software development for ODK. Go to https://nafundi.com to get started.

On Fri, Aug 12, 2016 at 2:55 PM, Jefferson Francisco jeffersont.francisco@gmail.com wrote:

hey guys, i think had a similar issue with the previous version of ODK
Aggregate that was causing my instance hours to exceed my quota. Since I was
testing I didn't set up billing. The fix was to install the latest version
of Aggregate that had a fix for the bug. Then, when i went into production,
I went ahead and set up billing. Once billing is set up, then you can really
evaluate your cost. I think that Google gives you a $300 credit for the
first three months. I would recommend 1) making sure you have the latest
version of Aggregate installed, and 2) Setting up billing to prevent data
loss.

On Friday, August 12, 2016 at 4:11:39 AM UTC-6, chris....@sundevelopment.co.za wrote:

We are experiencing a similar problem right now. Unlikely that we exceeded
our quota, we have an account with GC. Logs show:

105.186.98.167 - - [12/Aug/2016:11:56:26 +0200] "POST
/aggregateui/servicesadminservice HTTP/1.1" 500 - - "Mozilla/5.0 (Windows NT
10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/52.0.2743.116
Safari/537.36" "vpuumapping2.appspot.com" ms=42226 cpu_ms=0 cpm_usd=0
loading_request=0
instance=00c61b117cf22136f5f71be125309776c6ce8da2693f3d6382bd0a3a4c25
app_engine_release=1.9.42 trace_id=-
{
metadata: {…}
protoPayload: {…}
insertId: "2016-08-12|02:57:13.227532-07|10.94.33.10|-1476095845"
log: "appengine.googleapis.com/request_log"
httpRequest: {…}
operation: {…}
}A problem was encountered with the process that handled this request,
causing it to exit. This is likely to cause a new process to be used for the
next request to your application. If you see this message frequently, you
may be throwing exceptions during the initialization of your application.
(Error code 104)

On Thursday, August 11, 2016 at 7:18:17 PM UTC+2, Mitch Sundt wrote:

Note that the last link on the error page provides information on how to
identify the cause of the problem.

The free quota counters reset at midnight Los Angeles, CA USA time.
For some issues, you may need to debug them right after midnight when
the quota resets.
The Google Cloud Platform console operates with the same quota limits as
the site, so once your quota is exhausted, you cannot use the console to
investigate the cause (beyond looking at the logging).

On Thu, Aug 11, 2016 at 9:47 AM, Gustavo Zanfra Paitch gpa...@gmail.com wrote:

Hello,

Thank your for your attention!

I haven't used ODK since I created this post, however the ODK Aggregate
still not working and the same problem still there.

I don't know what I need to do.

If you are willing to help me, I can give you all infos as
username/password.

Thank you!

Regards,
Gustavo

Em terça-feira, 2 de agosto de 2016 15:09:17 UTC-3, Gustavo Zanfra Paitch escreveu:

Hello,

I'm not able to access my Aggregate due to this issue, but I'm not sure
if I've exceeded the quota.

I'm sending attached a screenshot of my Google App Engine, would be
great if you can help me, I need to get this data as soon as possible.

I can't even access the data using ODK Briefcase:

"Unable to fetch formList: Internal Server Error (500) while accessing:
https://nespampufpr.appspot.com/formList
Please verify that the URL, your user credentials and your permissions
are all correct."

I'm sure that I filling the right URL and credentials.

Thank you!

Regards,
Gustavo

--

--

Post: opend...@googlegroups.com

Unsubscribe: opendatakit...@googlegroups.com

Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to the Google
Groups "ODK Community" group.

To unsubscribe from this group and stop receiving emails from it, send
an email to opendatakit...@googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--

Mitch Sundt
Software Engineer
University of Washington
mitche...@gmail.com

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to the Google Groups
"ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Thanks Yaw,

Aggregate version is 1.4.3 Production

Aggregate errror message:* Problem persisting or accessing data (Somehow DB
entities got into problem state).*

It seems as if the first error reported is:

8/11/16, 1:13 PM ApiProxy$CancelledException: The API call
images.Transform() was cancelled because the overall HTTP request deadline
was reached.

8/11/16, 7:17 PMSystemFailureException: Unable to get a resource

8/11/16, 7:18 PMUnexpectedException: Service method 'public abstract
java.util.ArrayList
org.opendatakit.aggregate.client.form.FormService.getExports() throws
org.opendatakit.common.security.client.exception.AccessDeniedException,org.opendatakit.aggregate.client.exception.FormNotAvailableException,org.opendatakit.aggregate.client.exception.RequestFailureException,org.opendatakit.common.persistence.client.exception.DatastoreFailureException'
threw an unexpected exception:
com.google.apphosting.api.DeadlineExceededException: This request
(3e6c53311ace551a) started at 2016/08/11 17:17:51.855 UTC and was still
executing at 2016/08/11 17:18:52.550 UTC.

Followed by a host of hard deadline exceeded notifications.

In Google Cloud Platform's dashboard under My Project > Quotas there is
nothing to suggest that we might have exceeded a Daily quota. All %
readings are at 0. Our billable data limit is USD10 but we are currently
at 10 cents. Payment history reflects positive.

I will admit that I am challenged by GCP's extensive array of dashboards
and 'words for things'. Quite possibly a problem of our own making except
that besides Aggregate interfacing and data uploads/downloads.

All clues welcome here.

Regards,
Chris

PS worth noting that ODK error messages and KB have not kept up with
changes to the GCP architecture. Neither have I.

Chris Berens
*VPUU Knowledge Management - GISc *PLATO PGP 1308
VIOLENCE PREVENTION THROUGH URBAN UPGRADING
Office - 021 447 3881 Cell - 082 567 9322
223 Lower Main Road, Observatory, Cape Town, 7925
NPC Reg # 2013/060455/08 www.vpuu.org.za

··· On Fri, Aug 12, 2016 at 3:20 PM, Yaw Anokwa wrote:

Hi Chris,

You'll need to provide more information before anyone can help.

What version of Aggregate are you running?
When did the problem start?
What, if anything has changed since the problem started?
Can you reliably reproduce the problem?
Are you absolutely sure you haven't run out of quota?
Are there more and different errors that you can share (maybe use
dpaste.com).

Yaw

Need ODK consultants? Nafundi provides form design, server setup,
in-field training, and software development for ODK. Go to
https://nafundi.com to get started.

On Fri, Aug 12, 2016 at 10:11 AM, chris.berens@sundevelopment.co.za wrote:

We are experiencing a similar problem right now. Unlikely that we
exceeded our quota, we have an account with GC. Logs show:

105.186.98.167 - - [12/Aug/2016:11:56:26 +0200] "POST /aggregateui/servicesadminservice
HTTP/1.1" 500 - - "Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36
(KHTML, like Gecko) Chrome/52.0.2743.116 Safari/537.36" "
vpuumapping2.appspot.com" ms=42226 cpu_ms=0 cpm_usd=0 loading_request=0
instance=00c61b117cf22136f5f71be125309776c6ce8da2693f3d6382bd0a3a4c25
app_engine_release=1.9.42 trace_id=-
{
metadata: {…}
protoPayload: {…}
insertId: "2016-08-12|02:57:13.227532-07|10.94.33.10|-1476095845"
log: "appengine.googleapis.com/request_log"
httpRequest: {…}
operation: {…}
}A problem was encountered with the process that handled this request,
causing it to exit. This is likely to cause a new process to be used for
the next request to your application. If you see this message frequently,
you may be throwing exceptions during the initialization of your
application. (Error code 104)

On Thursday, August 11, 2016 at 7:18:17 PM UTC+2, Mitch Sundt wrote:

Note that the last link on the error page provides information on how
to identify the cause of the problem.

The free quota counters reset at midnight Los Angeles, CA USA time.
For some issues, you may need to debug them right after midnight when
the quota resets.
The Google Cloud Platform console operates with the same quota limits
as the site, so once your quota is exhausted, you cannot use the console to
investigate the cause (beyond looking at the logging).

On Thu, Aug 11, 2016 at 9:47 AM, Gustavo Zanfra Paitch < gpa...@gmail.com> wrote:

Hello,

Thank your for your attention!

I haven't used ODK since I created this post, however the ODK Aggregate
still not working and the same problem still there.

I don't know what I need to do.

If you are willing to help me, I can give you all infos as
username/password.

Thank you!

Regards,
Gustavo

Em terça-feira, 2 de agosto de 2016 15:09:17 UTC-3, Gustavo Zanfra Paitch escreveu:

Hello,

I'm not able to access my Aggregate due to this issue, but I'm not sure
if I've exceeded the quota.

I'm sending attached a screenshot of my Google App Engine, would be
great if you can help me, I need to get this data as soon as possible.

I can't even access the data using ODK Briefcase:

"Unable to fetch formList: Internal Server Error (500) while accessing:
https://nespampufpr.appspot.com/formList
Please verify that the URL, your user credentials and your permissions
are all correct."

I'm sure that I filling the right URL and credentials.

Thank you!

Regards,
Gustavo

--

--

Post: opend...@googlegroups.com

Unsubscribe: opendatakit...@googlegroups.com

Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to the Google
Groups "ODK Community" group.

To unsubscribe from this group and stop receiving emails from it, send
an email to opendatakit...@googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--

Mitch Sundt
Software Engineer
University of Washington
mitche...@gmail.com

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to the Google
Groups "ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to a topic in the
Google Groups "ODK Community" group.
To unsubscribe from this topic, visit https://groups.google.com/d/
topic/opendatakit/OD7pC-WN3ic/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Hello Yaw, Mitch and Chris,

I haven't posted for a while, however the problem still since the day that
I posted here (02/08/16).

I think it's not a quota problem because I haven't sent forms since the
last days of July.

Unfortunately I have very shallow knowledge, but I am able to give any
information that you may need.

What version of Aggregate are you running?
1.4.9
*When did the problem start? *
02/08/16 (maybe early, but I just noticed this day)

Thank you very much!

Regards,
Gustavo

··· Em sexta-feira, 12 de agosto de 2016 10:21:40 UTC-3, Yaw Anokwa escreveu: > > Hi Chris, > > You'll need to provide more information before anyone can help. > > What version of Aggregate are you running? > When did the problem start? > What, if anything has changed since the problem started? > Can you reliably reproduce the problem? > Are you absolutely sure you haven't run out of quota? > Are there more and different errors that you can share (maybe use > dpaste.com). > > Yaw > -- > Need ODK consultants? Nafundi provides form design, server setup, > in-field training, and software development for ODK. Go to > https://nafundi.com to get started. > > On Fri, Aug 12, 2016 at 10:11 AM, <chris....@sundevelopment.co.za > wrote: > > We are experiencing a similar problem right now. Unlikely that we > exceeded our quota, we have an account with GC. Logs show: > > > > 105.186.98.167 - - [12/Aug/2016:11:56:26 +0200] "POST > /aggregateui/servicesadminservice HTTP/1.1" 500 - - "Mozilla/5.0 (Windows > NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/52.0.2743.116 > Safari/537.36" "vpuumapping2.appspot.com" ms=42226 cpu_ms=0 cpm_usd=0 > loading_request=0 > instance=00c61b117cf22136f5f71be125309776c6ce8da2693f3d6382bd0a3a4c25 > app_engine_release=1.9.42 trace_id=- > > { > > metadata: {…} > > protoPayload: {…} > > insertId: "2016-08-12|02:57:13.227532-07|10.94.33.10|-1476095845" > > log: "appengine.googleapis.com/request_log" > > httpRequest: {…} > > operation: {…} > > }A problem was encountered with the process that handled this request, > causing it to exit. This is likely to cause a new process to be used for > the next request to your application. If you see this message frequently, > you may be throwing exceptions during the initialization of your > application. (Error code 104) > > > > > > On Thursday, August 11, 2016 at 7:18:17 PM UTC+2, Mitch Sundt wrote: > >> Note that the last link on the error page provides information on how > to identify the cause of the problem. > >> > >> > >> The free quota counters reset at midnight Los Angeles, CA USA time. > >> For some issues, you may need to debug them right after midnight when > the quota resets. > >> The Google Cloud Platform console operates with the same quota limits > as the site, so once your quota is exhausted, you cannot use the console to > investigate the cause (beyond looking at the logging). > >> > >> > >> > >> > >> > >> On Thu, Aug 11, 2016 at 9:47 AM, Gustavo Zanfra Paitch < gpa...@gmail.com> wrote: > >> > >> Hello, > >> > >> Thank your for your attention! > >> > >> I haven't used ODK since I created this post, however the ODK Aggregate > still not working and the same problem still there. > >> > >> I don't know what I need to do. > >> > >> If you are willing to help me, I can give you all infos as > username/password. > >> > >> Thank you! > >> > >> Regards, > >> Gustavo > >> > >> > >> > >> Em terça-feira, 2 de agosto de 2016 15:09:17 UTC-3, Gustavo Zanfra Paitch escreveu: > >> > >> Hello, > >> > >> > >> I'm not able to access my Aggregate due to this issue, but I'm not sure > if I've exceeded the quota. > >> > >> > >> > >> I'm sending attached a screenshot of my Google App Engine, would be > great if you can help me, I need to get this data as soon as possible. > >> > >> > >> I can't even access the data using ODK Briefcase: > >> > >> "Unable to fetch formList: Internal Server Error (500) while accessing: > https://nespampufpr.appspot.com/formList > >> Please verify that the URL, your user credentials and your permissions > are all correct." > >> > >> > >> I'm sure that I filling the right URL and credentials. > >> > >> > >> Thank you! > >> > >> > >> Regards, > >> Gustavo > >> > >> > >> > >> > >> > >> > >> -- > >> > >> -- > >> > >> Post: opend...@googlegroups.com > >> > >> Unsubscribe: opendatakit...@googlegroups.com > >> > >> Options: http://groups.google.com/group/opendatakit?hl=en > >> > >> > >> > >> --- > >> > >> You received this message because you are subscribed to the Google > Groups "ODK Community" group. > >> > >> To unsubscribe from this group and stop receiving emails from it, send > an email to opendatakit...@googlegroups.com. > >> > >> For more options, visit https://groups.google.com/d/optout. > >> > >> > >> > >> > >> > >> -- > >> > >> Mitch Sundt > >> Software Engineer > >> University of Washington > >> mitche...@gmail.com > > > > -- > > -- > > Post: opend...@googlegroups.com > > Unsubscribe: opendatakit...@googlegroups.com > > Options: http://groups.google.com/group/opendatakit?hl=en > > > > --- > > You received this message because you are subscribed to the Google > Groups "ODK Community" group. > > To unsubscribe from this group and stop receiving emails from it, send > an email to opendatakit...@googlegroups.com . > > For more options, visit https://groups.google.com/d/optout. >

Thanks Yaw and Mitch,

Our data is up and running once more suggesting that it was a quota issue
which eludes us.

Regarding updates: ODK has been such a stable and integral part of our
operation that we have followed the 'sleeping dogs lie'/don't fix what
ain't broke/let well alone approach to date. But I hear your
bold-red-underline loud and clear and will take action accordingly.

All thanks and praise to ODK developers and community for a tool that
simply performs, year after year.

Regards,
Chris

Chris Berens
*VPUU Knowledge Management - GISc *PLATO PGP 1308
VIOLENCE PREVENTION THROUGH URBAN UPGRADING
Office - 021 447 3881 Cell - 082 567 9322
223 Lower Main Road, Observatory, Cape Town, 7925
NPC Reg # 2013/060455/08 www.vpuu.org.za

··· On Fri, Aug 12, 2016 at 6:00 PM, Mitch Sundt wrote:

And 1.4.3 is EXTREMELY old.

See https://github.com/opendatakit/opendatakit/wiki/
Aggregate-Release-Notes

For how to upgrade.

It is important to upgrade to newer ODK Aggregate versions as they come
out
(not necessarily immediately, but this should be something you do
at least once a year
).

There are several reasons for this:

  1. Security vulnerabilities -- we (and Google) are constantly
    upgrading the libraries we use with newer, safer, versions. The older your
    software, the greater the number of vulnerabilities in it.
  2. Google AppEngine is a managed environment, unlike, say, AWS or
    other "bare-box" hosting services. Google is continuously updating features
    and removing support for older features in this environment. If you don't
    upgrade, there may not be an upgrade path that works due to these changes
    -- unlike "bare-box" hosting, you, and the ODK team, only have partial
    control over the software and hardware environment.
  3. Performance revisions -- as we find performance issues and address
    them, the tools get better and faster.
  4. Enhanced capabilities -- the form-processing library (javarosa) has
    roughly-annual updates to add new functions (e.g., sin(), cos()) and
    occasionally data types. And new features are slowly added to ODK
    Aggregate, too.

On Fri, Aug 12, 2016 at 7:55 AM, Jefferson Francisco < jeffersont.francisco@gmail.com> wrote:

hey guys, i think had a similar issue with the previous version of ODK
Aggregate that was causing my instance hours to exceed my quota. Since I
was testing I didn't set up billing. The fix was to install the latest
version of Aggregate that had a fix for the bug. Then, when i went into
production, I went ahead and set up billing. Once billing is set up, then
you can really evaluate your cost. I think that Google gives you a $300
credit for the first three months. I would recommend 1) making sure you
have the latest version of Aggregate installed, and 2) Setting up billing
to prevent data loss.

On Friday, August 12, 2016 at 4:11:39 AM UTC-6, chris....@sundevelopment.co.za wrote:

We are experiencing a similar problem right now. Unlikely that we
exceeded our quota, we have an account with GC. Logs show:

105.186.98.167 - - [12/Aug/2016:11:56:26 +0200] "POST
/aggregateui/servicesadminservice HTTP/1.1" 500 - - "Mozilla/5.0
(Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko)
Chrome/52.0.2743.116 Safari/537.36" "vpuumapping2.appspot.com" ms=42226
cpu_ms=0 cpm_usd=0 loading_request=0 instance=00c61b117cf22136f5f71
be125309776c6ce8da2693f3d6382bd0a3a4c25 app_engine_release=1.9.42
trace_id=-
{
metadata: {…}
protoPayload: {…}
insertId: "2016-08-12|02:57:13.227532-07|10.94.33.10|-1476095845"
log: "appengine.googleapis.com/request_log"
httpRequest: {…}
operation: {…}
}A problem was encountered with the process that handled this request,
causing it to exit. This is likely to cause a new process to be used for
the next request to your application. If you see this message frequently,
you may be throwing exceptions during the initialization of your
application. (Error code 104)

On Thursday, August 11, 2016 at 7:18:17 PM UTC+2, Mitch Sundt wrote:

Note that the last link on the error page provides information on how
to identify the cause of the problem.

The free quota counters reset at midnight Los Angeles, CA USA time.
For some issues, you may need to debug them right after midnight when
the quota resets.
The Google Cloud Platform console operates with the same quota limits
as the site, so once your quota is exhausted, you cannot use the console to
investigate the cause (beyond looking at the logging).

On Thu, Aug 11, 2016 at 9:47 AM, Gustavo Zanfra Paitch < gpa...@gmail.com> wrote:

Hello,

Thank your for your attention!

I haven't used ODK since I created this post, however the ODK
Aggregate still not working and the same problem still there.

I don't know what I need to do.

If you are willing to help me, I can give you all infos as
username/password.

Thank you!

Regards,
Gustavo

Em terça-feira, 2 de agosto de 2016 15:09:17 UTC-3, Gustavo Zanfra Paitch escreveu:

Hello,

I'm not able to access my Aggregate due to this issue, but I'm not
sure if I've exceeded the quota.

I'm sending attached a screenshot of my Google App Engine, would be
great if you can help me, I need to get this data as soon as possible.

I can't even access the data using ODK Briefcase:

"Unable to fetch formList: Internal Server Error (500) while
accessing: https://nespampufpr.appspot.com/formList
Please verify that the URL, your user credentials and your permissions
are all correct."

I'm sure that I filling the right URL and credentials.

Thank you!

Regards,
Gustavo

--

--

Post: opend...@googlegroups.com

Unsubscribe: opendatakit...@googlegroups.com

Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to the Google
Groups "ODK Community" group.

To unsubscribe from this group and stop receiving emails from it, send
an email to opendatakit...@googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--

Mitch Sundt
Software Engineer
University of Washington
mitche...@gmail.com

--
--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to the Google Groups
"ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
Mitch Sundt
Software Engineer
University of Washington
mitchellsundt@gmail.com

Hi Gustavo, it was a comfort to find your post when it was happening to us.
I up-versioned to 1.4.11 from 1.4.3 without a hitch (other than my pwrd
being reset to "aggregate"). But then we have a very simple setup without
Tables or SQL. The issue seems to have disappeared.
Best wishes,
Chris

Chris Berens
*VPUU Knowledge Management - GISc *PLATO PGP 1308
VIOLENCE PREVENTION THROUGH URBAN UPGRADING
Office - 021 447 3881 Cell - 082 567 9322
223 Lower Main Road, Observatory, Cape Town, 7925
NPC Reg # 2013/060455/08 www.vpuu.org.za

··· On Wed, Aug 17, 2016 at 8:50 PM, Gustavo Zanfra Paitch wrote:

Hello Yaw, Mitch and Chris,

I haven't posted for a while, however the problem still since the day that
I posted here (02/08/16).

I think it's not a quota problem because I haven't sent forms since the
last days of July.

Unfortunately I have very shallow knowledge, but I am able to give any
information that you may need.

What version of Aggregate are you running?
1.4.9
*When did the problem start? *
02/08/16 (maybe early, but I just noticed this day)

Thank you very much!

Regards,
Gustavo

Em sexta-feira, 12 de agosto de 2016 10:21:40 UTC-3, Yaw Anokwa escreveu:

Hi Chris,

You'll need to provide more information before anyone can help.

What version of Aggregate are you running?
When did the problem start?
What, if anything has changed since the problem started?
Can you reliably reproduce the problem?
Are you absolutely sure you haven't run out of quota?
Are there more and different errors that you can share (maybe use
dpaste.com).

Yaw

Need ODK consultants? Nafundi provides form design, server setup,
in-field training, and software development for ODK. Go to
https://nafundi.com to get started.

On Fri, Aug 12, 2016 at 10:11 AM, chris....@sundevelopment.co.za wrote:

We are experiencing a similar problem right now. Unlikely that we
exceeded our quota, we have an account with GC. Logs show:

105.186.98.167 - - [12/Aug/2016:11:56:26 +0200] "POST
/aggregateui/servicesadminservice HTTP/1.1" 500 - - "Mozilla/5.0
(Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko)
Chrome/52.0.2743.116 Safari/537.36" "vpuumapping2.appspot.com" ms=42226
cpu_ms=0 cpm_usd=0 loading_request=0 instance=00c61b117cf22136f5f71
be125309776c6ce8da2693f3d6382bd0a3a4c25 app_engine_release=1.9.42
trace_id=-
{
metadata: {…}
protoPayload: {…}
insertId: "2016-08-12|02:57:13.227532-07|10.94.33.10|-1476095845"
log: "appengine.googleapis.com/request_log"
httpRequest: {…}
operation: {…}
}A problem was encountered with the process that handled this request,
causing it to exit. This is likely to cause a new process to be used for
the next request to your application. If you see this message frequently,
you may be throwing exceptions during the initialization of your
application. (Error code 104)

On Thursday, August 11, 2016 at 7:18:17 PM UTC+2, Mitch Sundt wrote:

Note that the last link on the error page provides information on how
to identify the cause of the problem.

The free quota counters reset at midnight Los Angeles, CA USA time.
For some issues, you may need to debug them right after midnight when
the quota resets.
The Google Cloud Platform console operates with the same quota limits
as the site, so once your quota is exhausted, you cannot use the console to
investigate the cause (beyond looking at the logging).

On Thu, Aug 11, 2016 at 9:47 AM, Gustavo Zanfra Paitch < gpa...@gmail.com> wrote:

Hello,

Thank your for your attention!

I haven't used ODK since I created this post, however the ODK
Aggregate still not working and the same problem still there.

I don't know what I need to do.

If you are willing to help me, I can give you all infos as
username/password.

Thank you!

Regards,
Gustavo

Em terça-feira, 2 de agosto de 2016 15:09:17 UTC-3, Gustavo Zanfra Paitch escreveu:

Hello,

I'm not able to access my Aggregate due to this issue, but I'm not
sure if I've exceeded the quota.

I'm sending attached a screenshot of my Google App Engine, would be
great if you can help me, I need to get this data as soon as possible.

I can't even access the data using ODK Briefcase:

"Unable to fetch formList: Internal Server Error (500) while
accessing: https://nespampufpr.appspot.com/formList
Please verify that the URL, your user credentials and your permissions
are all correct."

I'm sure that I filling the right URL and credentials.

Thank you!

Regards,
Gustavo

--

--

Post: opend...@googlegroups.com

Unsubscribe: opendatakit...@googlegroups.com

Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to the Google
Groups "ODK Community" group.

To unsubscribe from this group and stop receiving emails from it, send
an email to opendatakit...@googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--

Mitch Sundt
Software Engineer
University of Washington
mitche...@gmail.com

--

Post: opend...@googlegroups.com
Unsubscribe: opendatakit...@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to the Google
Groups "ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to opendatakit...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to a topic in the
Google Groups "ODK Community" group.
To unsubscribe from this topic, visit https://groups.google.com/d/
topic/opendatakit/OD7pC-WN3ic/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.