AppEngine timeouts on start-up

Dear ODKers,

We've been running v1.0.6 production successfully for some time, then
earlier today we started receiving errors trying to log in to Aggregate.
The error message is the generic one:

AppEngine Application Problem
A problem has occurred that prevents your AppEngine application from
responding. Your application may have exceeded its per-minute or daily
usage quotas.
Please visit your application dashboard at Google AppEngine. The Billing
Status section will indicate what daily or per-minute usage limits your
application has exceeded.
If your application's usage limits have not been exceeded, then look for
performance issues within Google AppEngine cloud services. From your
application dashboard, click on the the System Status link on the left
sidebar under the Resources heading. This will report problems with Google
AppEngine cloud services.
If neither of those indicate any problems, then your application's Logs
may; these are reachable from the dashboard via the Logs link on the left
sidebar under the Main heading.

Following the advice above and elsewhere, we checked the logs. We are
nowhere near usage limits, but the problem appears to be that instance
start-up was taking too long and getting cut off:
"com.google.apphosting.api.DeadlineExceededException: This request
(51d9048e2f64ca86) started at 2012/06/04 17:55:25.466 UTC and was still
executing at 2012/06/04 17:56:24.910 UTC" (full log section below). This
happened repeatedly for one evening and then during the next morning, then
suddenly we started being able to access Aggregate again.

We're back online for the moment, but I'm worried about this cropping up
again and causing problems for our surveyors, etc. Is there anything that I
can do to make sure start-up doesn't take too long?

Thanks,

Chris

FROM THE APPENGINE LOG:

[ IP ADDRESS EDITED OUT ] - - [04/Jun/2012:10:56:25 -0700] "GET

/Aggregate.html HTTP/1.1" 500 0 - "Mozilla/5.0 (Windows NT 6.1)
AppleWebKit/536.5 (KHTML, like Gecko) Chrome/19.0.1084.52 Safari/536.5" "[
NAME EDITED OUT ].appspot.com" ms=62561 cpu_ms=10267 api_cpu_ms=0
cpm_usd=0.285243 loading_request=1 exit_code=104
instance=00c61b117caae31554c15db27a72f4c7c71ec28b

I 2012-06-04 10:55:52.210

javax.servlet.ServletContext log: Initializing Spring root

WebApplicationContext

I 2012-06-04 10:55:52.213

org.springframework.web.context.ContextLoader

initWebApplicationContext: Root WebApplicationContext: initialization
started

I 2012-06-04 10:55:57.902

org.springframework.context.support.AbstractApplicationContext

prepareRefresh: Refreshing Root WebApplicationContext: startup date [Mon
Jun 04 17:55:57 UTC 2012]; root of context hierarchy

I 2012-06-04 10:56:03.559

org.springframework.beans.factory.xml.XmlBeanDefinitionReader

loadBeanDefinitions: Loading XML bean definitions from class path resource
[odk-settings.xml]

I 2012-06-04 10:56:12.781

org.springframework.beans.factory.xml.XmlBeanDefinitionReader

loadBeanDefinitions: Loading XML bean definitions from ServletContext
resource [/WEB-INF/applicationContext-security.xml]

I 2012-06-04 10:56:13.501

org.springframework.beans.factory.xml.XmlBeanDefinitionReader

loadBeanDefinitions: Loading XML bean definitions from class path resource
[odk-security-settings.xml]

I 2012-06-04 10:56:13.572

org.springframework.beans.factory.xml.XmlBeanDefinitionReader

loadBeanDefinitions: Loading XML bean definitions from class path resource
[odk-common-security-settings.xml]

I 2012-06-04 10:56:13.862

org.springframework.security.config.SecurityNamespaceHandler <init>:

Couldn't determine package version information.

I 2012-06-04 10:56:14.805

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'true' for /_ah/**

I 2012-06-04 10:56:14.805

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'hasRole('ROLE_USER') or
hasRole('ROLE_SITE_ACCESS_ADMIN')' for /Aggregate.html

I 2012-06-04 10:56:14.805

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'hasRole('ROLE_USER')' for
/aggregateui/preferenceservice

I 2012-06-04 10:56:14.806

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'hasRole('ROLE_USER') or
hasRole('ROLE_SITE_ACCESS_ADMIN')' for /aggregateui/securityservice

I 2012-06-04 10:56:14.806

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'hasRole('ROLE_DATA_VIEWER')' for
/aggregateui/filterservice

I 2012-06-04 10:56:14.806

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'hasRole('ROLE_DATA_VIEWER')' for
/aggregateui/submissionservice

I 2012-06-04 10:56:14.806

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'hasRole('ROLE_DATA_VIEWER')' for
/aggregateui/formservice

I 2012-06-04 10:56:14.806

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'hasRole('ROLE_DATA_OWNER')' for
/aggregateui/formadminservice

I 2012-06-04 10:56:14.807

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'hasRole('ROLE_DATA_OWNER')' for
/aggregateui/servicesadminservice

I 2012-06-04 10:56:14.807

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'hasRole('ROLE_SITE_ACCESS_ADMIN')' for
/aggregateui/securityadminservice

I 2012-06-04 10:56:14.814

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'true' for /aggregateui/**

I 2012-06-04 10:56:14.815

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'true' for /images/**

I 2012-06-04 10:56:14.815

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'true' for /javascript/**

I 2012-06-04 10:56:14.815

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'true' for /res/**

I 2012-06-04 10:56:14.815

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'true' for /stylesheets/**

I 2012-06-04 10:56:14.816

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'true' for /access-denied.html

I 2012-06-04 10:56:14.816

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'true' for /over-quota.html

I 2012-06-04 10:56:14.816

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'true' for /robots.txt

I 2012-06-04 10:56:14.816

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'true' for /service-error.html

I 2012-06-04 10:56:14.816

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'true' for /AggregateUI.css

I 2012-06-04 10:56:14.817

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'true' for /favicon.ico

I 2012-06-04 10:56:14.817

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'true' for /index.html

I 2012-06-04 10:56:14.817

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'true' for /logout.html

I 2012-06-04 10:56:14.817

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'true' for /odk_color.png

I 2012-06-04 10:56:14.817

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'true' for /openid_login.html

I 2012-06-04 10:56:14.818

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'true' for /relogin.html

I 2012-06-04 10:56:14.818

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'isFullyAuthenticated() and hasRole('AUTH_LOCAL')' for
/local_login.html

I 2012-06-04 10:56:14.819

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'hasRole('ROLE_DATA_COLLECTOR') or
hasRole('ROLE_DATA_VIEWER')' for /formList

I 2012-06-04 10:56:14.819

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'hasRole('ROLE_DATA_COLLECTOR') or
hasRole('ROLE_DATA_VIEWER')' for /formXml

I 2012-06-04 10:56:14.820

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'hasRole('ROLE_DATA_COLLECTOR') or
hasRole('ROLE_DATA_OWNER')' for /submission

I 2012-06-04 10:56:14.820

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'hasRole('ROLE_DATA_OWNER')' for /formUpload

I 2012-06-04 10:56:14.820

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'hasRole('ROLE_DATA_OWNER')' for /upload

I 2012-06-04 10:56:14.821

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'hasRole('ROLE_DATA_COLLECTOR') or
hasRole('ROLE_DATA_VIEWER')' for /xformsDownload

I 2012-06-04 10:56:14.821

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'hasRole('ROLE_DATA_COLLECTOR') or
hasRole('ROLE_DATA_VIEWER')' for /xformsList

I 2012-06-04 10:56:14.821

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'hasRole('ROLE_DATA_COLLECTOR') or
hasRole('ROLE_DATA_VIEWER')' for /xformsManifest

I 2012-06-04 10:56:14.821

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'hasRole('ROLE_USER')' for /www/**

I 2012-06-04 10:56:14.822

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'hasRole('ROLE_DATA_VIEWER') or
hasRole('ROLE_ATTACHMENT_VIEWER')' for /view/binaryData

I 2012-06-04 10:56:14.822

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'hasRole('ROLE_DATA_VIEWER')' for /view/**

I 2012-06-04 10:56:14.822

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'hasRole('ROLE_DATA_OWNER')' for /auth/**

I 2012-06-04 10:56:14.822

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'hasRole('ROLE_SITE_ACCESS_ADMIN')' for /ssl/**

I 2012-06-04 10:56:14.822

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'true' for /gae/**

I 2012-06-04 10:56:14.822

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'true' for /remote_api

I 2012-06-04 10:56:14.836

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'isAnonymous()' for /**

W 2012-06-04 10:56:14.931

org.springframework.security.config.http.MatcherType fromElement:

'path-type' is deprecated. Please use 'request-matcher' instead.

W 2012-06-04 10:56:14.933

org.springframework.security.config.http.MatcherType fromElement:

'path-type' is deprecated. Please use 'request-matcher' instead.

I 2012-06-04 10:56:22.281

org.springframework.core.io.support.PropertiesLoaderSupport

loadProperties: Loading properties file from class path resource
[security.properties]

I 2012-06-04 10:56:22.713

org.springframework.core.io.support.PropertiesLoaderSupport

loadProperties: Loading properties file from ServletContext resource
[/WEB-INF/logging.properties]

I 2012-06-04 10:56:22.846

org.springframework.core.io.support.PropertiesLoaderSupport

loadProperties: Loading properties file from class path resource
[jdbc.properties]

I 2012-06-04 10:56:22.855

org.springframework.core.io.support.PropertiesLoaderSupport

loadProperties: Loading properties file from class path resource
[security.properties]

I 2012-06-04 10:56:22.869

org.springframework.core.io.support.PropertiesLoaderSupport

loadProperties: Loading properties file from ServletContext resource
[/WEB-INF/logging.properties]

I 2012-06-04 10:56:23.149

org.springframework.beans.factory.support.DefaultListableBeanFactory

preInstantiateSingletons: Pre-instantiating singletons in
org.springframework.beans.factory.support.DefaultListableBeanFactory@1af7c57:
defining beans
[org.springframework.beans.factory.config.PropertyPlaceholderConfigurer#0,datastore,realm,user_service,worksheet_creator,form_delete,purge_submissions,upload_task,kml_task,csv_task,http_client_factory,image_util,startup,oob_user_fetcher,watchdog,org.springframework.beans.factory.config.PropertyPlaceholderConfigurer#1,openid_4_java_http_client_factory,basicAuthenticationMessageDigestPasswordEncoder,hierarchicalRoleRelationships,org.springframework.security.web.access.expression.DefaultWebSecurityExpressionHandler#0,securityPolicy,serverSpringSecurityFilterChain,channelProcessingFilter,channelDecisionManager,portMapper,portResolver,secureChannelProcessor,insecureChannelProcessor,securityContextPersistenceFilter,securityContextRepository,logoutFilter,requestCacheAwareFilter,securityContextHolderAwareFilter,sessionManagerFilter,exceptionTranslationFilter,delegatingAuthenticationEntryPoint,localExceptionTranslationFilter,anonymousFilter,anonymousProvider,basicAuthFilter,basicEntryPoint,basicAuthenticationProvider,basicLoginService,digestAuthFilter,digestEntryPoint,digestAuthenticationProvider,digestLoginService,openIdFilter,openIdEntryPoint,openIdUserDetailsService,openIdAuthenticationProvider,tokenUserDetailsService,oobAuthFilter,oobAuthenticationProvider,oauth2ResourceFilter,oauth2AuthenticationProvider,filterSecurityInterceptor,accessDecisionManager,webPrivilegeEvaluator,authenticationManager];
root of factory hierarchy

I 2012-06-04 10:56:25.051

org.springframework.beans.factory.support.DefaultSingletonBeanRegistry

destroySingletons: Destroying singletons in
org.springframework.beans.factory.support.DefaultListableBeanFactory@1af7c57:
defining beans
[org.springframework.beans.factory.config.PropertyPlaceholderConfigurer#0,datastore,realm,user_service,worksheet_creator,form_delete,purge_submissions,upload_task,kml_task,csv_task,http_client_factory,image_util,startup,oob_user_fetcher,watchdog,org.springframework.beans.factory.config.PropertyPlaceholderConfigurer#1,openid_4_java_http_client_factory,basicAuthenticationMessageDigestPasswordEncoder,hierarchicalRoleRelationships,org.springframework.security.web.access.expression.DefaultWebSecurityExpressionHandler#0,securityPolicy,serverSpringSecurityFilterChain,channelProcessingFilter,channelDecisionManager,portMapper,portResolver,secureChannelProcessor,insecureChannelProcessor,securityContextPersistenceFilter,securityContextRepository,logoutFilter,requestCacheAwareFilter,securityContextHolderAwareFilter,sessionManagerFilter,exceptionTranslationFilter,delegatingAuthenticationEntryPoint,localExceptionTranslationFilter,anonymousFilter,anonymousProvider,basicAuthFilter,basicEntryPoint,basicAuthenticationProvider,basicLoginService,digestAuthFilter,digestEntryPoint,digestAuthenticationProvider,digestLoginService,openIdFilter,openIdEntryPoint,openIdUserDetailsService,openIdAuthenticationProvider,tokenUserDetailsService,oobAuthFilter,oobAuthenticationProvider,oauth2ResourceFilter,oauth2AuthenticationProvider,filterSecurityInterceptor,accessDecisionManager,webPrivilegeEvaluator,authenticationManager];
root of factory hierarchy

E 2012-06-04 10:56:25.051

org.springframework.web.context.ContextLoader

initWebApplicationContext: Context initialization failed
org.springframework.beans.factory.BeanCreationException: Error creating
bean with name 'realm' defined in class path resource [odk-settings.xml]:
Initialization of bean failed; nested exception is
com.google.apphosting.api.DeadlineExceededException: This request
(51d9048e2f64ca86) started at 2012/06/04 17:55:25.466 UTC and was still
executing at 2012/06/04 17:56:24.910 UTC.
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:527)
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:456)
at
org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:294)
at
org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:225)
at
org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:291)
at
org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:193)
at
org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:585)
at
org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:913)
at
org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:464)
at
org.springframework.web.context.ContextLoader.configureAndRefreshWebApplicationContext(ContextLoader.java:384)
at
org.springframework.web.context.ContextLoader.initWebApplicationContext(ContextLoader.java:283)
at
org.springframework.web.context.ContextLoaderListener.contextInitialized(ContextLoaderListener.java:111)
at
org.mortbay.jetty.handler.ContextHandler.startContext(ContextHandler.java:548)
at org.mortbay.jetty.servlet.Context.startContext(Context.java:136)
at
org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1250)
at
org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:517)
at
org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:467)
at
org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at
com.google.apphosting.runtime.jetty.AppVersionHandlerMap.createHandler(AppVersionHandlerMap.java:202)
at
com.google.apphosting.runtime.jetty.AppVersionHandlerMap.getHandler(AppVersionHandlerMap.java:171)
at
com.google.apphosting.runtime.jetty.JettyServletEngineAdapter.serviceRequest(JettyServletEngineAdapter.java:123)
at
com.google.apphosting.runtime.JavaRuntime$RequestRunnable.run(JavaRuntime.java:477)
at
com.google.tracing.TraceContext$TraceContextRunnable.runInContext(TraceContext.java:449)
at
com.google.tracing.TraceContext$TraceContextRunnable$1.run(TraceContext.java:455)
at com.google.tracing.TraceContext.runInContext(TraceContext.java:695)
at
com.google.tracing.TraceContext$AbstractTraceContextCallback.runInInheritedContextNoUnref(TraceContext.java:333)
at
com.google.tracing.TraceContext$AbstractTraceContextCallback.runInInheritedContext(TraceContext.java:325)
at
com.google.tracing.TraceContext$TraceContextRunnable.run(TraceContext.java:453)
at
com.google.apphosting.runtime.ThreadGroupPool$PoolEntry.run(ThreadGroupPool.java:251)
at java.lang.Thread.run(Thread.java:679)
Caused by: com.google.apphosting.api.DeadlineExceededException: This
request (51d9048e2f64ca86) started at 2012/06/04 17:55:25.466 UTC and was
still executing at 2012/06/04 17:56:24.910 UTC.
at
com.google.appengine.runtime.Request.process-51d9048e2f64ca86(Request.java)
at java.util.zip.ZipFile.read(Native Method)
at java.util.zip.ZipFile.access$1200(ZipFile.java:57)
at java.util.zip.ZipFile$ZipFileInputStream.read(ZipFile.java:476)
at java.util.zip.ZipFile$1.fill(ZipFile.java:259)
at java.util.zip.InflaterInputStream.read(InflaterInputStream.java:158)
at sun.misc.Resource.getBytes(Resource.java:124)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:273)
at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
at
org.springframework.beans.PropertyEditorRegistrySupport.createDefaultEditors(PropertyEditorRegistrySupport.java:207)
at
org.springframework.beans.PropertyEditorRegistrySupport.getDefaultEditor(PropertyEditorRegistrySupport.java:180)
at
org.springframework.beans.TypeConverterDelegate.findDefaultEditor(TypeConverterDelegate.java:314)
at
org.springframework.beans.TypeConverterDelegate.convertIfNecessary(TypeConverterDelegate.java:161)
at
org.springframework.beans.BeanWrapperImpl.convertIfNecessary(BeanWrapperImpl.java:470)
at
org.springframework.beans.BeanWrapperImpl.convertForProperty(BeanWrapperImpl.java:516)
at
org.springframework.beans.BeanWrapperImpl.convertForProperty(BeanWrapperImpl.java:510)
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.convertForProperty(AbstractAutowireCapableBeanFactory.java:1406)
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyPropertyValues(AbstractAutowireCapableBeanFactory.java:1365)
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1118)
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:517)
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:456)
at
org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:294)
at
org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:225)
at
org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:291)
at
org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:193)
at
org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:585)
at
org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:913)
at
org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:464)
at
org.springframework.web.context.ContextLoader.configureAndRefreshWebApplicationContext(ContextLoader.java:384)
at
org.springframework.web.context.ContextLoader.initWebApplicationContext(ContextLoader.java:283)
at
org.springframework.web.context.ContextLoaderListener.contextInitialized(ContextLoaderListener.java:111)
at
org.mortbay.jetty.handler.ContextHandler.startContext(ContextHandler.java:548)
at org.mortbay.jetty.servlet.Context.startContext(Context.java:136)
at
org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1250)
at
org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:517)
at
org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:467)
at
org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at
com.google.tracing.TraceContext$TraceContextRunnable.runInContext(TraceContext.java:449)
at
com.google.tracing.TraceContext$TraceContextRunnable$1.run(TraceContext.java:455)
at com.google.tracing.TraceContext.runInContext(TraceContext.java:695)
at
com.google.tracing.TraceContext$AbstractTraceContextCallback.runInInheritedContextNoUnref(TraceContext.java:333)
at
com.google.tracing.TraceContext$AbstractTraceContextCallback.runInInheritedContext(TraceContext.java:325)
at
com.google.tracing.TraceContext$TraceContextRunnable.run(TraceContext.java:453)
... 1 more

W 2012-06-04 10:56:25.062

Failed startup of context

com.google.apphosting.utils.jetty.RuntimeAppEngineWebAppContext@187275d{/,/base/data/home/apps/[
NAME EDITED OUT ]/1.358341606294558885}
org.springframework.beans.factory.BeanCreationException: Error creating
bean with name 'realm' defined in class path resource [odk-settings.xml]:
Initialization of bean failed; nested exception is
com.google.apphosting.api.DeadlineExceededException: This request
(51d9048e2f64ca86) started at 2012/06/04 17:55:25.466 UTC and was still
executing at 2012/06/04 17:56:24.910 UTC.
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:527)
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:456)
at
org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:294)
at
org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:225)
at
org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:291)
at
org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:193)
at
org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:585)
at
org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:913)
at
org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:464)
at
org.springframework.web.context.ContextLoader.configureAndRefreshWebApplicationContext(ContextLoader.java:384)
at
org.springframework.web.context.ContextLoader.initWebApplicationContext(ContextLoader.java:283)
at
org.springframework.web.context.ContextLoaderListener.contextInitialized(ContextLoaderListener.java:111)
at
org.mortbay.jetty.handler.ContextHandler.startContext(ContextHandler.java:548)
at org.mortbay.jetty.servlet.Context.startContext(Context.java:136)
at
org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1250)
at
org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:517)
at
org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:467)
at
org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at
com.google.apphosting.runtime.jetty.AppVersionHandlerMap.createHandler(AppVersionHandlerMap.java:202)
at
com.google.apphosting.runtime.jetty.AppVersionHandlerMap.getHandler(AppVersionHandlerMap.java:171)
at
com.google.apphosting.runtime.jetty.JettyServletEngineAdapter.serviceRequest(JettyServletEngineAdapter.java:123)
at
com.google.apphosting.runtime.JavaRuntime$RequestRunnable.run(JavaRuntime.java:477)
at
com.google.tracing.TraceContext$TraceContextRunnable.runInContext(TraceContext.java:449)
at
com.google.tracing.TraceContext$TraceContextRunnable$1.run(TraceContext.java:455)
at com.google.tracing.TraceContext.runInContext(TraceContext.java:695)
at
com.google.tracing.TraceContext$AbstractTraceContextCallback.runInInheritedContextNoUnref(TraceContext.java:333)
at
com.google.tracing.TraceContext$AbstractTraceContextCallback.runInInheritedContext(TraceContext.java:325)
at
com.google.tracing.TraceContext$TraceContextRunnable.run(TraceContext.java:453)
at
com.google.apphosting.runtime.ThreadGroupPool$PoolEntry.run(ThreadGroupPool.java:251)
at java.lang.Thread.run(Thread.java:679)
Caused by: com.google.apphosting.api.DeadlineExceededException: This
request (51d9048e2f64ca86) started at 2012/06/04 17:55:25.466 UTC and was
still executing at 2012/06/04 17:56:24.910 UTC.
at
com.google.appengine.runtime.Request.process-51d9048e2f64ca86(Request.java)
at java.util.zip.ZipFile.read(Native Method)
at java.util.zip.ZipFile.access$1200(ZipFile.java:57)
at java.util.zip.ZipFile$ZipFileInputStream.read(ZipFile.java:476)
at java.util.zip.ZipFile$1.fill(ZipFile.java:259)
at java.util.zip.InflaterInputStream.read(InflaterInputStream.java:158)
at sun.misc.Resource.getBytes(Resource.java:124)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:273)
at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
at
org.springframework.beans.PropertyEditorRegistrySupport.createDefaultEditors(PropertyEditorRegistrySupport.java:207)
at
org.springframework.beans.PropertyEditorRegistrySupport.getDefaultEditor(PropertyEditorRegistrySupport.java:180)
at
org.springframework.beans.TypeConverterDelegate.findDefaultEditor(TypeConverterDelegate.java:314)
at
org.springframework.beans.TypeConverterDelegate.convertIfNecessary(TypeConverterDelegate.java:161)
at
org.springframework.beans.BeanWrapperImpl.convertIfNecessary(BeanWrapperImpl.java:470)
at
org.springframework.beans.BeanWrapperImpl.convertForProperty(BeanWrapperImpl.java:516)
at
org.springframework.beans.BeanWrapperImpl.convertForProperty(BeanWrapperImpl.java:510)
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.convertForProperty(AbstractAutowireCapableBeanFactory.java:1406)
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyPropertyValues(AbstractAutowireCapableBeanFactory.java:1365)
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1118)
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:517)
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:456)
at
org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:294)
at
org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:225)
at
org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:291)
at
org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:193)
at
org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:585)
at
org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:913)
at
org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:464)
at
org.springframework.web.context.ContextLoader.configureAndRefreshWebApplicationContext(ContextLoader.java:384)
at
org.springframework.web.context.ContextLoader.initWebApplicationContext(ContextLoader.java:283)
at
org.springframework.web.context.ContextLoaderListener.contextInitialized(ContextLoaderListener.java:111)
at
org.mortbay.jetty.handler.ContextHandler.startContext(ContextHandler.java:548)
at org.mortbay.jetty.servlet.Context.startContext(Context.java:136)
at
org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1250)
at
org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:517)
at
org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:467)
at
org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at
com.google.tracing.TraceContext$TraceContextRunnable.runInContext(TraceContext.java:449)
at
com.google.tracing.TraceContext$TraceContextRunnable$1.run(TraceContext.java:455)
at com.google.tracing.TraceContext.runInContext(TraceContext.java:695)
at
com.google.tracing.TraceContext$AbstractTraceContextCallback.runInInheritedContextNoUnref(TraceContext.java:333)
at
com.google.tracing.TraceContext$AbstractTraceContextCallback.runInInheritedContext(TraceContext.java:325)
at
com.google.tracing.TraceContext$TraceContextRunnable.run(TraceContext.java:453)
... 1 more

W 2012-06-04 10:56:25.063

Nested in org.springframework.beans.factory.BeanCreationException:

Error creating bean with name 'realm' defined in class path resource
[odk-settings.xml]: Initialization of bean failed; nested exception is
com.google.apphosting.api.DeadlineExceededException: This request
(51d9048e2f64ca86) started at 2012/06/04 17:55:25.466 UTC and was still
executing at 2012/06/04 17:56:24.910 UTC.:
com.google.apphosting.api.DeadlineExceededException: This request
(51d9048e2f64ca86) started at 2012/06/04 17:55:25.466 UTC and was still
executing at 2012/06/04 17:56:24.910 UTC.
at
com.google.appengine.runtime.Request.process-51d9048e2f64ca86(Request.java)
at java.util.zip.ZipFile.read(Native Method)
at java.util.zip.ZipFile.access$1200(ZipFile.java:57)
at java.util.zip.ZipFile$ZipFileInputStream.read(ZipFile.java:476)
at java.util.zip.ZipFile$1.fill(ZipFile.java:259)
at java.util.zip.InflaterInputStream.read(InflaterInputStream.java:158)
at sun.misc.Resource.getBytes(Resource.java:124)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:273)
at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
at
org.springframework.beans.PropertyEditorRegistrySupport.createDefaultEditors(PropertyEditorRegistrySupport.java:207)
at
org.springframework.beans.PropertyEditorRegistrySupport.getDefaultEditor(PropertyEditorRegistrySupport.java:180)
at
org.springframework.beans.TypeConverterDelegate.findDefaultEditor(TypeConverterDelegate.java:314)
at
org.springframework.beans.TypeConverterDelegate.convertIfNecessary(TypeConverterDelegate.java:161)
at
org.springframework.beans.BeanWrapperImpl.convertIfNecessary(BeanWrapperImpl.java:470)
at
org.springframework.beans.BeanWrapperImpl.convertForProperty(BeanWrapperImpl.java:516)
at
org.springframework.beans.BeanWrapperImpl.convertForProperty(BeanWrapperImpl.java:510)
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.convertForProperty(AbstractAutowireCapableBeanFactory.java:1406)
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyPropertyValues(AbstractAutowireCapableBeanFactory.java:1365)
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1118)
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:517)
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:456)
at
org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:294)
at
org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:225)
at
org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:291)
at
org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:193)
at
org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:585)
at
org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:913)
at
org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:464)
at
org.springframework.web.context.ContextLoader.configureAndRefreshWebApplicationContext(ContextLoader.java:384)
at
org.springframework.web.context.ContextLoader.initWebApplicationContext(ContextLoader.java:283)
at
org.springframework.web.context.ContextLoaderListener.contextInitialized(ContextLoaderListener.java:111)
at
org.mortbay.jetty.handler.ContextHandler.startContext(ContextHandler.java:548)
at org.mortbay.jetty.servlet.Context.startContext(Context.java:136)
at
org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1250)
at
org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:517)
at
org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:467)
at
org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at
com.google.tracing.TraceContext$TraceContextRunnable.runInContext(TraceContext.java:449)
at
com.google.tracing.TraceContext$TraceContextRunnable$1.run(TraceContext.java:455)
at com.google.tracing.TraceContext.runInContext(TraceContext.java:695)
at
com.google.tracing.TraceContext$AbstractTraceContextCallback.runInInheritedContextNoUnref(TraceContext.java:333)
at
com.google.tracing.TraceContext$AbstractTraceContextCallback.runInInheritedContext(TraceContext.java:325)
at
com.google.tracing.TraceContext$TraceContextRunnable.run(TraceContext.java:453)
at java.lang.Thread.run(Thread.java:679)

C 2012-06-04 10:56:25.070

Uncaught exception from servlet
javax.servlet.UnavailableException: Initialization failed.
at

com.google.apphosting.runtime.jetty.AppVersionHandlerMap.createHandler(AppVersionHandlerMap.java:211)
at
com.google.apphosting.runtime.jetty.AppVersionHandlerMap.getHandler(AppVersionHandlerMap.java:171)
at
com.google.apphosting.runtime.jetty.JettyServletEngineAdapter.serviceRequest(JettyServletEngineAdapter.java:123)
at
com.google.apphosting.runtime.JavaRuntime$RequestRunnable.run(JavaRuntime.java:477)
at
com.google.tracing.TraceContext$TraceContextRunnable.runInContext(TraceContext.java:449)
at
com.google.tracing.TraceContext$TraceContextRunnable$1.run(TraceContext.java:455)
at com.google.tracing.TraceContext.runInContext(TraceContext.java:695)
at
com.google.tracing.TraceContext$AbstractTraceContextCallback.runInInheritedContextNoUnref(TraceContext.java:333)
at
com.google.tracing.TraceContext$AbstractTraceContextCallback.runInInheritedContext(TraceContext.java:325)
at
com.google.tracing.TraceContext$TraceContextRunnable.run(TraceContext.java:453)
at
com.google.apphosting.runtime.ThreadGroupPool$PoolEntry.run(ThreadGroupPool.java:251)
at java.lang.Thread.run(Thread.java:679)

I 2012-06-04 10:56:25.108

This request caused a new process to be started for your application,

and thus caused your application code to be loaded for the first time. This
request may thus take longer and use more CPU than a typical request for
your application.

W 2012-06-04 10:56:25.108

A problem was encountered with the process that handled this request,

causing it to exit. This is likely to cause a new process to be used for
the next request to your application. If you see this message frequently,
you may be throwing exceptions during the initialization of your
application. (Error code 104)

I've seen this a few times in the cloud, and never during development. As
far as I can tell, it is an instability in Google's infrastructure.
When I've seen it, the status page
http://code.google.com/status/appengineoften shows Elevated or other
issues.

The log always shows this same trace -- start-up was cancelled during the
SpringFramework WebApplicationContext initialization, always with the
"realm" object.
The "realm" object is the first class defined in the first config file that
is parsed during start-up. So the error means that it cannot open the
Aggregate code jar (aggregate-src-latest.jar).

I suspect it is a glitch in the file access ( java.util.zip.ZipFile.read ).

Mitch

··· On Mon, Jun 4, 2012 at 11:32 AM, Christopher Robert wrote:

Dear ODKers,

We've been running v1.0.6 production successfully for some time, then
earlier today we started receiving errors trying to log in to Aggregate.
The error message is the generic one:

AppEngine Application Problem
A problem has occurred that prevents your AppEngine application from
responding. Your application may have exceeded its per-minute or daily
usage quotas.
Please visit your application dashboard at Google AppEngine. The Billing
Status section will indicate what daily or per-minute usage limits your
application has exceeded.
If your application's usage limits have not been exceeded, then look for
performance issues within Google AppEngine cloud services. From your
application dashboard, click on the the System Status link on the left
sidebar under the Resources heading. This will report problems with Google
AppEngine cloud services.
If neither of those indicate any problems, then your application's Logs
may; these are reachable from the dashboard via the Logs link on the left
sidebar under the Main heading.

Following the advice above and elsewhere, we checked the logs. We are
nowhere near usage limits, but the problem appears to be that instance
start-up was taking too long and getting cut off:
"com.google.apphosting.api.DeadlineExceededException: This request
(51d9048e2f64ca86) started at 2012/06/04 17:55:25.466 UTC and was still
executing at 2012/06/04 17:56:24.910 UTC" (full log section below). This
happened repeatedly for one evening and then during the next morning, then
suddenly we started being able to access Aggregate again.

We're back online for the moment, but I'm worried about this cropping up
again and causing problems for our surveyors, etc. Is there anything that I
can do to make sure start-up doesn't take too long?

Thanks,

Chris

FROM THE APPENGINE LOG:

[ IP ADDRESS EDITED OUT ] - - [04/Jun/2012:10:56:25 -0700] "GET

/Aggregate.html HTTP/1.1" 500 0 - "Mozilla/5.0 (Windows NT 6.1)
AppleWebKit/536.5 (KHTML, like Gecko) Chrome/19.0.1084.52 Safari/536.5" "[
NAME EDITED OUT ].appspot.com" ms=62561 cpu_ms=10267 api_cpu_ms=0
cpm_usd=0.285243 loading_request=1 exit_code=104
instance=00c61b117caae31554c15db27a72f4c7c71ec28b

I 2012-06-04 10:55:52.210

javax.servlet.ServletContext log: Initializing Spring root

WebApplicationContext

I 2012-06-04 10:55:52.213

org.springframework.web.context.ContextLoader

initWebApplicationContext: Root WebApplicationContext: initialization
started

I 2012-06-04 10:55:57.902

org.springframework.context.support.AbstractApplicationContext

prepareRefresh: Refreshing Root WebApplicationContext: startup date [Mon
Jun 04 17:55:57 UTC 2012]; root of context hierarchy

I 2012-06-04 10:56:03.559

org.springframework.beans.factory.xml.XmlBeanDefinitionReader

loadBeanDefinitions: Loading XML bean definitions from class path resource
[odk-settings.xml]

I 2012-06-04 10:56:12.781

org.springframework.beans.factory.xml.XmlBeanDefinitionReader

loadBeanDefinitions: Loading XML bean definitions from ServletContext
resource [/WEB-INF/applicationContext-security.xml]

I 2012-06-04 10:56:13.501

org.springframework.beans.factory.xml.XmlBeanDefinitionReader

loadBeanDefinitions: Loading XML bean definitions from class path resource
[odk-security-settings.xml]

I 2012-06-04 10:56:13.572

org.springframework.beans.factory.xml.XmlBeanDefinitionReader

loadBeanDefinitions: Loading XML bean definitions from class path resource
[odk-common-security-settings.xml]

I 2012-06-04 10:56:13.862

org.springframework.security.config.SecurityNamespaceHandler <init>:

Couldn't determine package version information.

I 2012-06-04 10:56:14.805

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'true' for /_ah/**

I 2012-06-04 10:56:14.805

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'hasRole('ROLE_USER') or
hasRole('ROLE_SITE_ACCESS_ADMIN')' for /Aggregate.html

I 2012-06-04 10:56:14.805

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'hasRole('ROLE_USER')' for
/aggregateui/preferenceservice

I 2012-06-04 10:56:14.806

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'hasRole('ROLE_USER') or
hasRole('ROLE_SITE_ACCESS_ADMIN')' for /aggregateui/securityservice

I 2012-06-04 10:56:14.806

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'hasRole('ROLE_DATA_VIEWER')' for
/aggregateui/filterservice

I 2012-06-04 10:56:14.806

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'hasRole('ROLE_DATA_VIEWER')' for
/aggregateui/submissionservice

I 2012-06-04 10:56:14.806

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'hasRole('ROLE_DATA_VIEWER')' for
/aggregateui/formservice

I 2012-06-04 10:56:14.806

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'hasRole('ROLE_DATA_OWNER')' for
/aggregateui/formadminservice

I 2012-06-04 10:56:14.807

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'hasRole('ROLE_DATA_OWNER')' for
/aggregateui/servicesadminservice

I 2012-06-04 10:56:14.807

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'hasRole('ROLE_SITE_ACCESS_ADMIN')' for
/aggregateui/securityadminservice

I 2012-06-04 10:56:14.814

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'true' for /aggregateui/**

I 2012-06-04 10:56:14.815

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'true' for /images/**

I 2012-06-04 10:56:14.815

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'true' for /javascript/**

I 2012-06-04 10:56:14.815

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'true' for /res/**

I 2012-06-04 10:56:14.815

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'true' for /stylesheets/**

I 2012-06-04 10:56:14.816

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'true' for /access-denied.html

I 2012-06-04 10:56:14.816

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'true' for /over-quota.html

I 2012-06-04 10:56:14.816

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'true' for /robots.txt

I 2012-06-04 10:56:14.816

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'true' for /service-error.html

I 2012-06-04 10:56:14.816

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'true' for /AggregateUI.css

I 2012-06-04 10:56:14.817

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'true' for /favicon.ico

I 2012-06-04 10:56:14.817

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'true' for /index.html

I 2012-06-04 10:56:14.817

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'true' for /logout.html

I 2012-06-04 10:56:14.817

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'true' for /odk_color.png

I 2012-06-04 10:56:14.817

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'true' for /openid_login.html

I 2012-06-04 10:56:14.818

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'true' for /relogin.html

I 2012-06-04 10:56:14.818

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'isFullyAuthenticated() and hasRole('AUTH_LOCAL')' for
/local_login.html

I 2012-06-04 10:56:14.819

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'hasRole('ROLE_DATA_COLLECTOR') or
hasRole('ROLE_DATA_VIEWER')' for /formList

I 2012-06-04 10:56:14.819

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'hasRole('ROLE_DATA_COLLECTOR') or
hasRole('ROLE_DATA_VIEWER')' for /formXml

I 2012-06-04 10:56:14.820

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'hasRole('ROLE_DATA_COLLECTOR') or
hasRole('ROLE_DATA_OWNER')' for /submission

I 2012-06-04 10:56:14.820

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'hasRole('ROLE_DATA_OWNER')' for /formUpload

I 2012-06-04 10:56:14.820

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'hasRole('ROLE_DATA_OWNER')' for /upload

I 2012-06-04 10:56:14.821

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'hasRole('ROLE_DATA_COLLECTOR') or
hasRole('ROLE_DATA_VIEWER')' for /xformsDownload

I 2012-06-04 10:56:14.821

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'hasRole('ROLE_DATA_COLLECTOR') or
hasRole('ROLE_DATA_VIEWER')' for /xformsList

I 2012-06-04 10:56:14.821

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'hasRole('ROLE_DATA_COLLECTOR') or
hasRole('ROLE_DATA_VIEWER')' for /xformsManifest

I 2012-06-04 10:56:14.821

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'hasRole('ROLE_USER')' for /www/**

I 2012-06-04 10:56:14.822

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'hasRole('ROLE_DATA_VIEWER') or
hasRole('ROLE_ATTACHMENT_VIEWER')' for /view/binaryData

I 2012-06-04 10:56:14.822

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'hasRole('ROLE_DATA_VIEWER')' for /view/**

I 2012-06-04 10:56:14.822

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'hasRole('ROLE_DATA_OWNER')' for /auth/**

I 2012-06-04 10:56:14.822

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'hasRole('ROLE_SITE_ACCESS_ADMIN')' for /ssl/**

I 2012-06-04 10:56:14.822

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'true' for /gae/**

I 2012-06-04 10:56:14.822

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'true' for /remote_api

I 2012-06-04 10:56:14.836

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourceParser
parseInterceptUrlsForFilterInvocationRequestMap: Creating access control
expression attribute 'isAnonymous()' for /**

W 2012-06-04 10:56:14.931

org.springframework.security.config.http.MatcherType fromElement:

'path-type' is deprecated. Please use 'request-matcher' instead.

W 2012-06-04 10:56:14.933

org.springframework.security.config.http.MatcherType fromElement:

'path-type' is deprecated. Please use 'request-matcher' instead.

I 2012-06-04 10:56:22.281

org.springframework.core.io.support.PropertiesLoaderSupport

loadProperties: Loading properties file from class path resource
[security.properties]

I 2012-06-04 10:56:22.713

org.springframework.core.io.support.PropertiesLoaderSupport

loadProperties: Loading properties file from ServletContext resource
[/WEB-INF/logging.properties]

I 2012-06-04 10:56:22.846

org.springframework.core.io.support.PropertiesLoaderSupport

loadProperties: Loading properties file from class path resource
[jdbc.properties]

I 2012-06-04 10:56:22.855

org.springframework.core.io.support.PropertiesLoaderSupport

loadProperties: Loading properties file from class path resource
[security.properties]

I 2012-06-04 10:56:22.869

org.springframework.core.io.support.PropertiesLoaderSupport

loadProperties: Loading properties file from ServletContext resource
[/WEB-INF/logging.properties]

I 2012-06-04 10:56:23.149

org.springframework.beans.factory.support.DefaultListableBeanFactory

preInstantiateSingletons: Pre-instantiating singletons in
org.springframework.beans.factory.support.DefaultListableBeanFactory@1af7c57:
defining beans
[org.springframework.beans.factory.config.PropertyPlaceholderConfigurer#0,datastore,realm,user_service,worksheet_creator,form_delete,purge_submissions,upload_task,kml_task,csv_task,http_client_factory,image_util,startup,oob_user_fetcher,watchdog,org.springframework.beans.factory.config.PropertyPlaceholderConfigurer#1,openid_4_java_http_client_factory,basicAuthenticationMessageDigestPasswordEncoder,hierarchicalRoleRelationships,org.springframework.security.web.access.expression.DefaultWebSecurityExpressionHandler#0,securityPolicy,serverSpringSecurityFilterChain,channelProcessingFilter,channelDecisionManager,portMapper,portResolver,secureChannelProcessor,insecureChannelProcessor,securityContextPersistenceFilter,securityContextRepository,logoutFilter,requestCacheAwareFilter,securityContextHolderAwareFilter,sessionManagerFilter,exceptionTranslationFilter,delegatingAuthenticationEntryPoint,localExceptionTranslationFilter,anonymousFilter,anonymousProvider,basicAuthFilter,basicEntryPoint,basicAuthenticationProvider,basicLoginService,digestAuthFilter,digestEntryPoint,digestAuthenticationProvider,digestLoginService,openIdFilter,openIdEntryPoint,openIdUserDetailsService,openIdAuthenticationProvider,tokenUserDetailsService,oobAuthFilter,oobAuthenticationProvider,oauth2ResourceFilter,oauth2AuthenticationProvider,filterSecurityInterceptor,accessDecisionManager,webPrivilegeEvaluator,authenticationManager];
root of factory hierarchy

I 2012-06-04 10:56:25.051

org.springframework.beans.factory.support.DefaultSingletonBeanRegistry

destroySingletons: Destroying singletons in
org.springframework.beans.factory.support.DefaultListableBeanFactory@1af7c57:
defining beans
[org.springframework.beans.factory.config.PropertyPlaceholderConfigurer#0,datastore,realm,user_service,worksheet_creator,form_delete,purge_submissions,upload_task,kml_task,csv_task,http_client_factory,image_util,startup,oob_user_fetcher,watchdog,org.springframework.beans.factory.config.PropertyPlaceholderConfigurer#1,openid_4_java_http_client_factory,basicAuthenticationMessageDigestPasswordEncoder,hierarchicalRoleRelationships,org.springframework.security.web.access.expression.DefaultWebSecurityExpressionHandler#0,securityPolicy,serverSpringSecurityFilterChain,channelProcessingFilter,channelDecisionManager,portMapper,portResolver,secureChannelProcessor,insecureChannelProcessor,securityContextPersistenceFilter,securityContextRepository,logoutFilter,requestCacheAwareFilter,securityContextHolderAwareFilter,sessionManagerFilter,exceptionTranslationFilter,delegatingAuthenticationEntryPoint,localExceptionTranslationFilter,anonymousFilter,anonymousProvider,basicAuthFilter,basicEntryPoint,basicAuthenticationProvider,basicLoginService,digestAuthFilter,digestEntryPoint,digestAuthenticationProvider,digestLoginService,openIdFilter,openIdEntryPoint,openIdUserDetailsService,openIdAuthenticationProvider,tokenUserDetailsService,oobAuthFilter,oobAuthenticationProvider,oauth2ResourceFilter,oauth2AuthenticationProvider,filterSecurityInterceptor,accessDecisionManager,webPrivilegeEvaluator,authenticationManager];
root of factory hierarchy

E 2012-06-04 10:56:25.051

org.springframework.web.context.ContextLoader

initWebApplicationContext: Context initialization failed
org.springframework.beans.factory.BeanCreationException: Error
creating bean with name 'realm' defined in class path resource
[odk-settings.xml]: Initialization of bean failed; nested exception is
com.google.apphosting.api.DeadlineExceededException: This request
(51d9048e2f64ca86) started at 2012/06/04 17:55:25.466 UTC and was still
executing at 2012/06/04 17:56:24.910 UTC.
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:527)
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:456)
at
org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:294)
at
org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:225)
at
org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:291)
at
org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:193)
at
org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:585)
at
org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:913)
at
org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:464)
at
org.springframework.web.context.ContextLoader.configureAndRefreshWebApplicationContext(ContextLoader.java:384)
at
org.springframework.web.context.ContextLoader.initWebApplicationContext(ContextLoader.java:283)
at
org.springframework.web.context.ContextLoaderListener.contextInitialized(ContextLoaderListener.java:111)
at
org.mortbay.jetty.handler.ContextHandler.startContext(ContextHandler.java:548)
at org.mortbay.jetty.servlet.Context.startContext(Context.java:136)
at
org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1250)
at
org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:517)
at
org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:467)
at
org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at
com.google.apphosting.runtime.jetty.AppVersionHandlerMap.createHandler(AppVersionHandlerMap.java:202)
at
com.google.apphosting.runtime.jetty.AppVersionHandlerMap.getHandler(AppVersionHandlerMap.java:171)
at
com.google.apphosting.runtime.jetty.JettyServletEngineAdapter.serviceRequest(JettyServletEngineAdapter.java:123)
at
com.google.apphosting.runtime.JavaRuntime$RequestRunnable.run(JavaRuntime.java:477)
at
com.google.tracing.TraceContext$TraceContextRunnable.runInContext(TraceContext.java:449)
at
com.google.tracing.TraceContext$TraceContextRunnable$1.run(TraceContext.java:455)
at com.google.tracing.TraceContext.runInContext(TraceContext.java:695)
at
com.google.tracing.TraceContext$AbstractTraceContextCallback.runInInheritedContextNoUnref(TraceContext.java:333)
at
com.google.tracing.TraceContext$AbstractTraceContextCallback.runInInheritedContext(TraceContext.java:325)
at
com.google.tracing.TraceContext$TraceContextRunnable.run(TraceContext.java:453)
at
com.google.apphosting.runtime.ThreadGroupPool$PoolEntry.run(ThreadGroupPool.java:251)
at java.lang.Thread.run(Thread.java:679)
Caused by: com.google.apphosting.api.DeadlineExceededException: This
request (51d9048e2f64ca86) started at 2012/06/04 17:55:25.466 UTC and was
still executing at 2012/06/04 17:56:24.910 UTC.
at
com.google.appengine.runtime.Request.process-51d9048e2f64ca86(Request.java)
at java.util.zip.ZipFile.read(Native Method)
at java.util.zip.ZipFile.access$1200(ZipFile.java:57)
at java.util.zip.ZipFile$ZipFileInputStream.read(ZipFile.java:476)
at java.util.zip.ZipFile$1.fill(ZipFile.java:259)
at
java.util.zip.InflaterInputStream.read(InflaterInputStream.java:158)
at sun.misc.Resource.getBytes(Resource.java:124)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:273)
at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
at
org.springframework.beans.PropertyEditorRegistrySupport.createDefaultEditors(PropertyEditorRegistrySupport.java:207)
at
org.springframework.beans.PropertyEditorRegistrySupport.getDefaultEditor(PropertyEditorRegistrySupport.java:180)
at
org.springframework.beans.TypeConverterDelegate.findDefaultEditor(TypeConverterDelegate.java:314)
at
org.springframework.beans.TypeConverterDelegate.convertIfNecessary(TypeConverterDelegate.java:161)
at
org.springframework.beans.BeanWrapperImpl.convertIfNecessary(BeanWrapperImpl.java:470)
at
org.springframework.beans.BeanWrapperImpl.convertForProperty(BeanWrapperImpl.java:516)
at
org.springframework.beans.BeanWrapperImpl.convertForProperty(BeanWrapperImpl.java:510)
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.convertForProperty(AbstractAutowireCapableBeanFactory.java:1406)
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyPropertyValues(AbstractAutowireCapableBeanFactory.java:1365)
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1118)
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:517)
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:456)
at
org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:294)
at
org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:225)
at
org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:291)
at
org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:193)
at
org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:585)
at
org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:913)
at
org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:464)
at
org.springframework.web.context.ContextLoader.configureAndRefreshWebApplicationContext(ContextLoader.java:384)
at
org.springframework.web.context.ContextLoader.initWebApplicationContext(ContextLoader.java:283)
at
org.springframework.web.context.ContextLoaderListener.contextInitialized(ContextLoaderListener.java:111)
at
org.mortbay.jetty.handler.ContextHandler.startContext(ContextHandler.java:548)
at org.mortbay.jetty.servlet.Context.startContext(Context.java:136)
at
org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1250)
at
org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:517)
at
org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:467)
at
org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at
com.google.tracing.TraceContext$TraceContextRunnable.runInContext(TraceContext.java:449)
at
com.google.tracing.TraceContext$TraceContextRunnable$1.run(TraceContext.java:455)
at com.google.tracing.TraceContext.runInContext(TraceContext.java:695)
at
com.google.tracing.TraceContext$AbstractTraceContextCallback.runInInheritedContextNoUnref(TraceContext.java:333)
at
com.google.tracing.TraceContext$AbstractTraceContextCallback.runInInheritedContext(TraceContext.java:325)
at
com.google.tracing.TraceContext$TraceContextRunnable.run(TraceContext.java:453)
... 1 more

W 2012-06-04 10:56:25.062

Failed startup of context

com.google.apphosting.utils.jetty.RuntimeAppEngineWebAppContext@187275d{/,/base/data/home/apps/[
NAME EDITED OUT ]/1.358341606294558885}
org.springframework.beans.factory.BeanCreationException: Error
creating bean with name 'realm' defined in class path resource
[odk-settings.xml]: Initialization of bean failed; nested exception is
com.google.apphosting.api.DeadlineExceededException: This request
(51d9048e2f64ca86) started at 2012/06/04 17:55:25.466 UTC and was still
executing at 2012/06/04 17:56:24.910 UTC.
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:527)
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:456)
at
org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:294)
at
org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:225)
at
org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:291)
at
org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:193)
at
org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:585)
at
org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:913)
at
org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:464)
at
org.springframework.web.context.ContextLoader.configureAndRefreshWebApplicationContext(ContextLoader.java:384)
at
org.springframework.web.context.ContextLoader.initWebApplicationContext(ContextLoader.java:283)
at
org.springframework.web.context.ContextLoaderListener.contextInitialized(ContextLoaderListener.java:111)
at
org.mortbay.jetty.handler.ContextHandler.startContext(ContextHandler.java:548)
at org.mortbay.jetty.servlet.Context.startContext(Context.java:136)
at
org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1250)
at
org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:517)
at
org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:467)
at
org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at
com.google.apphosting.runtime.jetty.AppVersionHandlerMap.createHandler(AppVersionHandlerMap.java:202)
at
com.google.apphosting.runtime.jetty.AppVersionHandlerMap.getHandler(AppVersionHandlerMap.java:171)
at
com.google.apphosting.runtime.jetty.JettyServletEngineAdapter.serviceRequest(JettyServletEngineAdapter.java:123)
at
com.google.apphosting.runtime.JavaRuntime$RequestRunnable.run(JavaRuntime.java:477)
at
com.google.tracing.TraceContext$TraceContextRunnable.runInContext(TraceContext.java:449)
at
com.google.tracing.TraceContext$TraceContextRunnable$1.run(TraceContext.java:455)
at com.google.tracing.TraceContext.runInContext(TraceContext.java:695)
at
com.google.tracing.TraceContext$AbstractTraceContextCallback.runInInheritedContextNoUnref(TraceContext.java:333)
at
com.google.tracing.TraceContext$AbstractTraceContextCallback.runInInheritedContext(TraceContext.java:325)
at
com.google.tracing.TraceContext$TraceContextRunnable.run(TraceContext.java:453)
at
com.google.apphosting.runtime.ThreadGroupPool$PoolEntry.run(ThreadGroupPool.java:251)
at java.lang.Thread.run(Thread.java:679)
Caused by: com.google.apphosting.api.DeadlineExceededException: This
request (51d9048e2f64ca86) started at 2012/06/04 17:55:25.466 UTC and was
still executing at 2012/06/04 17:56:24.910 UTC.
at
com.google.appengine.runtime.Request.process-51d9048e2f64ca86(Request.java)
at java.util.zip.ZipFile.read(Native Method)
at java.util.zip.ZipFile.access$1200(ZipFile.java:57)
at java.util.zip.ZipFile$ZipFileInputStream.read(ZipFile.java:476)
at java.util.zip.ZipFile$1.fill(ZipFile.java:259)
at
java.util.zip.InflaterInputStream.read(InflaterInputStream.java:158)
at sun.misc.Resource.getBytes(Resource.java:124)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:273)
at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
at
org.springframework.beans.PropertyEditorRegistrySupport.createDefaultEditors(PropertyEditorRegistrySupport.java:207)
at
org.springframework.beans.PropertyEditorRegistrySupport.getDefaultEditor(PropertyEditorRegistrySupport.java:180)
at
org.springframework.beans.TypeConverterDelegate.findDefaultEditor(TypeConverterDelegate.java:314)
at
org.springframework.beans.TypeConverterDelegate.convertIfNecessary(TypeConverterDelegate.java:161)
at
org.springframework.beans.BeanWrapperImpl.convertIfNecessary(BeanWrapperImpl.java:470)
at
org.springframework.beans.BeanWrapperImpl.convertForProperty(BeanWrapperImpl.java:516)
at
org.springframework.beans.BeanWrapperImpl.convertForProperty(BeanWrapperImpl.java:510)
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.convertForProperty(AbstractAutowireCapableBeanFactory.java:1406)
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyPropertyValues(AbstractAutowireCapableBeanFactory.java:1365)
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1118)
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:517)
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:456)
at
org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:294)
at
org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:225)
at
org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:291)
at
org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:193)
at
org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:585)
at
org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:913)
at
org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:464)
at
org.springframework.web.context.ContextLoader.configureAndRefreshWebApplicationContext(ContextLoader.java:384)
at
org.springframework.web.context.ContextLoader.initWebApplicationContext(ContextLoader.java:283)
at
org.springframework.web.context.ContextLoaderListener.contextInitialized(ContextLoaderListener.java:111)
at
org.mortbay.jetty.handler.ContextHandler.startContext(ContextHandler.java:548)
at org.mortbay.jetty.servlet.Context.startContext(Context.java:136)
at
org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1250)
at
org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:517)
at
org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:467)
at
org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at
com.google.tracing.TraceContext$TraceContextRunnable.runInContext(TraceContext.java:449)
at
com.google.tracing.TraceContext$TraceContextRunnable$1.run(TraceContext.java:455)
at com.google.tracing.TraceContext.runInContext(TraceContext.java:695)
at
com.google.tracing.TraceContext$AbstractTraceContextCallback.runInInheritedContextNoUnref(TraceContext.java:333)
at
com.google.tracing.TraceContext$AbstractTraceContextCallback.runInInheritedContext(TraceContext.java:325)
at
com.google.tracing.TraceContext$TraceContextRunnable.run(TraceContext.java:453)
... 1 more

W 2012-06-04 10:56:25.063

Nested in org.springframework.beans.factory.BeanCreationException:

Error creating bean with name 'realm' defined in class path resource
[odk-settings.xml]: Initialization of bean failed; nested exception is
com.google.apphosting.api.DeadlineExceededException: This request
(51d9048e2f64ca86) started at 2012/06/04 17:55:25.466 UTC and was still
executing at 2012/06/04 17:56:24.910 UTC.:
com.google.apphosting.api.DeadlineExceededException: This request
(51d9048e2f64ca86) started at 2012/06/04 17:55:25.466 UTC and was still
executing at 2012/06/04 17:56:24.910 UTC.
at
com.google.appengine.runtime.Request.process-51d9048e2f64ca86(Request.java)
at java.util.zip.ZipFile.read(Native Method)
at java.util.zip.ZipFile.access$1200(ZipFile.java:57)
at java.util.zip.ZipFile$ZipFileInputStream.read(ZipFile.java:476)
at java.util.zip.ZipFile$1.fill(ZipFile.java:259)
at
java.util.zip.InflaterInputStream.read(InflaterInputStream.java:158)
at sun.misc.Resource.getBytes(Resource.java:124)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:273)
at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
at
org.springframework.beans.PropertyEditorRegistrySupport.createDefaultEditors(PropertyEditorRegistrySupport.java:207)
at
org.springframework.beans.PropertyEditorRegistrySupport.getDefaultEditor(PropertyEditorRegistrySupport.java:180)
at
org.springframework.beans.TypeConverterDelegate.findDefaultEditor(TypeConverterDelegate.java:314)
at
org.springframework.beans.TypeConverterDelegate.convertIfNecessary(TypeConverterDelegate.java:161)
at
org.springframework.beans.BeanWrapperImpl.convertIfNecessary(BeanWrapperImpl.java:470)
at
org.springframework.beans.BeanWrapperImpl.convertForProperty(BeanWrapperImpl.java:516)
at
org.springframework.beans.BeanWrapperImpl.convertForProperty(BeanWrapperImpl.java:510)
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.convertForProperty(AbstractAutowireCapableBeanFactory.java:1406)
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyPropertyValues(AbstractAutowireCapableBeanFactory.java:1365)
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1118)
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:517)
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:456)
at
org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:294)
at
org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:225)
at
org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:291)
at
org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:193)
at
org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:585)
at
org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:913)
at
org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:464)
at
org.springframework.web.context.ContextLoader.configureAndRefreshWebApplicationContext(ContextLoader.java:384)
at
org.springframework.web.context.ContextLoader.initWebApplicationContext(ContextLoader.java:283)
at
org.springframework.web.context.ContextLoaderListener.contextInitialized(ContextLoaderListener.java:111)
at
org.mortbay.jetty.handler.ContextHandler.startContext(ContextHandler.java:548)
at org.mortbay.jetty.servlet.Context.startContext(Context.java:136)
at
org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1250)
at
org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:517)
at
org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:467)
at
org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at
com.google.tracing.TraceContext$TraceContextRunnable.runInContext(TraceContext.java:449)
at
com.google.tracing.TraceContext$TraceContextRunnable$1.run(TraceContext.java:455)
at com.google.tracing.TraceContext.runInContext(TraceContext.java:695)
at
com.google.tracing.TraceContext$AbstractTraceContextCallback.runInInheritedContextNoUnref(TraceContext.java:333)
at
com.google.tracing.TraceContext$AbstractTraceContextCallback.runInInheritedContext(TraceContext.java:325)
at
com.google.tracing.TraceContext$TraceContextRunnable.run(TraceContext.java:453)
at java.lang.Thread.run(Thread.java:679)

C 2012-06-04 10:56:25.070

Uncaught exception from servlet
javax.servlet.UnavailableException: Initialization failed.
at

com.google.apphosting.runtime.jetty.AppVersionHandlerMap.createHandler(AppVersionHandlerMap.java:211)
at
com.google.apphosting.runtime.jetty.AppVersionHandlerMap.getHandler(AppVersionHandlerMap.java:171)
at
com.google.apphosting.runtime.jetty.JettyServletEngineAdapter.serviceRequest(JettyServletEngineAdapter.java:123)
at
com.google.apphosting.runtime.JavaRuntime$RequestRunnable.run(JavaRuntime.java:477)
at
com.google.tracing.TraceContext$TraceContextRunnable.runInContext(TraceContext.java:449)
at
com.google.tracing.TraceContext$TraceContextRunnable$1.run(TraceContext.java:455)
at com.google.tracing.TraceContext.runInContext(TraceContext.java:695)
at
com.google.tracing.TraceContext$AbstractTraceContextCallback.runInInheritedContextNoUnref(TraceContext.java:333)
at
com.google.tracing.TraceContext$AbstractTraceContextCallback.runInInheritedContext(TraceContext.java:325)
at
com.google.tracing.TraceContext$TraceContextRunnable.run(TraceContext.java:453)
at
com.google.apphosting.runtime.ThreadGroupPool$PoolEntry.run(ThreadGroupPool.java:251)
at java.lang.Thread.run(Thread.java:679)

I 2012-06-04 10:56:25.108

This request caused a new process to be started for your application,

and thus caused your application code to be loaded for the first time. This
request may thus take longer and use more CPU than a typical request for
your application.

W 2012-06-04 10:56:25.108

A problem was encountered with the process that handled this request,

causing it to exit. This is likely to cause a new process to be used for
the next request to your application. If you see this message frequently,
you may be throwing exceptions during the initialization of your
application. (Error code 104)

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

--
Mitch Sundt
Software Engineer
University of Washington
mitchellsundt@gmail.com

Hi Mitch,

Okay, then I'll keep my fingers crossed that it's not going to become a
common occurrence..!

Thanks,

Chris

··· On Monday, June 4, 2012, Mitch S wrote:

I've seen this a few times in the cloud, and never during development. As
far as I can tell, it is an instability in Google's infrastructure.
When I've seen it, the status page http://code.google.com/status/appengineoften shows Elevated or other issues.

The log always shows this same trace -- start-up was cancelled during the
SpringFramework WebApplicationContext initialization, always with the
"realm" object.
The "realm" object is the first class defined in the first config file
that is parsed during start-up. So the error means that it cannot open the
Aggregate code jar (aggregate-src-latest.jar).

I suspect it is a glitch in the file access ( java.util.zip.ZipFile.read ).

Mitch

On Mon, Jun 4, 2012 at 11:32 AM, Christopher Robert < chrislrobert@gmail.com <javascript:_e({}, 'cvml', 'chrislrobert@gmail.com');>> wrote:

Dear ODKers,

We've been running v1.0.6 production successfully for some time, then
earlier today we started receiving errors trying to log in to Aggregate.
The error message is the generic one:

AppEngine Application Problem
A problem has occurred that prevents your AppEngine application from
responding. Your application may have exceeded its per-minute or daily
usage quotas.
Please visit your application dashboard at Google AppEngine. The
Billing Status section will indicate what daily or per-minute usage limits
your application has exceeded.
If your application's usage limits have not been exceeded, then look
for performance issues within Google AppEngine cloud services. From your
application dashboard, click on the the System Status link on the left
sidebar under the Resources heading. This will report problems with Google
AppEngine cloud services.
If neither of those indicate any problems, then your application's Logs
may; these are reachable from the dashboard via the Logs link on the left
sidebar under the Main heading.

Following the advice above and elsewhere, we checked the logs. We are
nowhere near usage limits, but the problem appears to be that instance
start-up was taking too long and getting cut off:
"com.google.apphosting.api.DeadlineExceededException: This request
(51d9048e2f64ca86) started at 2012/06/04 17:55:25.466 UTC and was still
executing at 2012/06/04 17:56:24.910 UTC" (full log section below). This
happened repeatedly for one evening and then during the next morning, then
suddenly we started being able to access Aggregate again.

We're back online for the moment, but I'm worried about this cropping up
again and causing problems for our surveyors, etc. Is there anything that I
can do to make sure start-up doesn't take too long?

Thanks,

Chris

FROM THE APPENGINE LOG:

[ IP ADDRESS EDITED OUT ] - - [04/Jun/2012:10:56:25 -0700] "GET

/Aggregate.html HTTP/1.1" 500 0 - "Mozilla/5.0 (Windows NT 6.1)
AppleWebKit/536.5 (KHTML, like Gecko) Chrome/19.0.1084.52 Safari/536.5" "[
NAME EDITED OUT ].appspot.com" ms=62561 cpu_ms=10267 api_cpu_ms=0
cpm_usd=0.285243 loading_request=1 exit_code=104
instance=00c61b117caae31554c15db27a72f4c7c71ec28b

I 2012-06-04 10:55:52.210

javax.servlet.ServletContext log: Initializing Spring root

WebApplicationContext

I 2012-06-04 10:55:52.213

org.springframework.web.context.ContextLoader

initWebApplicationContext: Root WebApplicationContext: initialization
started

I 2012-06-04 10:55:57.902

org.springframework.context.support.AbstractApplicationContext

prepareRefresh: Refreshing Root WebApplicationContext: startup date [Mon
Jun 04 17:55:57 UTC 2012]; root of context hierarchy

I 2012-06-04 10:56:03.559

org.springframework.beans.factory.xml.XmlBeanDefinitionReader

loadBeanDefinitions: Loading XML bean definitions from class path resource
[odk-settings.xml]

I 2012-06-04 10:56:12.781

org.springframework.beans.factory.xml.XmlBeanDefinitionReader

loadBeanDefinitions: Loading XML bean definitions from ServletContext
resource [/WEB-INF/applicationContext-security.xml]

I 2012-06-04 10:56:13.501

org.springframework.beans.factory.xml.XmlBeanDefinitionReader

loadBeanDefinitions: Loading XML bean definitions from class path resource
[odk-security-settings.xml]

I 2012-06-04 10:56:13.572

org.springframework.beans.factory.xml.XmlBeanDefinitionReader

loadBeanDefinitions: Loading XML bean definitions from class path resource
[odk-common-security-settings.xml]

I 2012-06-04 10:56:13.862

org.springframework.security.config.SecurityNamespaceHandler <init>:

Couldn't determine package version information.

 I 2012-06-04 10:56:14.805

org.springframework.security.config.http.FilterInvocationSecurityMetadataSourcePars

--
Post: opendatakit@googlegroups.com <javascript:_e({}, 'cvml',
'opendatakit@googlegroups.com');>
Unsubscribe: opendatakit+unsubscribe@googlegroups.com <javascript:_e({},
'cvml', 'opendatakit%2Bunsubscribe@googlegroups.com');>
Options: http://groups.google.com/group/opendatakit?hl=en

--
Mitch Sundt
Software Engineer
University of Washington
mitchellsundt@gmail.com <javascript:_e({}, 'cvml',
'mitchellsundt@gmail.com');>

--
Post: opendatakit@googlegroups.com <javascript:_e({}, 'cvml',
'opendatakit@googlegroups.com');>
Unsubscribe: opendatakit+unsubscribe@googlegroups.com <javascript:_e({},
'cvml', 'opendatakit%2Bunsubscribe@googlegroups.com');>
Options: http://groups.google.com/group/opendatakit?hl=en

This is WHY it's going to be very important to do a comparative study on
using/implementing Aggregate on other cloud platforms (Amazon AWS, Azure
Linux, your own server, etc.).
I hear Aggregate can be installed on AWS. When I get some time, I'll take a
peek at this option.

Christopher did a great write-up documenting his steps configuring
Aggregate on AWS:
http://code.google.com/p/opendatakit/wiki/AggregateAWSInstall

Mitch

··· On Wed, Jun 13, 2012 at 9:16 PM, DataMax wrote:

This is WHY it's going to be very important to do a comparative study on
using/implementing Aggregate on other cloud platforms (Amazon AWS, Azure
Linux, your own server, etc.).
I hear Aggregate can be installed on AWS. When I get some time, I'll take
a peek at this option.

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

--
Mitch Sundt
Software Engineer
University of Washington
mitchellsundt@gmail.com