I face a problem with one instance of a well working form (more than 100 submission over the 4 last weeks).
The form is well finalized but Aggregate refuse to integrate it.
Looking at the apache log I found this error message :
Repeat table SICEN2020_EMPLACEMENT has dupes or missing rows for top level auri null and parent auri null
and SEVERE: Unexpected exception: incrementing repeats by more than one!
Jun 23, 2020 3:02:18 PM org.opendatakit.common.security.spring.RoleHierarchyImpl refreshReachableGrantedAuthorities
INFO: Executing: refreshReachableGrantedAuthorities
Jun 23, 2020 3:02:18 PM org.opendatakit.common.security.spring.UserServiceImpl reloadPermissions
INFO: Executing: reloadPermissions
Jun 23, 2020 3:02:18 PM org.opendatakit.aggregate.form.FormFactory internalGetForms
INFO: FormCache: fetching new list of Forms
Jun 23, 2020 3:02:18 PM org.opendatakit.aggregate.util.BackendActionsTable logValues
INFO: incoming- last Fetch: -190546 [S: -11575 Eq: -946197 Fs: -46197] futureMillis: 0
Jun 23, 2020 3:02:18 PM org.opendatakit.aggregate.util.BackendActionsTable logValues
INFO: -fetched- last Fetch: 0 [S: -11575 Eq: -946197 Fs: -46197] futureMillis: -1
Jun 23, 2020 3:02:18 PM org.opendatakit.aggregate.util.BackendActionsTable logValues
INFO: Eq-update last Fetch: 0 [S: -11575 Eq: 0 Fs: -46197] futureMillis: 0 requested: 0
Jun 23, 2020 3:02:18 PM org.opendatakit.aggregate.form.FormFactory internalGetForms
INFO: FormCache: using cached list of Forms
Jun 23, 2020 3:02:28 PM org.opendatakit.aggregate.form.FormFactory internalGetForms
INFO: FormCache: fetching new list of Forms
Jun 23, 2020 3:02:28 PM org.opendatakit.aggregate.util.BackendActionsTable logValues
INFO: incoming- last Fetch: -9900 [S: -21475 Eq: -9900 Fs: -56097] futureMillis: 890100
Jun 23, 2020 3:02:28 PM org.opendatakit.aggregate.util.BackendActionsTable logValues
INFO: -fetched- last Fetch: 0 [S: -21475 Eq: -9900 Fs: -56097] futureMillis: -1
Jun 23, 2020 3:02:28 PM org.opendatakit.aggregate.util.BackendActionsTable logValues
INFO: Fs-update last Fetch: 0 [S: -21475 Eq: -9900 Fs: 890100] futureMillis: 890100 requested: 890100
Jun 23, 2020 3:02:28 PM org.opendatakit.aggregate.form.FormFactory internalGetForms
INFO: FormCache: using cached list of Forms
Jun 23, 2020 3:02:34 PM org.opendatakit.aggregate.form.FormFactory internalGetForms
INFO: FormCache: fetching new list of Forms
Jun 23, 2020 3:02:34 PM org.opendatakit.aggregate.util.BackendActionsTable logValues
INFO: incoming- last Fetch: -5896 [S: -27371 Eq: -15796 Fs: 884204] futureMillis: 884204
Jun 23, 2020 3:02:34 PM org.opendatakit.aggregate.util.BackendActionsTable logValues
INFO: -fetched- last Fetch: 0 [S: -27371 Eq: -15796 Fs: 884204] futureMillis: -1
Jun 23, 2020 3:02:34 PM org.opendatakit.aggregate.submission.type.RepeatSubmissionType groupPerOrdinalNumber
SEVERE: Repeat table SICEN2020_EMPLACEMENT has dupes or missing rows for top level auri null and parent auri null
Jun 23, 2020 3:02:34 PM org.opendatakit.common.persistence.engine.pgres.DatastoreImpl deleteEntity
INFO: Executing DELETE FROM "odk_prod"."_task_lock" WHERE "_URI" = ? with key b249bce2-8412-4416-9f95-1b38208032a2 by user uid:odkchef|2017-06-14T14:22:06.053+0000
Jun 23, 2020 3:02:34 PM org.opendatakit.aggregate.servlet.SubmissionServlet doPost
SEVERE: Unexpected exception: incrementing repeats by more than one!
java.lang.IllegalStateException: incrementing repeats by more than one!
at org.opendatakit.aggregate.parser.SubmissionParser.processSubmissionElement(SubmissionParser.java:401)
at org.opendatakit.aggregate.parser.SubmissionParser.processSubmissionElement(SubmissionParser.java:405)
at org.opendatakit.aggregate.parser.SubmissionParser.constructorHelper(SubmissionParser.java:302)
at org.opendatakit.aggregate.parser.SubmissionParser.<init>(SubmissionParser.java:106)
at org.opendatakit.aggregate.servlet.SubmissionServlet.doPost(SubmissionServlet.java:222)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:661)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:742)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:231)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:317)
at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:127)
at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:91)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:114)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:137)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at org.opendatakit.common.security.spring.SecurityContextHolderAwareAuthPreservingRequestFilter.doFilter(SecurityContextHolderAwareAuthPreservingRequestFilter.java:58)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:111)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:63)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at org.opendatakit.common.security.spring.DigestAuthenticationFilter.doFilter(DigestAuthenticationFilter.java:39)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at org.opendatakit.common.security.spring.OutOfBandUserFilter.doFilter(OutOfBandUserFilter.java:102)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at org.opendatakit.common.security.spring.Oauth2ResourceFilter.doFilter(Oauth2ResourceFilter.java:344)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:116)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:105)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at org.springframework.security.web.access.channel.ChannelProcessingFilter.doFilter(ChannelProcessingFilter.java:157)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:214)
at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:177)
at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346)
at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:262)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:199)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:96)
at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:493)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:140)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:81)
at org.apache.catalina.valves.AbstractAccessLogValve.invoke(AbstractAccessLogValve.java:650)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:87)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:342)
at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:800)
at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:66)
at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:806)
at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1498)
at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
at java.lang.Thread.run(Thread.java:748)
I understand that one of the "emplacement" have no parent... And I don't understand how it is possible.
I attached the xml data here :
Sicen2020_2020-06-03_06-04-35.xml (98.6 KB)
I can easilly transform this xml to get the data but maybe it could be a more general bug...