Decryption failing on one interview (XmlPullParserException)

Hi,

We are able to download all the instances for an encrypted form from
Aggregate using ODK Briefcase 1.4.9, but decryption fails after about 200
interviews.

...
Processing instance: uuid70ddce71-3cd2-47bc-80db-c0927d98ff6a
Processing instance: uuid71ca6097-27f4-4415-a6c9-aa4c05a85e67
Processing instance: uuid721bc06b-031f-4d90-af7a-8eabbddb595b
Error decrypting submission uuid721bc06b-031f-4d90-af7a-8eabbddb595b Cause:
org.opendatakit.briefcase.model.FileSystemException: Error decrypting:
submission.xml Cause: org.opendatakit.briefcase.model.ParsingException:
Failed during parsing of submission Xml:
org.xmlpull.v1.XmlPullParserException: element stack empty
(position:END_TAG @2:483 in java.io.InputStreamReader@5527b09b)
FAILED!

The key must be correct or no interviews could be decrypted. A search for
'element stack empty' in this group found nothing, though some have had the
XmlPullParserException.

I've tested the form with ODK Validate and it passes.

Does anyone have an idea what I should try next?

Thanks,
Thomas

As an interim solution to get past this bad submission,

(1) open a file browser and navigate into the ODK Briefcase Storage folder
that your ODK Briefcase is using to hold the encrypted form.
(2) navigate to forms / encrypted-form-name / instances /
(3) and find the submission folder that the export was complaining about.
In this case, uuid721bc06b-031f-4d90-af7a-8eabbddb595b
(4) move this folder and its contents to a location outside of the ODK
Briefcase Storage directory.

Then run ODK Briefcase and try the export. This should either complete or
report a different submission with a problem. Repeat the above steps as
necessary.

I suspect that the submissions that are bad are incomplete submissions that
have not been finalized.

This would only occur if you are manually copying files off of the device
and failed to ensure that all the files copied were finalized.

To confirm this, you could examine the submission.xml files to see how
different they are.

I use Notepad++. You can download XML Tools (
http://docs.notepad-plus-plus.org/index.php/Plugin_Central#X ) and install
it using these instructions:
http://docs.notepad-plus-plus.org/index.php/Plugin_Central

To do that, it is useful to have an XML pretty-printer.

If you use Notepad++, you can install XML Tools (
http://docs.notepad-plus-plus.org/index.php/Plugin_Central#X ) and use its
pretty-printer (with line breaks).

If the submission is a well-formed encrypted form, it would look something
like this:


jwEbnMFMPgeepiW4iz72dN6oh1T5bEbA6s9pAGCLPdohy43mxUz+1nV2+bzbg3G/Nx78/grAQNRz7c9J0xMDr8tsRIUwdkHlmDx+H9eoOSKIUBLNiUfplYZbQTsGEh60GEm8qfecFwqe12yNbzvtRwGU3rA2cPc89/awx5WmQtrhpOd+ueSI55w2fUOe8SRhKjoYxDJPgHSL1cvPMHwpxpYyf3OE2sBCVA/dXj9DpQyhkcjiB4b47y7fmkLZjQDnS56xYOrzhyPFakCVZkDv5G+yu1p8O1/0DOq/WT1WeF7nO6irj2wNXCDJlAL+tAyMFT9f/WRO9S2VDMva5bs65A==
<n0:meta xmlns:n0="http://openrosa.org/xforms">
n0:instanceIDuuid:03d4e156-1c4d-4f04-a202-89c12b3aa057</n0:instanceID>
</n0:meta>




1415995855358.jpg.enc

submission.xml.enc
kgtCxWxqr8Ug21EOlNwkbyfAwPW9EVhmvzU4GwEumgXjtB+FXkCBsr1fNcJFrPu6yoD6NT70oTs8EqFE9jFTD7FFh8kTlvjAclInX+h993puFUQkKCjfirOVn/JydZa6qUw3aGwqrC5yiKqUwyzLv6V0ljo1rKXmcF0pmnvcf5iitWQ7KM8L67E4Ez8AVg2F7Lq29KDemPWj0DhnqSKT62ECkwCxOqVrjdg9UM/e5qu0iF2btYc/Qtu+tZ6cYGU635WR/+2sWzcKB4R4FPtKpta2hTld5mTQGPpPacEiqtMNVxmYo5HR/q6zgFR9xMxK3Wc1Zft4IgUT0BW01T4Gkg==

If it looks like it contains your survey data, then the form was never
finalized.

··· On Tue, Aug 23, 2016 at 9:58 PM, Thomas Graydon-Guy < t.graydon-guy@massey.ac.nz> wrote:

Hi,

We are able to download all the instances for an encrypted form from
Aggregate using ODK Briefcase 1.4.9, but decryption fails after about 200
interviews.

...
Processing instance: uuid70ddce71-3cd2-47bc-80db-c0927d98ff6a
Processing instance: uuid71ca6097-27f4-4415-a6c9-aa4c05a85e67
Processing instance: uuid721bc06b-031f-4d90-af7a-8eabbddb595b
Error decrypting submission uuid721bc06b-031f-4d90-af7a-8eabbddb595b
Cause: org.opendatakit.briefcase.model.FileSystemException: Error
decrypting: submission.xml Cause: org.opendatakit.briefcase.model.ParsingException:
Failed during parsing of submission Xml: org.xmlpull.v1.XmlPullParserException:
element stack empty (position:END_TAG @2:483 in
java.io.InputStreamReader@5527b09b)
FAILED!

The key must be correct or no interviews could be decrypted. A search
for 'element stack empty' in this group found nothing, though some have had
the XmlPullParserException.

I've tested the form with ODK Validate and it passes.

Does anyone have an idea what I should try next?

Thanks,
Thomas

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to the Google Groups
"ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
Mitch Sundt
Software Engineer
University of Washington
mitchellsundt@gmail.com

Thanks Mitch,

Skipping that one instance worked; the rest were decrypted fine. I'll
examine the bad one later.

··· On Friday, 26 August 2016 11:51:04 UTC+12, Mitch Sundt wrote: > > As an interim solution to get past this bad submission, > > (1) open a file browser and navigate into the ODK Briefcase Storage folder > that your ODK Briefcase is using to hold the encrypted form. > (2) navigate to forms / encrypted-form-name / instances / > (3) and find the submission folder that the export was complaining about. > In this case, *uuid721bc06b-031f-4d90-af7a-8eabbddb595b* > (4) move this folder and its contents to a location outside of the ODK > Briefcase Storage directory. > > Then run ODK Briefcase and try the export. This should either complete or > report a different submission with a problem. Repeat the above steps as > necessary. > > I suspect that the submissions that are bad are incomplete submissions > that have not been finalized. > > This would only occur if you are manually copying files off of the device > and failed to ensure that all the files copied were finalized. > > To confirm this, you could examine the submission.xml files to see how > different they are. > > I use Notepad++. You can download XML Tools ( > http://docs.notepad-plus-plus.org/index.php/Plugin_Central#X ) and > install it using these instructions: > http://docs.notepad-plus-plus.org/index.php/Plugin_Central > > To do that, it is useful to have an XML pretty-printer. > > If you use Notepad++, you can install XML Tools ( > http://docs.notepad-plus-plus.org/index.php/Plugin_Central#X ) and use > its pretty-printer (with line breaks). > > If the submission is a well-formed encrypted form, it would look something > like this: > > instanceID="uuid:03d4e156-1c4d-4f04-a202-89c12b3aa057" version="5" > submissionDate="2014-11-17T23:53:32.837Z" isComplete="true" > markedAsCompleteDate="2014-11-17T23:53:42.990Z" xmlns=" > http://opendatakit.org/submissions"> > > jwEbnMFMPgeepiW4iz72dN6oh1T5bEbA6s9pAGCLPdohy43mxUz+1nV2+bzbg3G/Nx78/grAQNRz7c9J0xMDr8tsRIUwdkHlmDx+H9eoOSKIUBLNiUfplYZbQTsGEh60GEm8qfecFwqe12yNbzvtRwGU3rA2cPc89/awx5WmQtrhpOd+ueSI55w2fUOe8SRhKjoYxDJPgHSL1cvPMHwpxpYyf3OE2sBCVA/dXj9DpQyhkcjiB4b47y7fmkLZjQDnS56xYOrzhyPFakCVZkDv5G+yu1p8O1/0DOq/WT1WeF7nO6irj2wNXCDJlAL+tAyMFT9f/WRO9S2VDMva5bs65A== > > uuid:03d4e156-1c4d-4f04-a202-89c12b3aa057 > > > > > > 1415995855358.jpg.enc > > submission.xml.enc > > kgtCxWxqr8Ug21EOlNwkbyfAwPW9EVhmvzU4GwEumgXjtB+FXkCBsr1fNcJFrPu6yoD6NT70oTs8EqFE9jFTD7FFh8kTlvjAclInX+h993puFUQkKCjfirOVn/JydZa6qUw3aGwqrC5yiKqUwyzLv6V0ljo1rKXmcF0pmnvcf5iitWQ7KM8L67E4Ez8AVg2F7Lq29KDemPWj0DhnqSKT62ECkwCxOqVrjdg9UM/e5qu0iF2btYc/Qtu+tZ6cYGU635WR/+2sWzcKB4R4FPtKpta2hTld5mTQGPpPacEiqtMNVxmYo5HR/q6zgFR9xMxK3Wc1Zft4IgUT0BW01T4Gkg== > > > If it looks like it contains your survey data, then the form was never > finalized. > > > On Tue, Aug 23, 2016 at 9:58 PM, Thomas Graydon-Guy < t.gray...@massey.ac.nz > wrote: > >> Hi, >> >> We are able to download all the instances for an encrypted form from >> Aggregate using ODK Briefcase 1.4.9, but decryption fails after about 200 >> interviews. >> >> ... >> Processing instance: uuid70ddce71-3cd2-47bc-80db-c0927d98ff6a >> Processing instance: uuid71ca6097-27f4-4415-a6c9-aa4c05a85e67 >> Processing instance: uuid721bc06b-031f-4d90-af7a-8eabbddb595b >> Error decrypting submission uuid721bc06b-031f-4d90-af7a-8eabbddb595b >> Cause: org.opendatakit.briefcase.model.FileSystemException: Error >> decrypting: submission.xml Cause: >> org.opendatakit.briefcase.model.ParsingException: Failed during parsing of >> submission Xml: org.xmlpull.v1.XmlPullParserException: element stack empty >> (position:END_TAG @2:483 in java.io.InputStreamReader@5527b09b) >> FAILED! >> >> The key must be correct or *no* interviews could be decrypted. A search >> for 'element stack empty' in this group found nothing, though some have had >> the XmlPullParserException. >> >> I've tested the form with ODK Validate and it passes. >> >> Does anyone have an idea what I should try next? >> >> Thanks, >> Thomas >> >> -- >> -- >> Post: opend...@googlegroups.com >> Unsubscribe: opendatakit...@googlegroups.com >> Options: http://groups.google.com/group/opendatakit?hl=en >> >> --- >> You received this message because you are subscribed to the Google Groups >> "ODK Community" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to opendatakit...@googlegroups.com . >> For more options, visit https://groups.google.com/d/optout. >> > > > > -- > Mitch Sundt > Software Engineer > University of Washington > mitche...@gmail.com >