Briefcase failing to export encrypted submissions

Running briefcase 1.3.2. Upon exporting some submissions which have been downloaded from the server, I run into this.

Starting Export...
Processing instance: uuid0000697b-b3e3-4b3a-9c16-6051954153f7
Processing instance: uuid00040176-dd58-4d28-ae71-c19b558ad96e
Processing instance: uuid000e9ace-bca7-4dde-9585-576db16ab4aa
Processing instance: uuid001a8cc0-7298-43ed-a0f0-890fe4dc79f1
Processing instance: uuid0021883a-cf92-43c9-b7b8-bb46cccb97d6
Processing instance: uuid00286c9b-9c04-43ac-bf2e-70617bc15d68
Processing instance: uuid0037c162-22ca-46db-b0fe-b7a244365b0a
Submission not found for instance directory: C:\Users\jason\Documents\ODK Briefcase Storage\forms\Test and Treat Survey\instances\uuid00498801-2432-43aa-a941-ca5e2165637e
FAILED!

and the process fails.

Any tips about how to fix/work around this?

Regards,
Jason

After managing to replicate my server to a local machine, I was able to
export all submissions. However, I am not getting this error.

Error decrypting submission uuid0205bf60-6069-4627-a5e9-c59c8ebcbcac Cause:
org.opendatakit.briefcase.model.ParsingException: Missing one or more
required elements of encrypted form.

Browsing through the source code of briefcase, it seems to be extremely
strict in terms of errors. If anything goes wrong, the entire process
fails. Anyway, to skip over these sorts of errors instead?

Regards,
Jason

··· On Monday, August 12, 2013 1:45:50 PM UTC+2, Jason Pickering wrote: > > Running briefcase 1.3.2. Upon exporting some submissions which have been > downloaded from the server, I run into this. > > Starting Export... > Processing instance: uuid0000697b-b3e3-4b3a-9c16-6051954153f7 > Processing instance: uuid00040176-dd58-4d28-ae71-c19b558ad96e > Processing instance: uuid000e9ace-bca7-4dde-9585-576db16ab4aa > Processing instance: uuid001a8cc0-7298-43ed-a0f0-890fe4dc79f1 > Processing instance: uuid0021883a-cf92-43c9-b7b8-bb46cccb97d6 > Processing instance: uuid00286c9b-9c04-43ac-bf2e-70617bc15d68 > Processing instance: uuid0037c162-22ca-46db-b0fe-b7a244365b0a > Submission not found for instance directory: C:\Users\jason\Documents\ODK > Briefcase Storage\forms\Test and Treat > Survey\instances\uuid00498801-2432-43aa-a941-ca5e2165637e > FAILED! > > and the process fails. > > Any tips about how to fix/work around this? > > Regards, > Jason > >

It looks like there are a few problems here.

  1. Some submissions are invalid, but are recorded in the smallSQL database.
    Typically, they seem to be missing the encrypted file. This throws the
    "Submission not found for instance directory" error. I managed to write a
    script to get rid of these instances and delete them from the database, so,
    one problem solved maybe, but ...

  2. After a couple of dozen records are processed, this error occurs, which
    would not seem to be fatal, but the process fails.

Unable to remove decrypted files: Unable to delete directory
C:\Users\jason\Documents\ODK Briefcase Storage\forms\Test and Treat
Survey\instances\uuid03ce1992-ae6f-415f-831d-0b52d448db15\temp.

··· On Monday, August 12, 2013 9:56:42 PM UTC+2, Jason Pickering wrote: > > After managing to replicate my server to a local machine, I was able to > export all submissions. However, I am not getting this error. > > Error decrypting submission uuid0205bf60-6069-4627-a5e9-c59c8ebcbcac > Cause: org.opendatakit.briefcase.model.ParsingException: Missing one or > more required elements of encrypted form. > > Browsing through the source code of briefcase, it seems to be extremely > strict in terms of errors. If anything goes wrong, the entire process > fails. Anyway, to skip over these sorts of errors instead? > > Regards, > Jason > > > On Monday, August 12, 2013 1:45:50 PM UTC+2, Jason Pickering wrote: >> >> Running briefcase 1.3.2. Upon exporting some submissions which have been >> downloaded from the server, I run into this. >> >> Starting Export... >> Processing instance: uuid0000697b-b3e3-4b3a-9c16-6051954153f7 >> Processing instance: uuid00040176-dd58-4d28-ae71-c19b558ad96e >> Processing instance: uuid000e9ace-bca7-4dde-9585-576db16ab4aa >> Processing instance: uuid001a8cc0-7298-43ed-a0f0-890fe4dc79f1 >> Processing instance: uuid0021883a-cf92-43c9-b7b8-bb46cccb97d6 >> Processing instance: uuid00286c9b-9c04-43ac-bf2e-70617bc15d68 >> Processing instance: uuid0037c162-22ca-46db-b0fe-b7a244365b0a >> Submission not found for instance directory: C:\Users\jason\Documents\ODK >> Briefcase Storage\forms\Test and Treat >> Survey\instances\uuid00498801-2432-43aa-a941-ca5e2165637e >> FAILED! >> >> and the process fails. >> >> Any tips about how to fix/work around this? >> >> Regards, >> Jason >> >>

yes, that should be recoverable.

If you can send code changes to fix these two issues, I can apply them to
the main code tree.

Mitch

··· On Tue, Aug 13, 2013 at 12:02 AM, Jason Pickering < jason.p.pickering@gmail.com> wrote:

It looks like there are a few problems here.

  1. Some submissions are invalid, but are recorded in the smallSQL
    database. Typically, they seem to be missing the encrypted file. This
    throws the "Submission not found for instance directory" error. I managed
    to write a script to get rid of these instances and delete them from the
    database, so, one problem solved maybe, but ...

  2. After a couple of dozen records are processed, this error occurs, which
    would not seem to be fatal, but the process fails.

Unable to remove decrypted files: Unable to delete directory
C:\Users\jason\Documents\ODK Briefcase Storage\forms\Test and Treat
Survey\instances\uuid03ce1992-ae6f-415f-831d-0b52d448db15\temp.

On Monday, August 12, 2013 9:56:42 PM UTC+2, Jason Pickering wrote:

After managing to replicate my server to a local machine, I was able to
export all submissions. However, I am not getting this error.

Error decrypting submission uuid0205bf60-6069-4627-a5e9-**c59c8ebcbcac
Cause: org.opendatakit.briefcase.**model.ParsingException: Missing one
or more required elements of encrypted form.

Browsing through the source code of briefcase, it seems to be extremely
strict in terms of errors. If anything goes wrong, the entire process
fails. Anyway, to skip over these sorts of errors instead?

Regards,
Jason

On Monday, August 12, 2013 1:45:50 PM UTC+2, Jason Pickering wrote:

Running briefcase 1.3.2. Upon exporting some submissions which have been
downloaded from the server, I run into this.

Starting Export...
Processing instance: uuid0000697b-b3e3-4b3a-9c16-**6051954153f7
Processing instance: uuid00040176-dd58-4d28-ae71-**c19b558ad96e
Processing instance: uuid000e9ace-bca7-4dde-9585-**576db16ab4aa
Processing instance: uuid001a8cc0-7298-43ed-a0f0-**890fe4dc79f1
Processing instance: uuid0021883a-cf92-43c9-b7b8-**bb46cccb97d6
Processing instance: uuid00286c9b-9c04-43ac-bf2e-**70617bc15d68
Processing instance: uuid0037c162-22ca-46db-b0fe-**b7a244365b0a
Submission not found for instance directory:
C:\Users\jason\Documents\ODK Briefcase Storage\forms\Test and Treat
Survey\instances\uuid00498801-**2432-43aa-a941-ca5e2165637e
FAILED!

and the process fails.

Any tips about how to fix/work around this?

Regards,
Jason

--
--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to the Google Groups
"ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
Mitch Sundt
Software Engineer
University of Washington
mitchellsundt@gmail.com

Hi, I've had a similar problem. I've pulled data from Aggregate but when I try to export I got this message:

Starting Export...
Submission not found for instance directory: C:\Users...\ODK\ODK Briefcase Storage\forms\sample\instances\desktop.ini
FAILED!

I don't know if the data is encrypted--upload and download is password protected (no anonymous submissions) but I don't think that makes it encrypted.

Any recommendations would be a huge help, thanks!

Kat

··· On Tuesday, August 20, 2013 12:04:20 PM UTC-6, Mitch Sundt wrote: > yes, that should be recoverable. > > If you can send code changes to fix these two issues, I can apply them to the main code tree. > > Mitch > > > > > > On Tue, Aug 13, 2013 at 12:02 AM, Jason Pickering wrote: > > > It looks like there are a few problems here. > 1) Some submissions are invalid, but are recorded in the smallSQL database. Typically, they seem to be missing the encrypted file. This throws the "Submission not found for instance directory" error. I managed to write a script to get rid of these instances and delete them from the database, so, one problem solved maybe, but ... > > > > 2) After a couple of dozen records are processed, this error occurs, which would not seem to be fatal, but the process fails. > > > Unable to remove decrypted files: Unable to delete directory C:\Users\jason\Documents\ODK Briefcase Storage\forms\Test and Treat Survey\instances\uuid03ce1992-ae6f-415f-831d-0b52d448db15\temp. > > > > > > On Monday, August 12, 2013 9:56:42 PM UTC+2, Jason Pickering wrote: > > After managing to replicate my server to a local machine, I was able to export all submissions. However, I am not getting this error. > > > Error decrypting submission uuid0205bf60-6069-4627-a5e9-c59c8ebcbcac Cause: org.opendatakit.briefcase.model.ParsingException: Missing one or more required elements of encrypted form. > > > > Browsing through the source code of briefcase, it seems to be extremely strict in terms of errors. If anything goes wrong, the entire process fails. Anyway, to skip over these sorts of errors instead? > > > > Regards, > Jason > > > > On Monday, August 12, 2013 1:45:50 PM UTC+2, Jason Pickering wrote: > Running briefcase 1.3.2. Upon exporting some submissions which have been downloaded from the server, I run into this. > Starting Export... > Processing instance: uuid0000697b-b3e3-4b3a-9c16-6051954153f7 > Processing instance: uuid00040176-dd58-4d28-ae71-c19b558ad96e > > Processing instance: uuid000e9ace-bca7-4dde-9585-576db16ab4aa > Processing instance: uuid001a8cc0-7298-43ed-a0f0-890fe4dc79f1 > Processing instance: uuid0021883a-cf92-43c9-b7b8-bb46cccb97d6 > Processing instance: uuid00286c9b-9c04-43ac-bf2e-70617bc15d68 > > Processing instance: uuid0037c162-22ca-46db-b0fe-b7a244365b0a > Submission not found for instance directory: C:\Users\jason\Documents\ODK Briefcase Storage\forms\Test and Treat Survey\instances\uuid00498801-2432-43aa-a941-ca5e2165637e > > FAILED! > and the process fails. > Any tips about how to fix/work around this? > Regards, > Jason > > > > > > > > > > > > > -- > > -- > > Post: opend...@googlegroups.com > > Unsubscribe: opendatakit...@googlegroups.com > > Options: http://groups.google.com/group/opendatakit?hl=en > > > > --- > > You received this message because you are subscribed to the Google Groups "ODK Community" group. > > To unsubscribe from this group and stop receiving emails from it, send an email to opendatakit...@googlegroups.com. > > For more options, visit https://groups.google.com/groups/opt_out. > > > > > > > > > -- > Mitch Sundt > Software Engineer > University of Washington > mitche...@gmail.com

Hi Kat,

You'll know the form is encrypted in Aggregate because there will be
nonsense text in the submissions page (see attached). If it is
encrypted you'll need to get the private key from whomever uploaded
that blank form.

As far as your Briefcase issues, first, make sure you are using the
latest version (v1.4). Then try going into C:\Users...\ODK\ODK
Briefcase Storage\forms\sample\instances and removing desktop.ini and
see if that helps.

You can also try uploading and filling out a test form on the server
to see if you can get that to work.

Yaw

image

··· -- Need ODK services? http://nafundi.com provides form design, server setup, professional support, and software development for ODK.

On Fri, Mar 14, 2014 at 5:33 PM, kdiaz@tns.org wrote:

Hi, I've had a similar problem. I've pulled data from Aggregate but when I try to export I got this message:

Starting Export...
Submission not found for instance directory: C:\Users...\ODK\ODK Briefcase Storage\forms\sample\instances\desktop.ini
FAILED!

I don't know if the data is encrypted--upload and download is password protected (no anonymous submissions) but I don't think that makes it encrypted.

Any recommendations would be a huge help, thanks!

Kat

On Tuesday, August 20, 2013 12:04:20 PM UTC-6, Mitch Sundt wrote:

yes, that should be recoverable.

If you can send code changes to fix these two issues, I can apply them to the main code tree.

Mitch

On Tue, Aug 13, 2013 at 12:02 AM, Jason Pickering jason.p....@gmail.com wrote:

It looks like there are a few problems here.

  1. Some submissions are invalid, but are recorded in the smallSQL database. Typically, they seem to be missing the encrypted file. This throws the "Submission not found for instance directory" error. I managed to write a script to get rid of these instances and delete them from the database, so, one problem solved maybe, but ...

  2. After a couple of dozen records are processed, this error occurs, which would not seem to be fatal, but the process fails.

Unable to remove decrypted files: Unable to delete directory C:\Users\jason\Documents\ODK Briefcase Storage\forms\Test and Treat Survey\instances\uuid03ce1992-ae6f-415f-831d-0b52d448db15\temp.

On Monday, August 12, 2013 9:56:42 PM UTC+2, Jason Pickering wrote:

After managing to replicate my server to a local machine, I was able to export all submissions. However, I am not getting this error.

Error decrypting submission uuid0205bf60-6069-4627-a5e9-c59c8ebcbcac Cause: org.opendatakit.briefcase.model.ParsingException: Missing one or more required elements of encrypted form.

Browsing through the source code of briefcase, it seems to be extremely strict in terms of errors. If anything goes wrong, the entire process fails. Anyway, to skip over these sorts of errors instead?

Regards,
Jason

On Monday, August 12, 2013 1:45:50 PM UTC+2, Jason Pickering wrote:
Running briefcase 1.3.2. Upon exporting some submissions which have been downloaded from the server, I run into this.
Starting Export...
Processing instance: uuid0000697b-b3e3-4b3a-9c16-6051954153f7
Processing instance: uuid00040176-dd58-4d28-ae71-c19b558ad96e

Processing instance: uuid000e9ace-bca7-4dde-9585-576db16ab4aa
Processing instance: uuid001a8cc0-7298-43ed-a0f0-890fe4dc79f1
Processing instance: uuid0021883a-cf92-43c9-b7b8-bb46cccb97d6
Processing instance: uuid00286c9b-9c04-43ac-bf2e-70617bc15d68

Processing instance: uuid0037c162-22ca-46db-b0fe-b7a244365b0a
Submission not found for instance directory: C:\Users\jason\Documents\ODK Briefcase Storage\forms\Test and Treat Survey\instances\uuid00498801-2432-43aa-a941-ca5e2165637e

FAILED!
and the process fails.
Any tips about how to fix/work around this?
Regards,
Jason

--

--

Post: opend...@googlegroups.com

Unsubscribe: opendatakit...@googlegroups.com

Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to the Google Groups "ODK Community" group.

To unsubscribe from this group and stop receiving emails from it, send an email to opendatakit...@googlegroups.com.

For more options, visit https://groups.google.com/groups/opt_out.

--
Mitch Sundt
Software Engineer
University of Washington
mitche...@gmail.com

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to the Google Groups "ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Thanks for your response, Yaw. I delete the .ini file and had no more
problems.

Cheers!

··· On Sun, Mar 16, 2014 at 1:00 PM, Yaw Anokwa wrote:

Hi Kat,

You'll know the form is encrypted in Aggregate because there will be
nonsense text in the submissions page (see attached). If it is
encrypted you'll need to get the private key from whomever uploaded
that blank form.

As far as your Briefcase issues, first, make sure you are using the
latest version (v1.4). Then try going into C:\Users...\ODK\ODK
Briefcase Storage\forms\sample\instances and removing desktop.ini and
see if that helps.

You can also try uploading and filling out a test form on the server
to see if you can get that to work.

Yaw

Need ODK services? http://nafundi.com provides form design, server
setup, professional support, and software development for ODK.

On Fri, Mar 14, 2014 at 5:33 PM, kdiaz@tns.org wrote:

Hi, I've had a similar problem. I've pulled data from Aggregate but when
I try to export I got this message:

Starting Export...
Submission not found for instance directory: C:\Users...\ODK\ODK
Briefcase Storage\forms\sample\instances\desktop.ini
FAILED!

I don't know if the data is encrypted--upload and download is password
protected (no anonymous submissions) but I don't think that makes it
encrypted.

Any recommendations would be a huge help, thanks!

Kat

On Tuesday, August 20, 2013 12:04:20 PM UTC-6, Mitch Sundt wrote:

yes, that should be recoverable.

If you can send code changes to fix these two issues, I can apply them
to the main code tree.

Mitch

On Tue, Aug 13, 2013 at 12:02 AM, Jason Pickering < jason.p....@gmail.com> wrote:

It looks like there are a few problems here.

  1. Some submissions are invalid, but are recorded in the smallSQL
    database. Typically, they seem to be missing the encrypted file. This
    throws the "Submission not found for instance directory" error. I managed
    to write a script to get rid of these instances and delete them from the
    database, so, one problem solved maybe, but ...
  1. After a couple of dozen records are processed, this error occurs,
    which would not seem to be fatal, but the process fails.

Unable to remove decrypted files: Unable to delete directory
C:\Users\jason\Documents\ODK Briefcase Storage\forms\Test and Treat
Survey\instances\uuid03ce1992-ae6f-415f-831d-0b52d448db15\temp.

On Monday, August 12, 2013 9:56:42 PM UTC+2, Jason Pickering wrote:

After managing to replicate my server to a local machine, I was able to
export all submissions. However, I am not getting this error.

Error decrypting submission uuid0205bf60-6069-4627-a5e9-c59c8ebcbcac
Cause: org.opendatakit.briefcase.model.ParsingException: Missing one or
more required elements of encrypted form.

Browsing through the source code of briefcase, it seems to be extremely
strict in terms of errors. If anything goes wrong, the entire process
fails. Anyway, to skip over these sorts of errors instead?

Regards,
Jason

On Monday, August 12, 2013 1:45:50 PM UTC+2, Jason Pickering wrote:
Running briefcase 1.3.2. Upon exporting some submissions which have
been downloaded from the server, I run into this.

Starting Export...
Processing instance: uuid0000697b-b3e3-4b3a-9c16-6051954153f7
Processing instance: uuid00040176-dd58-4d28-ae71-c19b558ad96e

Processing instance: uuid000e9ace-bca7-4dde-9585-576db16ab4aa
Processing instance: uuid001a8cc0-7298-43ed-a0f0-890fe4dc79f1
Processing instance: uuid0021883a-cf92-43c9-b7b8-bb46cccb97d6
Processing instance: uuid00286c9b-9c04-43ac-bf2e-70617bc15d68

Processing instance: uuid0037c162-22ca-46db-b0fe-b7a244365b0a
Submission not found for instance directory:
C:\Users\jason\Documents\ODK Briefcase Storage\forms\Test and Treat
Survey\instances\uuid00498801-2432-43aa-a941-ca5e2165637e

FAILED!
and the process fails.
Any tips about how to fix/work around this?
Regards,
Jason

--

--

Post: opend...@googlegroups.com

Unsubscribe: opendatakit...@googlegroups.com

Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to the Google
Groups "ODK Community" group.

To unsubscribe from this group and stop receiving emails from it, send
an email to opendatakit...@googlegroups.com.

For more options, visit https://groups.google.com/groups/opt_out.

--
Mitch Sundt
Software Engineer
University of Washington
mitche...@gmail.com

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to the Google
Groups "ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to a topic in the
Google Groups "ODK Community" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/opendatakit/H0YBi2MIk8A/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
KATE SCAIFE DIAZ
Monitoring and Evaluation Manager, LAC | TechnoServe
kdiaz@tns.org | Skype: kmscaife

Km. 8.5 Carretera Sur, Nejapa | Entrada Reparto Puerta de Hierro. Casa #2 |
Managua, Nicaragua
Teléfono +505 2271 3369 | Fax +505 2271 3370 | *Celular *+505 8181
4116 or +1 (202) 455-8405

BUSINESS SOLUTIONS TO POVERTY