Failed download records .zip folder from project submission page

@LN I'm getting the same issue, hitting export zip opens a new tab, but then does nothing.

Details:

  • self-hosted ODK Central, K8s on Azure, v0.6 (this setup Installing ODK central in microsoft azure cloud - #2 by Florian_May)
  • installation has known problem with sending emails vs SSL certificates, working on it
  • Some forms download fine as zip: one zip comes with 17 submissions and attachments at 9MB, another one has 7 submissions and no attachments at 2kB
  • Some forms do not download: one form with 127 submissions with photos, another form with 75 submissions without photos
  • Our forms will grow over the now starting field season to ca 12k submissions with ca 200GB of attachments. We will access the submissions via OData to ingest incrementally into our data warehouse.
  • on export zip, no memory spike in backend
  • form has 75 submissions, no attachments
  • new tab "blank.html" opens, nothing happens for ca 60 seconds, no network requests I can see through Firefox console other than "blank.html", certainly not the URL ending in .zip
    Download started at 7:22am local time:

There's some more profiling I need to do on my end.
Using ruODK I can access the 75 records via the OData API within a second or so.
Using ruODK's submission export to zip, I'm also getting an error:

> ruODK::submission_export()
Error in curl::curl_fetch_disk(url, x$path, handle = handle) : 
  transfer closed with outstanding read data remaining

But running ruODK's test suite which is using the ODK Central sandbox, the zip export works fine. So my installation is what we call in expert programmer-dad-joke circles "nginxed".

All I can contribute here is that I'm not maxing out on RAM or any other server metric, and I can access the data fine via the OData API.