Publish data to Google Fusion Tables

Dear Group,

I am currently testing the "publish to Google Fusion Tables" Function in
ODK Aggregate.

I have four surveys which I would like to publish the Fusion Tables.
Starting the publish process is very easy. Once started I am able to view
the progress in the FORM MANAGEMENT -> PUBLISHED DATA part of Aggregate.

My question is, how long does it take for data to be uploaded to Fusion
tables and will the STATUS change to completed once it has uploaded? I have
had varying experience with upload times and want to know what will and can
affect this time.

Many thanks and kind regards,
Wesley

··· -- Dr Wesley Roberts jwesroberts@gmail.com Cell: +27(0)83 5355 646 skype: roberts-w

If you have chosen any choice that includes 'Stream New Submission Data',
the STATUS will never change to COMPLETE. It will remain ACTIVE or, if the
credentials become invalid, will change to a button where you can click
"Refresh Credentials".

I'm making changes in this area due to upcoming changes in the
authentication procedures for Google app access, and will look into
exposing a field that indicates the uploaded-through submission time, and
not just the start time of the publisher. This should address your concern.

Publishing of data always proceeds from oldest to most recent. If you
exceed quota, publishing will resume within 12 minutes of midnight when the
quota resets. Publishing is capped at no more than 1 per second. This is
aggressive w.r.t. the limits Google Fusion Tables states:

  • Applications sending write operations to the Google Fusion Tables
    server will be most successful when they limit write requests to 30 per
    minute or less. Each insert, update, or delete request counts as a write
    request.

ODK Aggregate detects failures and then resumes the publishing
automatically, so it can handle errors from Fusion Tables. However, if
Fusion Tables is having a bad day, the aggressive sending of data by ODK
Aggregate will adversely affect the submission rate.

Publishing of incoming data should propagate through to Fusion Tables after
no more than 12 minutes from receipt. This is due to the time interval
between sweeps of a watchdog process that scans for not-yet-published
data. We had to set this to be a fairly long interval to keep the billing
costs of AppEngine fairly low.

··· -------- Mitch

On Wed, Dec 5, 2012 at 1:57 AM, Wesley Roberts jwesroberts@gmail.comwrote:

Dear Group,

I am currently testing the "publish to Google Fusion Tables" Function in
ODK Aggregate.

I have four surveys which I would like to publish the Fusion Tables.
Starting the publish process is very easy. Once started I am able to view
the progress in the FORM MANAGEMENT -> PUBLISHED DATA part of Aggregate.

My question is, how long does it take for data to be uploaded to Fusion
tables and will the STATUS change to completed once it has uploaded? I have
had varying experience with upload times and want to know what will and can
affect this time.

Many thanks and kind regards,
Wesley

--
Dr Wesley Roberts
jwesroberts@gmail.com
Cell: +27(0)83 5355 646
skype: roberts-w

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

--
Mitch Sundt
Software Engineer
University of Washington
mitchellsundt@gmail.com