ODK Aggregate Server stopped streaming new data to Fusion Table

Hi,

I have set up an ODK Aggregate Server 1.2.0 on a windows 2008 Server. I has
been working fine, since November 2012. All of the forms would publish to
fusion tables.

Now, I noticed that a form has stopped publishing to its fusion table. I
tried recreating the fusion by deleting it and re-publishing from the
Aggregate server, but I still don't get all of the records. It stops at
record 274.

Also, I tried to export the record, I got a timeout each time with this
message. "Failure - abandoned all retry attempts"...

Would appreciate your help. Thanks.

Raul M. Maano
IM Specialist
IOM Philippines

Fusion Tables is shutting down the old API that Aggregate used prior to v
1.3. The ODK team released Aggregate v1.3, two and half months ago to solve
the problem. Last week the ODK team released Aggregate v1.3.1 with improved
streaming capabilties to fusion tables as the new API was much slower so we
redesigned the system to do more batching.

I am including Mitch's email about how to fix your publishers when
upgrading; however, upgrade to the latest as it has improvements for Fusion
Tables. I am also including the latest message on the subject from FT team
further down.

Again please use v1.3.1 as we have included lots of improvements and fixes
for publishers.

Cheers,
Waylon

Mitch's email about v1.3

ยทยทยท ------------------------------------------------------------- ODK Aggregate 1.3.0 Production Release is now available for download.

This release breaks all publishers. See the release notes for recommended
upgrade steps.

http://code.google.com/p/opendatakit/wiki/AggregateReleaseNotes

In many small ways, this is a complete update to the publishing
capabilities of the server.

Significant fixes and features:

  • 3 new Alpha-stage publishers have been added - 1 *REDCap *compliant *XML
    *publisher, 2 *JSON *publishers. See Publisher
    Detailshttp://code.google.com/p/opendatakit/wiki/AggregateToJSonXmlREDCapPublishersfor
    information about the new publishers.
  • most links open a new tab, rather than switching you off the page.
    Added and enabled links for repeat groups in Fusion Tables publishers and
    for the Google Spreadsheet publisher.
  • The Fusion Tables publisher now automatically constructs a flattened
    view (left outer join) of the top-level table and the first repeat group in
    the table.
  • Added a 'Published Through' and an 'Owner' column to the 'Published
    Data' table to communicate the progress of the publisher and who is
    receiving the data (really, the initial owner).
  • issue 718 http://code.google.com/p/opendatakit/issues/detail?id=718,
    issue 730 http://code.google.com/p/opendatakit/issues/detail?id=730-
    some large forms cause table subdivision algorithm to fail, preventing
    the form from loading into ODK Aggregate. This change affects what
    tables are constructed and what they contain.
  • JSON file export - remove extra trailing comma from exported dataset
    (e.g., in repeat groups). Multiple-choice selects are now emitted as an
    array of string values.
  • forms are now listed alphabetically by title.
  • installer now supports migrated AppEngine instance (for Master-Slave
    -to- High-Replication Datastore migration).
  • webserver configuration has been revised to enable reference VM images
    to be constructed for, e.g., AWS deployments.
  • moved the periodic 'watchdog' worker to the UI thread, which should
    lead to a reduction in quota usage.
  • annual jar update and transition to OAuth 2.0 for all Google
    publishers (hence why they broke).

From Fusion Tables Team:


Hello Fusion Tables API Users,

If you are already using the Fusion Tables API
v1.0https://developers.google.com/fusiontables/docs/v1/getting_started,
you can stop reading now.

Nine months ago we
announcedhttps://groups.google.com/forum/?hl=en-US&fromgroups=#!forum/fusion-tables-api-announcethat
the SQL API was
deprecated and that existing applications should migrate to the new Fusion
Tables API v1.0 before the deprecated SQL API was shut down. To minimize
disruption to our users, we also
extendedhttps://groups.google.com/forum/?hl=en-US&fromgroups=#!topic/fusion-tables-api-announce/_U1U4x2yD9gthe
deprecation period.

After giving an additional three month grace period, we will now begin
shutting down the deprecated SQL API.

Starting this week, we will reduce the allowed number of queries per day to
the deprecated SQL API, and will continue reducing this number each week
until the API is shut down. The deprecated SQL API will be completely shut
down by May 1, 2013.

Please migrate to the new Fusion Tables API v1.0 as soon as possible to
avoid disruption to your application. Refer to the migration
guidehttps://developers.google.com/fusiontables/docs/v1/migration_guidefor
instructions.

Thank you for using the Fusion Tables API.

Sincerely,

The Fusion Tables Team*

On Mon, Apr 15, 2013 at 1:15 PM, Raul Maano simplyraul@gmail.com wrote:

Hi,

I have set up an ODK Aggregate Server 1.2.0 on a windows 2008 Server. I
has been working fine, since November 2012. All of the forms would publish
to fusion tables.

Now, I noticed that a form has stopped publishing to its fusion table. I
tried recreating the fusion by deleting it and re-publishing from the
Aggregate server, but I still don't get all of the records. It stops at
record 274.

Also, I tried to export the record, I got a timeout each time with this
message. "Failure - abandoned all retry attempts"...

Would appreciate your help. Thanks.

Raul M. Maano
IM Specialist
IOM Philippines

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to the Google Groups
"ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.