Publish data to Google Fusion Tables

··· -- Dr Wesley Roberts

jwesroberts@gmail.com

Cell: 083 5355 646

Work: 021 - 888 2490

skype: roberts-w

Hi Mitch,

Following my original email, I removed several of the survey responses from
Aggregate and focused on four draft surveys which I have been using to test
our survey (inputting hard copy data into the survey). Yesterday I cleared
out my google drive and once again published the resulting surveys to
fusion tables stored on my GDrive. I opened it this morning and two of the
survey responses have indeed been uploaded to my GDrive however, one of the
surveys has been uploaded more than 6 times i.e. I have 8 uploaded surveys
with one survey being duplicated 7 times. This is a little unreliable right
now and I think the issue sits with me running a Free / non-billable
account. On the other hand ODK Briefcase does a very good job of
downloading the correct number of survey responses. I wanted to use Fusion
tables to facilitate easy joins / merges of the begin repeats I mentioned
earlier. I can accomplish what I want by uploading the ODK briefcase
exports to fusion tables and merging them there.

Our survey is being restructured today to have less begin repeats so the
merging of the data should not be too much of an issue in the future. For
now I will rather using the BRIEFCASE as opposed to publishing via ODK
Aggregate.

Another potential option is to export the data as a JSON file and import
into a RDBMS such as postgresql. This would be my first prize as I am
interested in automating the entire process from data collection to biomass
/ carbon quantification and finally mapping.

Many thanks,
Wesley

··· On Wednesday, December 5, 2012 11:49:36 AM UTC+2, Wes Roberts wrote: > > > > -- > Dr Wesley Roberts > jwesroberts@gmail.com > Cell: 083 5355 646 > Work: 021 - 888 2490 > skype: roberts-w >

If you eventually want to have the data in PostgreSQL, you might want to
install Aggregate on a local machine using PostgreSQL as the backing store,
set that up to be reachable from the internet, and bypass AppEngine
altogether. Requires more knowledge, and you'd be responsible for backing
up all your data.

You could then directly access the data tables that Aggregate manages from
whatever software you wanted to run. Aggregate splits everything into
columns with the appropriate data types, etc.

For extra isolation from Aggregate's data model, you could also set up
triggers to copy the data into tables of your own design.

Aggregate generally consistently and repeatedly names its tables (and
columns), but under certain circumstances may rename tables across form
delete / re-upload cycles.

Mitch

··· On Wed, Dec 5, 2012 at 10:25 PM, Wes Roberts wrote:

Hi Mitch,

Following my original email, I removed several of the survey responses
from Aggregate and focused on four draft surveys which I have been using to
test our survey (inputting hard copy data into the survey). Yesterday I
cleared out my google drive and once again published the resulting surveys
to fusion tables stored on my GDrive. I opened it this morning and two of
the survey responses have indeed been uploaded to my GDrive however, one of
the surveys has been uploaded more than 6 times i.e. I have 8 uploaded
surveys with one survey being duplicated 7 times. This is a little
unreliable right now and I think the issue sits with me running a Free /
non-billable account. On the other hand ODK Briefcase does a very good job
of downloading the correct number of survey responses. I wanted to use
Fusion tables to facilitate easy joins / merges of the begin repeats I
mentioned earlier. I can accomplish what I want by uploading the ODK
briefcase exports to fusion tables and merging them there.

Our survey is being restructured today to have less begin repeats so the
merging of the data should not be too much of an issue in the future. For
now I will rather using the BRIEFCASE as opposed to publishing via ODK
Aggregate.

Another potential option is to export the data as a JSON file and import
into a RDBMS such as postgresql. This would be my first prize as I am
interested in automating the entire process from data collection to biomass
/ carbon quantification and finally mapping.

Many thanks,
Wesley

On Wednesday, December 5, 2012 11:49:36 AM UTC+2, Wes Roberts wrote:

--
Dr Wesley Roberts
jwesroberts@gmail.com
Cell: 083 5355 646
Work: 021 - 888 2490
skype: roberts-w

--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

--
Mitch Sundt
Software Engineer
University of Washington
mitchellsundt@gmail.com