Publishing to Google Sheets or Fusion tables

Hi Guys,

I've posted a question on stack overflow here:

http://stackoverflow.com/questions/42781886/publishing-odk-submissions-to-google-fusion-tables-or-sheets

and thought I would repost here to see if anyone can help. The problem I'm
having is as follows (with solutions I've tried already):

I have ODK aggregate (version 1.4.13) set up on Google appspot and
everything is working apart from publishing submissions to Google fusion
tables or sheets. When trying to publish to fusion tables and entering my
email address (email@domain.com) I get a 400 error stating that ownership
cannot be transferred:

"Bad Request. User message: "Sorry, cannot transfer ownership to
email@domain.com. Ownership can only be transferred to another user in the
same domain as the current owner.""

Publishing to sheets throws no error but nor do any data or sheets appear
in G-Drive (I've also tried creating an empty target sheet in G-Drive first
to no avail). I have set up OAuth2 as per the instructions on the ODK site
https://opendatakit.org/use/aggregate/oauth2-service-account/.

So far I have tried

  • using the service account email address. No error messages appear but
    neither do any data.
  • Adding myself as an admin on the Aggregate settings page
    (email@domain.com)
  • Adding my domain (domain.com) as the owner of the service account on
    Google Cloud Platform
  • Adding the service account as owner of the project on GCP
  • Adding my email as owner of the project on GCP (domains are not
    allowed to own projects)
  • All permutations of the above

I think the problem may lie in the fact that my domain.com is a Google apps
account rather than a gmail.com account but I set up ODK aggregate with
domain.com as the owner of the appspot project from the get go.

As a work around I can probably fangle something up using ODK briefcase
instead but I would rather stream to fusion tables directly.

Update

The google maps API is key is working (i.e. I can use aggregate to
visualise records with geolocation).

I've also tried setting up an ODK project without assigning my domain.com
as the organisation from the outset. The same errors are given.

If you want to pursue this, you could open a support ticket with Google,
though I don't have much hope.

This is likely still broken within Google infrastructure.

In the past, the crux of the problem has been that the service account
credentials are strongly bound to gmail.com, and even though your Google
Cloud Platform account is created for a specific app domain, the service
account did not get created bound to that app domain, but always to
gmail.com.

That prevented transferring ownership of the Google Sheets or Google Fusion
Tables artifacts to your app domain account. Which prevents them from
seeing it.

If memory serves, there is a configuration setting under Google's app
domain settings that controls whether a @domain.com account can transfer
ownership to a @gmail.com account, but what you really need is to be able
to manage the inverse of that setting on your specific service account.

The last time I looked at this was 4+ years ago. Much has changed; if you
have the time, a support ticket might offer an answer.

Last time, the only way I could get an answer to this was to go to Google
I/O and pester the wizard bar, and then I had to come back 3 times before
meeting the person that could answer "no."

··· On Tue, Mar 14, 2017 at 5:15 AM, Oliver Burdekin <oliverburdekin@burdgis.com wrote:

Hi Guys,

I've posted a question on stack overflow here:

http://stackoverflow.com/questions/42781886/publishing-
odk-submissions-to-google-fusion-tables-or-sheets

and thought I would repost here to see if anyone can help. The problem I'm
having is as follows (with solutions I've tried already):

I have ODK aggregate (version 1.4.13) set up on Google appspot and
everything is working apart from publishing submissions to Google fusion
tables or sheets. When trying to publish to fusion tables and entering my
email address (email@domain.com) I get a 400 error stating that ownership
cannot be transferred:

"Bad Request. User message: "Sorry, cannot transfer ownership to
email@domain.com. Ownership can only be transferred to another user in
the same domain as the current owner.""

Publishing to sheets throws no error but nor do any data or sheets appear
in G-Drive (I've also tried creating an empty target sheet in G-Drive first
to no avail). I have set up OAuth2 as per the instructions on the ODK site
https://opendatakit.org/use/aggregate/oauth2-service-account/.

So far I have tried

  • using the service account email address. No error messages appear
    but neither do any data.
  • Adding myself as an admin on the Aggregate settings page (
    email@domain.com)
  • Adding my domain (domain.com) as the owner of the service account on
    Google Cloud Platform
  • Adding the service account as owner of the project on GCP
  • Adding my email as owner of the project on GCP (domains are not
    allowed to own projects)
  • All permutations of the above

I think the problem may lie in the fact that my domain.com is a Google
apps account rather than a gmail.com account but I set up ODK aggregate
with domain.com as the owner of the appspot project from the get go.

As a work around I can probably fangle something up using ODK briefcase
instead but I would rather stream to fusion tables directly.

Update

The google maps API is key is working (i.e. I can use aggregate to
visualise records with geolocation).

I've also tried setting up an ODK project without assigning my domain.com
as the organisation from the outset. The same errors are given.

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to the Google Groups
"ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
Mitch Sundt
Software Engineer
University of Washington
mitchellsundt@gmail.com

On the plus side, I did end up with a Pixel Chromebook.

··· On Tue, Mar 14, 2017 at 10:29 AM, Mitch Sundt wrote:

If you want to pursue this, you could open a support ticket with Google,
though I don't have much hope.

This is likely still broken within Google infrastructure.

In the past, the crux of the problem has been that the service account
credentials are strongly bound to gmail.com, and even though your Google
Cloud Platform account is created for a specific app domain, the service
account did not get created bound to that app domain, but always to
gmail.com.

That prevented transferring ownership of the Google Sheets or Google
Fusion Tables artifacts to your app domain account. Which prevents them
from seeing it.

If memory serves, there is a configuration setting under Google's app
domain settings that controls whether a @domain.com account can transfer
ownership to a @gmail.com account, but what you really need is to be able
to manage the inverse of that setting on your specific service account.

The last time I looked at this was 4+ years ago. Much has changed; if you
have the time, a support ticket might offer an answer.

Last time, the only way I could get an answer to this was to go to Google
I/O and pester the wizard bar, and then I had to come back 3 times before
meeting the person that could answer "no."

On Tue, Mar 14, 2017 at 5:15 AM, Oliver Burdekin < oliverburdekin@burdgis.com> wrote:

Hi Guys,

I've posted a question on stack overflow here:

http://stackoverflow.com/questions/42781886/publishing-odk-
submissions-to-google-fusion-tables-or-sheets

and thought I would repost here to see if anyone can help. The problem
I'm having is as follows (with solutions I've tried already):

I have ODK aggregate (version 1.4.13) set up on Google appspot and
everything is working apart from publishing submissions to Google fusion
tables or sheets. When trying to publish to fusion tables and entering my
email address (email@domain.com) I get a 400 error stating that
ownership cannot be transferred:

"Bad Request. User message: "Sorry, cannot transfer ownership to
email@domain.com. Ownership can only be transferred to another user in
the same domain as the current owner.""

Publishing to sheets throws no error but nor do any data or sheets appear
in G-Drive (I've also tried creating an empty target sheet in G-Drive first
to no avail). I have set up OAuth2 as per the instructions on the ODK
site https://opendatakit.org/use/aggregate/oauth2-service-account/.

So far I have tried

  • using the service account email address. No error messages appear
    but neither do any data.
  • Adding myself as an admin on the Aggregate settings page (
    email@domain.com)
  • Adding my domain (domain.com) as the owner of the service account
    on Google Cloud Platform
  • Adding the service account as owner of the project on GCP
  • Adding my email as owner of the project on GCP (domains are not
    allowed to own projects)
  • All permutations of the above

I think the problem may lie in the fact that my domain.com is a Google
apps account rather than a gmail.com account but I set up ODK aggregate
with domain.com as the owner of the appspot project from the get go.

As a work around I can probably fangle something up using ODK briefcase
instead but I would rather stream to fusion tables directly.

Update

The google maps API is key is working (i.e. I can use aggregate to
visualise records with geolocation).

I've also tried setting up an ODK project without assigning my domain.com
as the organisation from the outset. The same errors are given.

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to the Google Groups
"ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
Mitch Sundt
Software Engineer
University of Washington
mitchellsundt@gmail.com

--
Mitch Sundt
Software Engineer
University of Washington
mitchellsundt@gmail.com

Mitch, thanks so much for taking the time to respond. Your message made me
chuckle and it would appear every (Google) cloud has a silver lining (in
the form of a Pixel Chromebook). Although I'm not holding out much hope for
the latter.

Looks like I'll have to come up with some wizadry of my own (or maybe just
go to the bar).

Thanks again for your help and I'll repost any solutions I come up with.

Cheers,

Oliver

··· On Tuesday, March 14, 2017 at 5:31:31 PM UTC, Mitch Sundt wrote: > > On the plus side, I did end up with a Pixel Chromebook. > > On Tue, Mar 14, 2017 at 10:29 AM, Mitch Sundt <mitche...@gmail.com > wrote: > >> If you want to pursue this, you could open a support ticket with Google, >> though I don't have much hope. >> >> This is likely still broken within Google infrastructure. >> >> In the past, the crux of the problem has been that the service account >> credentials are strongly bound to gmail.com, and even though your Google >> Cloud Platform account is created for a specific app domain, the service >> account did not get created bound to that app domain, but always to >> gmail.com. >> >> That prevented transferring ownership of the Google Sheets or Google >> Fusion Tables artifacts to your app domain account. Which prevents them >> from seeing it. >> >> If memory serves, there is a configuration setting under Google's app >> domain settings that controls whether a @domain.com account can transfer >> ownership to a @gmail.com account, but what you really need is to be >> able to manage the inverse of that setting on your specific service account. >> >> The last time I looked at this was 4+ years ago. Much has changed; if you >> have the time, a support ticket might offer an answer. >> >> Last time, the only way I could get an answer to this was to go to Google >> I/O and pester the wizard bar, and then I had to come back 3 times before >> meeting the person that could answer "no." >> >> >> >> On Tue, Mar 14, 2017 at 5:15 AM, Oliver Burdekin <oliverb...@burdgis.com > wrote: >> >>> Hi Guys, >>> >>> I've posted a question on stack overflow here: >>> >>> >>> http://stackoverflow.com/questions/42781886/publishing-odk-submissions-to-google-fusion-tables-or-sheets >>> >>> and thought I would repost here to see if anyone can help. The problem >>> I'm having is as follows (with solutions I've tried already): >>> >>> I have ODK aggregate (version 1.4.13) set up on Google appspot and >>> everything is working apart from publishing submissions to Google fusion >>> tables or sheets. When trying to publish to fusion tables and entering my >>> email address (em...@domain.com ) I get a 400 error >>> stating that ownership cannot be transferred: >>> >>> >>> "Bad Request. User message: \"Sorry, cannot transfer ownership to >>> em...@domain.com . Ownership can only be transferred to >>> another user in the same domain as the current owner.\"" >>> >>> >>> Publishing to sheets throws no error but nor do any data or sheets >>> appear in G-Drive (I've also tried creating an empty target sheet in >>> G-Drive first to no avail). I have set up OAuth2 as per the instructions on >>> the ODK site >>> . >>> >>> So far I have tried >>> >>> - using the service account email address. No error messages appear >>> but neither do any data. >>> - Adding myself as an admin on the Aggregate settings page ( >>> em...@domain.com ) >>> - Adding my domain (domain.com) as the owner of the service account >>> on Google Cloud Platform >>> - Adding the service account as owner of the project on GCP >>> - Adding my email as owner of the project on GCP (domains are not >>> allowed to own projects) >>> - All permutations of the above >>> >>> I think the problem may lie in the fact that my domain.com is a Google >>> apps account rather than a gmail.com account but I set up ODK aggregate >>> with domain.com as the owner of the appspot project from the get go. >>> >>> >>> As a work around I can probably fangle something up using ODK briefcase >>> instead but I would rather stream to fusion tables directly. >>> >>> >>> *Update* >>> >>> The google maps API is key is working (i.e. I can use aggregate to >>> visualise records with geolocation). >>> >>> I've also tried setting up an ODK project without assigning my >>> domain.com as the organisation from the outset. The same errors are >>> given. >>> >>> -- >>> -- >>> Post: opend...@googlegroups.com >>> Unsubscribe: opendatakit...@googlegroups.com >>> Options: http://groups.google.com/group/opendatakit?hl=en >>> >>> --- >>> You received this message because you are subscribed to the Google >>> Groups "ODK Community" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to opendatakit...@googlegroups.com . >>> For more options, visit https://groups.google.com/d/optout. >>> >> >> >> >> -- >> Mitch Sundt >> Software Engineer >> University of Washington >> mitche...@gmail.com >> > > > > -- > Mitch Sundt > Software Engineer > University of Washington > mitche...@gmail.com >

And on the minus side I'm not on the free tier any more and tech support is
150 bucks per month. No silver linings here.

··· On Tuesday, March 14, 2017 at 5:55:32 PM UTC, Oliver Burdekin wrote: > > Mitch, thanks so much for taking the time to respond. Your message made me > chuckle and it would appear every (Google) cloud has a silver lining (in > the form of a Pixel Chromebook). Although I'm not holding out much hope for > the latter. > > Looks like I'll have to come up with some wizadry of my own (or maybe just > go to the bar). > > Thanks again for your help and I'll repost any solutions I come up with. > > Cheers, > > Oliver > > On Tuesday, March 14, 2017 at 5:31:31 PM UTC, Mitch Sundt wrote: >> >> On the plus side, I did end up with a Pixel Chromebook. >> >> On Tue, Mar 14, 2017 at 10:29 AM, Mitch Sundt wrote: >> >>> If you want to pursue this, you could open a support ticket with Google, >>> though I don't have much hope. >>> >>> This is likely still broken within Google infrastructure. >>> >>> In the past, the crux of the problem has been that the service account >>> credentials are strongly bound to gmail.com, and even though your >>> Google Cloud Platform account is created for a specific app domain, the >>> service account did not get created bound to that app domain, but always to >>> gmail.com. >>> >>> That prevented transferring ownership of the Google Sheets or Google >>> Fusion Tables artifacts to your app domain account. Which prevents them >>> from seeing it. >>> >>> If memory serves, there is a configuration setting under Google's app >>> domain settings that controls whether a @domain.com account can >>> transfer ownership to a @gmail.com account, but what you really need is >>> to be able to manage the inverse of that setting on your specific service >>> account. >>> >>> The last time I looked at this was 4+ years ago. Much has changed; if >>> you have the time, a support ticket might offer an answer. >>> >>> Last time, the only way I could get an answer to this was to go to >>> Google I/O and pester the wizard bar, and then I had to come back 3 times >>> before meeting the person that could answer "no." >>> >>> >>> >>> On Tue, Mar 14, 2017 at 5:15 AM, Oliver Burdekin >> >>>> Hi Guys, >>>> >>>> I've posted a question on stack overflow here: >>>> >>>> >>>> http://stackoverflow.com/questions/42781886/publishing-odk-submissions-to-google-fusion-tables-or-sheets >>>> >>>> and thought I would repost here to see if anyone can help. The problem >>>> I'm having is as follows (with solutions I've tried already): >>>> >>>> I have ODK aggregate (version 1.4.13) set up on Google appspot and >>>> everything is working apart from publishing submissions to Google fusion >>>> tables or sheets. When trying to publish to fusion tables and entering my >>>> email address (em...@domain.com) I get a 400 error stating that >>>> ownership cannot be transferred: >>>> >>>> >>>> "Bad Request. User message: \"Sorry, cannot transfer ownership to >>>> em...@domain.com. Ownership can only be transferred to another user in >>>> the same domain as the current owner.\"" >>>> >>>> >>>> Publishing to sheets throws no error but nor do any data or sheets >>>> appear in G-Drive (I've also tried creating an empty target sheet in >>>> G-Drive first to no avail). I have set up OAuth2 as per the instructions on >>>> the ODK site >>>> . >>>> >>>> So far I have tried >>>> >>>> - using the service account email address. No error messages appear >>>> but neither do any data. >>>> - Adding myself as an admin on the Aggregate settings page ( >>>> em...@domain.com) >>>> - Adding my domain (domain.com) as the owner of the service account >>>> on Google Cloud Platform >>>> - Adding the service account as owner of the project on GCP >>>> - Adding my email as owner of the project on GCP (domains are not >>>> allowed to own projects) >>>> - All permutations of the above >>>> >>>> I think the problem may lie in the fact that my domain.com is a Google >>>> apps account rather than a gmail.com account but I set up ODK >>>> aggregate with domain.com as the owner of the appspot project from the >>>> get go. >>>> >>>> >>>> As a work around I can probably fangle something up using ODK briefcase >>>> instead but I would rather stream to fusion tables directly. >>>> >>>> >>>> *Update* >>>> >>>> The google maps API is key is working (i.e. I can use aggregate to >>>> visualise records with geolocation). >>>> >>>> I've also tried setting up an ODK project without assigning my >>>> domain.com as the organisation from the outset. The same errors are >>>> given. >>>> >>>> -- >>>> -- >>>> Post: opend...@googlegroups.com >>>> Unsubscribe: opendatakit...@googlegroups.com >>>> Options: http://groups.google.com/group/opendatakit?hl=en >>>> >>>> --- >>>> You received this message because you are subscribed to the Google >>>> Groups "ODK Community" group. >>>> To unsubscribe from this group and stop receiving emails from it, send >>>> an email to opendatakit...@googlegroups.com. >>>> For more options, visit https://groups.google.com/d/optout. >>>> >>> >>> >>> >>> -- >>> Mitch Sundt >>> Software Engineer >>> University of Washington >>> mitche...@gmail.com >>> >> >> >> >> -- >> Mitch Sundt >> Software Engineer >> University of Washington >> mitche...@gmail.com >> >

If you do submit an issue, I'm curious to hear how responsive they are.

From a developers' standpoint, their issue tickets are file-and-forget.
And, at best, only useful as a warning to other developers.

https://issuetracker.google.com/issues/35885649

https://issuetracker.google.com/issues/35887589

Of course, opening issue tickets was free.

··· On Tue, Mar 14, 2017 at 10:59 AM, Oliver Burdekin < oliverburdekin@burdgis.com> wrote:

And on the minus side I'm not on the free tier any more and tech support
is 150 bucks per month. No silver linings here.

On Tuesday, March 14, 2017 at 5:55:32 PM UTC, Oliver Burdekin wrote:

Mitch, thanks so much for taking the time to respond. Your message made
me chuckle and it would appear every (Google) cloud has a silver lining (in
the form of a Pixel Chromebook). Although I'm not holding out much hope for
the latter.

Looks like I'll have to come up with some wizadry of my own (or maybe
just go to the bar).

Thanks again for your help and I'll repost any solutions I come up with.

Cheers,

Oliver

On Tuesday, March 14, 2017 at 5:31:31 PM UTC, Mitch Sundt wrote:

On the plus side, I did end up with a Pixel Chromebook.

On Tue, Mar 14, 2017 at 10:29 AM, Mitch Sundt mitche...@gmail.com wrote:

If you want to pursue this, you could open a support ticket with
Google, though I don't have much hope.

This is likely still broken within Google infrastructure.

In the past, the crux of the problem has been that the service account
credentials are strongly bound to gmail.com, and even though your
Google Cloud Platform account is created for a specific app domain, the
service account did not get created bound to that app domain, but always to
gmail.com.

That prevented transferring ownership of the Google Sheets or Google
Fusion Tables artifacts to your app domain account. Which prevents them
from seeing it.

If memory serves, there is a configuration setting under Google's app
domain settings that controls whether a @domain.com account can
transfer ownership to a @gmail.com account, but what you really need
is to be able to manage the inverse of that setting on your specific
service account.

The last time I looked at this was 4+ years ago. Much has changed; if
you have the time, a support ticket might offer an answer.

Last time, the only way I could get an answer to this was to go to
Google I/O and pester the wizard bar, and then I had to come back 3 times
before meeting the person that could answer "no."

On Tue, Mar 14, 2017 at 5:15 AM, Oliver Burdekin < oliverb...@burdgis.com> wrote:

Hi Guys,

I've posted a question on stack overflow here:

http://stackoverflow.com/questions/42781886/publishing-odk-s
ubmissions-to-google-fusion-tables-or-sheets

and thought I would repost here to see if anyone can help. The problem
I'm having is as follows (with solutions I've tried already):

I have ODK aggregate (version 1.4.13) set up on Google appspot and
everything is working apart from publishing submissions to Google fusion
tables or sheets. When trying to publish to fusion tables and entering my
email address (em...@domain.com) I get a 400 error stating that
ownership cannot be transferred:

"Bad Request. User message: "Sorry, cannot transfer ownership to
em...@domain.com. Ownership can only be transferred to another user
in the same domain as the current owner.""

Publishing to sheets throws no error but nor do any data or sheets
appear in G-Drive (I've also tried creating an empty target sheet in
G-Drive first to no avail). I have set up OAuth2 as per the instructions on
the ODK site
https://opendatakit.org/use/aggregate/oauth2-service-account/.

So far I have tried

  • using the service account email address. No error messages
    appear but neither do any data.
  • Adding myself as an admin on the Aggregate settings page (
    em...@domain.com)
  • Adding my domain (domain.com) as the owner of the service
    account on Google Cloud Platform
  • Adding the service account as owner of the project on GCP
  • Adding my email as owner of the project on GCP (domains are not
    allowed to own projects)
  • All permutations of the above

I think the problem may lie in the fact that my domain.com is a
Google apps account rather than a gmail.com account but I set up ODK
aggregate with domain.com as the owner of the appspot project from
the get go.

As a work around I can probably fangle something up using ODK
briefcase instead but I would rather stream to fusion tables directly.

Update

The google maps API is key is working (i.e. I can use aggregate to
visualise records with geolocation).

I've also tried setting up an ODK project without assigning my
domain.com as the organisation from the outset. The same errors are
given.

--

Post: opend...@googlegroups.com
Unsubscribe: opendatakit...@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to the Google
Groups "ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to opendatakit...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
Mitch Sundt
Software Engineer
University of Washington
mitche...@gmail.com

--
Mitch Sundt
Software Engineer
University of Washington
mitche...@gmail.com

--
--
Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to the Google Groups
"ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
Mitch Sundt
Software Engineer
University of Washington
mitchellsundt@gmail.com