Rows skipped when pulling with ODK briefcase

Hi, dear all.
for a given table, when I pull data (from Aggregate server) using odk
briefcase, i get N1 rows; but when i publish the same data to google spread
sheet, i get more than N1 rows.
I would like to understand why.
In advance, thanks for your help.
regards

Hi Amal,

Curious. You'll have to do some detective before we can help. Compare
the instanceIDs from Briefcase to those of Google Spreadsheets. Do you
see a pattern in the ones that are missing? Does this happen with one
form or multiple forms? Do you get a different result when you export
to CSV on the server?

Yaw

··· -- Need ODK consultants? Nafundi provides form design, server setup, in-field training, and software development for ODK. Go to https://nafundi.com to get started.

On Sat, Aug 20, 2016 at 6:24 PM, Amal altessedac@gmail.com wrote:

Hi, dear all.
for a given table, when I pull data (from Aggregate server) using odk
briefcase, i get N1 rows; but when i publish the same data to google spread
sheet, i get more than N1 rows.
I would like to understand why.
In advance, thanks for your help.
regards

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to the Google Groups
"ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Thanks, Yaw.
20 out of 9429 forms were omitted; I did not try to export to csv on the
server (because, with google spread sheet, I've get the expected numbers of
rows).
About ' pattern', I don't understand well what you are meaning.
Again, thanks for your reply
Regards.

··· Le lundi 22 août 2016 16:08:27 UTC+2, Yaw Anokwa a écrit : > > Hi Amal, > > Curious. You'll have to do some detective before we can help. Compare > the instanceIDs from Briefcase to those of Google Spreadsheets. Do you > see a pattern in the ones that are missing? Does this happen with one > form or multiple forms? Do you get a different result when you export > to CSV on the server? > > Yaw > -- > Need ODK consultants? Nafundi provides form design, server setup, > in-field training, and software development for ODK. Go to > https://nafundi.com to get started. > > On Sat, Aug 20, 2016 at 6:24 PM, Amal <altes...@gmail.com > wrote: > > Hi, dear all. > > for a given table, when I pull data (from Aggregate server) using odk > > briefcase, i get N1 rows; but when i publish the same data to google > spread > > sheet, i get more than N1 rows. > > I would like to understand why. > > In advance, thanks for your help. > > regards > > > > -- > > -- > > Post: opend...@googlegroups.com > > Unsubscribe: opendatakit...@googlegroups.com > > Options: http://groups.google.com/group/opendatakit?hl=en > > > > --- > > You received this message because you are subscribed to the Google > Groups > > "ODK Community" group. > > To unsubscribe from this group and stop receiving emails from it, send > an > > email to opendatakit...@googlegroups.com . > > For more options, visit https://groups.google.com/d/optout. >

Hi Amal,

In order to figure out why 20 forms are not being exported, you need
to try various forms of export (Spreadsheets, Aggregate CSV, Aggregate
Briefcase) to see if the 20 that are missing are the same. The
differences between those versions will help determine where the
problem is.

Yaw

··· -- Need ODK consultants? Nafundi provides form design, server setup, in-field training, and software development for ODK. Go to https://nafundi.com to get started.

On Mon, Aug 22, 2016 at 11:20 PM, Amal altessedac@gmail.com wrote:

Thanks, Yaw.
20 out of 9429 forms were omitted; I did not try to export to csv on the
server (because, with google spread sheet, I've get the expected numbers of
rows).
About ' pattern', I don't understand well what you are meaning.
Again, thanks for your reply
Regards.

Le lundi 22 août 2016 16:08:27 UTC+2, Yaw Anokwa a écrit :

Hi Amal,

Curious. You'll have to do some detective before we can help. Compare
the instanceIDs from Briefcase to those of Google Spreadsheets. Do you
see a pattern in the ones that are missing? Does this happen with one
form or multiple forms? Do you get a different result when you export
to CSV on the server?

Yaw

Need ODK consultants? Nafundi provides form design, server setup,
in-field training, and software development for ODK. Go to
https://nafundi.com to get started.

On Sat, Aug 20, 2016 at 6:24 PM, Amal altes...@gmail.com wrote:

Hi, dear all.
for a given table, when I pull data (from Aggregate server) using odk
briefcase, i get N1 rows; but when i publish the same data to google
spread
sheet, i get more than N1 rows.
I would like to understand why.
In advance, thanks for your help.
regards

--

Post: opend...@googlegroups.com
Unsubscribe: opendatakit...@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to the Google
Groups
"ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send
an
email to opendatakit...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to the Google Groups
"ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

All Publishers can generate duplicates of a given submission.

This can happen if Google is slow responding to a Sheets row-insertion
request. It might complete the request, but ODK Aggregate's request might
time-out (and disconnect before getting a "Success" response), causing it
to think that the request failed and never happened. When ODK Aggregate
next tries to publish, it will re-publish the same data row to Google, and
will continue to re-publish that row, until it succeeds.

On Google Sheets (or Fusion Tables or any of the other publisher targets),
you should look for duplicate rows and remove the duplicates.

For Google Sheets:
order the dataset by the *metainstanceid *column.
Look for duplicate values in that column. Remove the duplicated row.

For Google Fusion Tables:
order the dataset by the meta-instance-id column.
Look for duplicate values in that column. Remove the duplicated row.

··· On Mon, Aug 29, 2016 at 3:55 AM, Yaw Anokwa wrote:

Hi Amal,

In order to figure out why 20 forms are not being exported, you need
to try various forms of export (Spreadsheets, Aggregate CSV, Aggregate
Briefcase) to see if the 20 that are missing are the same. The
differences between those versions will help determine where the
problem is.

Yaw

Need ODK consultants? Nafundi provides form design, server setup,
in-field training, and software development for ODK. Go to
https://nafundi.com to get started.

On Mon, Aug 22, 2016 at 11:20 PM, Amal altessedac@gmail.com wrote:

Thanks, Yaw.
20 out of 9429 forms were omitted; I did not try to export to csv on the
server (because, with google spread sheet, I've get the expected numbers
of
rows).
About ' pattern', I don't understand well what you are meaning.
Again, thanks for your reply
Regards.

Le lundi 22 août 2016 16:08:27 UTC+2, Yaw Anokwa a écrit :

Hi Amal,

Curious. You'll have to do some detective before we can help. Compare
the instanceIDs from Briefcase to those of Google Spreadsheets. Do you
see a pattern in the ones that are missing? Does this happen with one
form or multiple forms? Do you get a different result when you export
to CSV on the server?

Yaw

Need ODK consultants? Nafundi provides form design, server setup,
in-field training, and software development for ODK. Go to
https://nafundi.com to get started.

On Sat, Aug 20, 2016 at 6:24 PM, Amal altes...@gmail.com wrote:

Hi, dear all.
for a given table, when I pull data (from Aggregate server) using odk
briefcase, i get N1 rows; but when i publish the same data to google
spread
sheet, i get more than N1 rows.
I would like to understand why.
In advance, thanks for your help.
regards

--

Post: opend...@googlegroups.com
Unsubscribe: opendatakit...@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to the Google
Groups
"ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send
an
email to opendatakit...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to the Google Groups
"ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to the Google Groups
"ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
Mitch Sundt
Software Engineer
University of Washington
mitchellsundt@gmail.com

Mitch, many thanks for those precisions .
Regards,

··· Le mercredi 7 septembre 2016 21:00:07 UTC+2, Mitch Sundt a écrit : > > *All Publishers can generate duplicates of a given submission.* > > This can happen if Google is slow responding to a Sheets row-insertion > request. It might complete the request, but ODK Aggregate's request might > time-out (and disconnect before getting a "Success" response), causing it > to think that the request failed and never happened. When ODK Aggregate > next tries to publish, it will re-publish the same data row to Google, and > will continue to re-publish that row, until it succeeds. > > On Google Sheets (or Fusion Tables or any of the other publisher targets), > you should look for duplicate rows and remove the duplicates. > > For Google Sheets: > order the dataset by the *metainstanceid *column. > Look for duplicate values in that column. Remove the duplicated row. > > For Google Fusion Tables: > order the dataset by the **meta-instance-id** column. > Look for duplicate values in that column. Remove the duplicated row. > > > > On Mon, Aug 29, 2016 at 3:55 AM, Yaw Anokwa <yan...@nafundi.com > wrote: > >> Hi Amal, >> >> In order to figure out why 20 forms are not being exported, you need >> to try various forms of export (Spreadsheets, Aggregate CSV, Aggregate >> Briefcase) to see if the 20 that are missing are the same. The >> differences between those versions will help determine where the >> problem is. >> >> Yaw >> -- >> Need ODK consultants? Nafundi provides form design, server setup, >> in-field training, and software development for ODK. Go to >> https://nafundi.com to get started. >> >> On Mon, Aug 22, 2016 at 11:20 PM, Amal <altes...@gmail.com > wrote: >> > Thanks, Yaw. >> > 20 out of 9429 forms were omitted; I did not try to export to csv on >> the >> > server (because, with google spread sheet, I've get the expected >> numbers of >> > rows). >> > About ' pattern', I don't understand well what you are meaning. >> > Again, thanks for your reply >> > Regards. >> > >> > Le lundi 22 août 2016 16:08:27 UTC+2, Yaw Anokwa a écrit : >> >> >> >> Hi Amal, >> >> >> >> Curious. You'll have to do some detective before we can help. Compare >> >> the instanceIDs from Briefcase to those of Google Spreadsheets. Do you >> >> see a pattern in the ones that are missing? Does this happen with one >> >> form or multiple forms? Do you get a different result when you export >> >> to CSV on the server? >> >> >> >> Yaw >> >> -- >> >> Need ODK consultants? Nafundi provides form design, server setup, >> >> in-field training, and software development for ODK. Go to >> >> https://nafundi.com to get started. >> >> >> >> On Sat, Aug 20, 2016 at 6:24 PM, Amal wrote: >> >> > Hi, dear all. >> >> > for a given table, when I pull data (from Aggregate server) using odk >> >> > briefcase, i get N1 rows; but when i publish the same data to google >> >> > spread >> >> > sheet, i get more than N1 rows. >> >> > I would like to understand why. >> >> > In advance, thanks for your help. >> >> > regards >> >> > >> >> > -- >> >> > -- >> >> > Post: opend...@googlegroups.com >> >> > Unsubscribe: opendatakit...@googlegroups.com >> >> > Options: http://groups.google.com/group/opendatakit?hl=en >> >> > >> >> > --- >> >> > You received this message because you are subscribed to the Google >> >> > Groups >> >> > "ODK Community" group. >> >> > To unsubscribe from this group and stop receiving emails from it, >> send >> >> > an >> >> > email to opendatakit...@googlegroups.com. >> >> > For more options, visit https://groups.google.com/d/optout. >> > >> > -- >> > -- >> > Post: opend...@googlegroups.com >> > Unsubscribe: opendatakit...@googlegroups.com >> > Options: http://groups.google.com/group/opendatakit?hl=en >> > >> > --- >> > You received this message because you are subscribed to the Google >> Groups >> > "ODK Community" group. >> > To unsubscribe from this group and stop receiving emails from it, send >> an >> > email to opendatakit...@googlegroups.com . >> > For more options, visit https://groups.google.com/d/optout. >> >> -- >> -- >> Post: opend...@googlegroups.com >> Unsubscribe: opendatakit...@googlegroups.com >> Options: http://groups.google.com/group/opendatakit?hl=en >> >> --- >> You received this message because you are subscribed to the Google Groups >> "ODK Community" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to opendatakit...@googlegroups.com . >> For more options, visit https://groups.google.com/d/optout. >> > > > > -- > Mitch Sundt > Software Engineer > University of Washington > mitche...@gmail.com >