ODK Collect - error uploading sample form

Support
1

​

​Folks,

sorry to disturb your day. I'm sure you're tired of this by now.

I've done a lot of googling about this error. I've tried a lot of things.
Ok, let's go.

Preample - my setup

First, I'm running a VirtualBox VM with Slackware 14.2 - it's what I am
accustomed to.
I have

root@rad:~# java -version
java version "1.8.0_131"
Java(TM) SE Runtime Environment (build 1.8.0_131-b11)
Java HotSpot(TM) Client VM (build 25.131-b11, mixed mode)

I am running ODK Collect ver 1.5.1.apk on my Android tablet.
I am running ODK Aggregate v1.4.13 linux-installer.run on my Tomcat
server.
I used ODK Validate 1.4.9 for ODK Collect v1.4.9 and newer.jar to
validate my sample.xml.
I am running

apache-tomcat-8.5.14.

Sample form loaded onto ODKAggregate service

​

The Problem
This is what happens when I try to upload a sample form to the ODKAggregate
service

​
This is what happened when I tried to get a form from the ODKAggregate
service, so I had to resort to mounting the SD card over USB to get
sample.xml into /sdcard/odk/forms

​

How my Android tablet is setup for ODK CollectThese are the General
Settings on my Android device

https://mail.google.com/mail/u/0/?ui=2&ik=320ca2b7f2&view=fimg&th=15b9883d1925e01a&attid=0.0.3&disp=emb&realattid=ii_j1tp9n1l5_15b9749fa363aa41&attbid=ANGjdJ-5LnFWhkEDXuvNTUNNgp5Q4lIDsoGYADcEX-ME04z1t3TSMcK5pcgSUv7TASsIx5LKOjStyJm6gJrSz9uZEphHATZVtM5A3zyu3mIKmmh2oZp_yHkkx7X6DrU&sz=s0-l75&ats=1492915525252&rm=15b9883d1925e01a&zw

​

​
​

https://lh3.googleusercontent.com/-mf_QfAOX7j0/WPwX3klUhKI/AAAAAAAAAUc/o5jvPP7zrwUoOFZjt_EVFioLqdAkwKovgCLcB/s1600/ODKCollect-General-Settings-1.png

This is the actual sample form (which loads ok from /sdcard/odk/forms)

​
I ran ODKValidate on the sample form, just to be sure

​
My log,* /opt/tomcat/logs/localhost_acc**ess_log.2017-04-22.txt* has this
everytime I try to upload the sample form.

    • [22/Apr/2017:19:58:18 -0400] "HEAD
      /submission?deviceID=android_id%3Ae3437b61f5790a0d HTTP/1.1" 404 -
    • [22/Apr/2017:19:58:18 -0400] "POST
      /submission?deviceID=android_id%3Ae3437b61f5790a0d HTTP/1.1" 404 1080

Sadly, I know nothing about java. Yes, my fault. But, I cannot find
"submission" anywhere in the entire filesystem, so I'm assuming this is a
method being called somehow by java to process the deviceID for some
reason.

These are the Android device settings.

​

​
Not an expert with tcpdump, but I tried so a couple of packet capture files
are attached.

I ran

tcpdump "dst port 8080" -w /tmp/my.dump
tcpdump -w /tmp/my.dump4

I ran these while attempting to upload the sample form to my ODKAggregate
server.

NB: at that time, I changed the General Settings from
http://lightpole512.ddns.net:8080 to http://192.168.100.10:8080 to avoid
any DNS issues. (Tearing my hair out here) That didn't change anything.

I've attempted to access the URL from the error message in my desktop
browser with the following result :-

​
When I use the Android tablet's browser to access the same URL, I get a
similar result :-

​
When I connect the Android tablet via USB to my PC, and copy
/odk/instances/* to my PC, I can then upload the finalised sample form &
its data files to my ODKAggregate service. The forms loaded properly and
can even be graphed. Recordings play back correctly, etc.

So, my problem is in uploading the finalised form to my ODKAggregate
service using the ODK Collect Send Selected button.

Can anyone point me in the right direction, please?

Thanks,

Seth

image
image800×480 16.5 KB

my.dump (2.81 KB)

sample.xml (25.7 KB)

image
image1146×344 33.7 KB

image
image887×748 32.2 KB

2

For some unknown reasons, all my carefully prepared screenshots disappeared
point out what I am doing wrong.

Thanks,

Seth

image
image1146×344 33.7 KB

image
image887×748 32.2 KB

image
image800×480 16.5 KB

image
image800×480 28.6 KB

image
image744×229 13.7 KB

image
image800×480 43.4 KB

image
image800×480 48.6 KB

image
image825×723 9.93 KB

image
image800×480 29.9 KB

image
image800×480 25 KB

image
image800×480 24.1 KB

image
image800×480 22.2 KB

image
image1278×227 31.8 KB

image
image1261×681 67.6 KB

image
image1279×945 86.2 KB

··· from my post, so I'm attaching them to this post, hoping that someone can
3

So, this morning, I found another interesting thing.

In the Site Admin section of the ODKAggregate service, there is a link to download Download current UsersAndCapabilities.csv.

This link points to http://lightpole512.ddns.net:8080/ODKAggregate/ssl/get-users-and-permissions.

Now, clicking on the link works. It produces a file called UsersAndCapabilities.csv, which can be opened into a spreadsheet.

That tells me at least that part of the ODKAggregate service is working.

I checked the filesystem. There is no folder called "ssl", so this also is something being generated by java.

I can't believe I'm going to have to learn java to get this working.

Is there ANYONE on this list who can point me in the right direction? I am not asking you to solve it for me. I just need a way to go.

Yaw?

Mitch?

Anyone?

Please,

Seth

··· On Saturday, 22 April 2017 22:58:30 UTC-4, Seth Brown wrote: > ​ > > ​Folks, > > > sorry to disturb your day. I'm sure you're tired of this by now. > > > I've done a lot of googling about this error. I've tried a lot of things. Ok, let's go. > > Preample - my setup > > > First, I'm running a VirtualBox VM with Slackware 14.2 - it's what I am accustomed to. > I have > > root@rad:~# java -version > java version "1.8.0_131" > Java(TM) SE Runtime Environment (build 1.8.0_131-b11) > Java HotSpot(TM) Client VM (build 25.131-b11, mixed mode) > > > > I am running ODK Collect ver 1.5.1.apk on my Android tablet. > > I am running ODK Aggregate v1.4.13 linux-installer.run on my Tomcat server. > > I used ODK Validate 1.4.9 for ODK Collect v1.4.9 and newer.jar to validate my sample.xml. > > I am running apache-tomcat-8.5.14. > > > > > > > > > > Sample form loaded onto ODKAggregate service > > > > ​ > The Problem > > > > This is what happens when I try to upload a sample form to the ODKAggregate service > > > > ​ > This > is what happened when I tried to get a form from the ODKAggregate > service, so I had to resort to mounting the SD card over USB to get sample.xml into /sdcard/odk/forms > > > > > ​ > How my Android tablet is setup for ODK Collect > > These are the General Settings on my Android device > > > > > > ​ > > ​ > ​ > > > > > > > > > > > > > > > > > > > This is the actual sample form (which loads ok from /sdcard/odk/forms) > > > ​ > > I ran ODKValidate on the sample form, just to be sure > > > ​ > My log, /opt/tomcat/logs/localhost_access_log.2017-04-22.txt has this everytime I try to upload the sample form. > > - - [22/Apr/2017:19:58:18 -0400] "HEAD /submission?deviceID=android_id%3Ae3437b61f5790a0d HTTP/1.1" 404 - > - - [22/Apr/2017:19:58:18 -0400] "POST /submission?deviceID=android_id%3Ae3437b61f5790a0d HTTP/1.1" 404 1080 > > > Sadly, > I know nothing about java. Yes, my fault. But, I cannot find > "submission" anywhere in the entire filesystem, so I'm assuming this is a > method being called somehow by java to process the deviceID for some > reason. > > > > These are the Android device settings. > > > ​ > > ​ > > Not an expert with tcpdump, but I tried so a couple of packet capture files are attached. > > I ran > > > tcpdump "dst port 8080" -w /tmp/my.dumptcpdump -w /tmp/my.dump4 > > > I ran these while attempting to upload the sample form to my ODKAggregate server. > > > NB: at that time, I changed the General Settings from http://lightpole512.ddns.net:8080 to http://192.168.100.10:8080 to avoid any DNS issues. (Tearing my hair out here) That didn't change anything. > > > > I've attempted to access the URL from the error message in my desktop browser with the following result :- > > > ​ > When I use the Android tablet's browser to access the same URL, I get a similar result :- > > > ​ > When I connect the Android tablet via USB to my PC, and copy /odk/instances/* to my PC, I can then upload the finalised sample form & its data files to my ODKAggregate service. The forms loaded properly and can even be graphed. Recordings play back correctly, etc. > > So, my problem is in uploading the finalised form to my ODKAggregate service using the ODK Collect Send Selected button. > > Can anyone point me in the right direction, please? > > Thanks, > > Seth
4

Hi Seth,

Welcome to the ODK community!

Your Aggregate server lives at http://lightpole512.ddns.net:
8080/ODKAggregate/. You've configured Collect to point to
http://lightpole512.ddns.net:8080 (note you are missing ODK Aggregate).

Once you fix that, there'll likely still be problems. When you installed
Aggregate, it asked you for the globally accessible URL. If you used the
192 address, you should re-run the installer and put the DynDNS address.

Thanks,

Yaw

For some unknown reasons, all my carefully prepared screenshots
disappeared

··· On Sat, Apr 22, 2017 at 8:05 PM, Seth Brown wrote: > from my post, so I'm attaching them to this post, hoping that someone can > point out what I am doing wrong. > > Thanks, > > Seth > > -- > -- > Post: opendatakit@googlegroups.com > Unsubscribe: opendatakit+unsubscribe@googlegroups.com > Options: http://groups.google.com/group/opendatakit?hl=en > > --- > You received this message because you are subscribed to the Google Groups > "ODK Community" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to opendatakit+unsubscribe@googlegroups.com. > For more options, visit https://groups.google.com/d/optout.
5

Yaw, thank you!

Ok, that change fixed it. I can now pull down my sample form.
As soon as I fixed this benighted piece of Android crap, I will try
uploading a data form.
Thank you, sir! You are a gent.

Seth.

Richard Hamel-Smith
bmobile: 1 868 763 2049
email: richardhamelsmith@gmail.com

··· On 24 April 2017 at 11:49, Yaw Anokwa wrote:

Hi Seth,

Welcome to the ODK community!

Your Aggregate server lives at http://lightpole512.ddns.net:8
080/ODKAggregate/. You've configured Collect to point to
http://lightpole512.ddns.net:8080 (note you are missing ODK Aggregate).

Once you fix that, there'll likely still be problems. When you installed
Aggregate, it asked you for the globally accessible URL. If you used the
192 address, you should re-run the installer and put the DynDNS address.

Thanks,

Yaw

On Sat, Apr 22, 2017 at 8:05 PM, Seth Brown lopinot.unplugged@gmail.com wrote:

For some unknown reasons, all my carefully prepared screenshots
disappeared
from my post, so I'm attaching them to this post, hoping that someone can
point out what I am doing wrong.

Thanks,

Seth

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

You received this message because you are subscribed to the Google Groups
"ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

You received this message because you are subscribed to a topic in the
Google Groups "ODK Community" group.
To unsubscribe from this topic, visit https://groups.google.com/d/
topic/opendatakit/GxSN23Oa9_Y/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

6

Seth,

Glad everything is working on the Aggregate side! Good luck with the
benighted crap :slight_smile:

Yaw

··· On Mon, Apr 24, 2017 at 2:42 PM, Richard Hamel-Smith wrote: > Yaw, thank you! > > Ok, that change fixed it. I can now pull down my sample form. > As soon as I fixed this benighted piece of Android crap, I will try > uploading a data form. > Thank you, sir! You are a gent. > > Seth. > > Richard Hamel-Smith > bmobile: 1 868 763 2049 > email: richardhamelsmith@gmail.com > > > > On 24 April 2017 at 11:49, Yaw Anokwa wrote: >> >> Hi Seth, >> >> Welcome to the ODK community! >> >> Your Aggregate server lives at >> http://lightpole512.ddns.net:8080/ODKAggregate/. You've configured Collect >> to point to http://lightpole512.ddns.net:8080 (note you are missing ODK >> Aggregate). >> >> Once you fix that, there'll likely still be problems. When you installed >> Aggregate, it asked you for the globally accessible URL. If you used the 192 >> address, you should re-run the installer and put the DynDNS address. >> >> Thanks, >> >> Yaw >> >> >> On Sat, Apr 22, 2017 at 8:05 PM, Seth Brown wrote: >> > For some unknown reasons, all my carefully prepared screenshots >> > disappeared >> > from my post, so I'm attaching them to this post, hoping that someone >> > can >> > point out what I am doing wrong. >> > >> > Thanks, >> > >> > Seth >> > >> > -- >> > -- >> > Post: opendatakit@googlegroups.com >> > Unsubscribe: opendatakit+unsubscribe@googlegroups.com >> > Options: http://groups.google.com/group/opendatakit?hl=en >> > >> > --- >> > You received this message because you are subscribed to the Google >> > Groups >> > "ODK Community" group. >> > To unsubscribe from this group and stop receiving emails from it, send >> > an >> > email to opendatakit+unsubscribe@googlegroups.com. >> > For more options, visit https://groups.google.com/d/optout. >> >> -- >> -- >> Post: opendatakit@googlegroups.com >> Unsubscribe: opendatakit+unsubscribe@googlegroups.com >> Options: http://groups.google.com/group/opendatakit?hl=en >> >> --- >> You received this message because you are subscribed to a topic in the >> Google Groups "ODK Community" group. >> To unsubscribe from this topic, visit >> https://groups.google.com/d/topic/opendatakit/GxSN23Oa9_Y/unsubscribe. >> To unsubscribe from this group and all its topics, send an email to >> opendatakit+unsubscribe@googlegroups.com. >> For more options, visit https://groups.google.com/d/optout. > > > -- > -- > Post: opendatakit@googlegroups.com > Unsubscribe: opendatakit+unsubscribe@googlegroups.com > Options: http://groups.google.com/group/opendatakit?hl=en > > --- > You received this message because you are subscribed to the Google Groups > "ODK Community" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to opendatakit+unsubscribe@googlegroups.com. > For more options, visit https://groups.google.com/d/optout.
7

Yes! I just wipe he back to beaded glass as the man say.
We cooking with gas now!

Thanks again,

Seth

··· On Mon, Apr 24, 2017 at 8:32 PM, Yaw Anokwa wrote:

Seth,

Glad everything is working on the Aggregate side! Good luck with the
benighted crap :slight_smile:

Yaw

On Mon, Apr 24, 2017 at 2:42 PM, Richard Hamel-Smith richardhamelsmith@gmail.com wrote:

Yaw, thank you!

Ok, that change fixed it. I can now pull down my sample form.
As soon as I fixed this benighted piece of Android crap, I will try
uploading a data form.
Thank you, sir! You are a gent.

Seth.

Richard Hamel-Smith
bmobile: 1 868 763 2049
email: richardhamelsmith@gmail.com

On 24 April 2017 at 11:49, Yaw Anokwa yanokwa@nafundi.com wrote:

Hi Seth,

Welcome to the ODK community!

Your Aggregate server lives at
http://lightpole512.ddns.net:8080/ODKAggregate/. You've configured
Collect
to point to http://lightpole512.ddns.net:8080 (note you are missing ODK
Aggregate).

Once you fix that, there'll likely still be problems. When you installed
Aggregate, it asked you for the globally accessible URL. If you used
the 192
address, you should re-run the installer and put the DynDNS address.

Thanks,

Yaw

On Sat, Apr 22, 2017 at 8:05 PM, Seth Brown < lopinot.unplugged@gmail.com> wrote:

For some unknown reasons, all my carefully prepared screenshots
disappeared
from my post, so I'm attaching them to this post, hoping that someone
can
point out what I am doing wrong.

Thanks,

Seth

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

You received this message because you are subscribed to the Google
Groups
"ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send
an
email to opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

You received this message because you are subscribed to a topic in the
Google Groups "ODK Community" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/opendatakit/GxSN23Oa9_Y/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

You received this message because you are subscribed to the Google Groups
"ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

You received this message because you are subscribed to a topic in the
Google Groups "ODK Community" group.
To unsubscribe from this topic, visit https://groups.google.com/d/
topic/opendatakit/GxSN23Oa9_Y/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.