No Aggregate just want to use http post request to send data on server

Hi,

I am planning to use Tomacat server with mysql as backend. How can I use
http post from Collect itself?

Useful notes from Collect says Like forms, data does not have to be sent to
Aggregate. You write an HTTP post to any web server or use an offline
processor like Kobo Post Processor http://www.kobotoolbox.org/. You can
also retrieve them from /odk/instances folder on your Android device's SD
card.

I want to use this HTTP Post. Does anybody have any idea How can I use the
same? After giving tomcat server url, Submit will automatically do http
post..right?
Am I doing wrong by bypassing Aggregate? I am not sure how much aggregate
can scale for request. Application server are kind of proven module.

Regards
Kishor

Kishor,

You have to build some server to accept the post and that server must
implement these APIs...

https://bitbucket.org/javarosa/javarosa/wiki/OpenRosaAPI
https://bitbucket.org/javarosa/javarosa/wiki/FormListAPI
https://bitbucket.org/javarosa/javarosa/wiki/FormSubmissionAPI

Unless you have a really good reason, it probably doesn't make much
sense to replace Aggregate, which is a Tomcat server backed with
MySQL, with another Tomcat server backed with MySQL.

Yaw

··· -- Need ODK consultants? Nafundi provides form design, server setup, in-field training, and software development for ODK. Go to https://nafundi.com to get started.

On Mon, Dec 7, 2015 at 7:51 PM, Kishor Bachhav kishorbachhav@gmail.com wrote:

Hi,

I am planning to use Tomacat server with mysql as backend. How can I use
http post from Collect itself?

Useful notes from Collect says Like forms, data does not have to be sent to
Aggregate. You write an HTTP post to any web server or use an offline
processor like Kobo Post Processor. You can also retrieve them from
/odk/instances folder on your Android device's SD card.

I want to use this HTTP Post. Does anybody have any idea How can I use the
same? After giving tomcat server url, Submit will automatically do http
post..right?
Am I doing wrong by bypassing Aggregate? I am not sure how much aggregate
can scale for request. Application server are kind of proven module.

Regards
Kishor

--
You received this message because you are subscribed to the Google Groups
"ODK Developers" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to opendatakit-developers+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

how many tablets are you expecting to attempt to submit at peak times?

Keep in mind that each ODK Collect submits its filled-in forms one at a
time. So if each data collector collects 100 surveys, they are sent one
after another and are not sent all-at-once (there is limited wifi /
cellular bandwidth off of your device; it does not make sense to send them
all-at-once if all of those submissions need to subdivide that bandwidth
and end up trickling their data into the server).

And it is unlikely every data collector will return to your field office at
exactly the same time and all begin submitting data simultaneously.

==> I doubt you need to worry.

We have never tested the system, but a single server should handle at least
20 submissions per second, and can handle more if you configure your server
with a larger JVM (the JVM size, server socket connection pool, idle
reclamation settings, database connection pool, and GC rate will be the
limiting factors).

But, again, you are likely to reach a wifi / cellular bandwidth limit
and/or network bandwidth limit at some point.

Everything except the database connection pool are configuration settings
you specify when setting up Tomcat (the pool is configured within our
configuration settings:















··· ----------------------------- On AppEngine, everything auto-scales, so you are limited by Google's distributed-denial-of-service (DDoS) throttling logic.

Google will spin up as many copies of ODK Aggregate as necessary to handle
the incoming requests, but will moderate that by its DDoS algorithm and the
daily $ amount you have configured for your billing (i.e., if you set a
maximum of $2/day, Google is not going to spin up 1000 servers for you).

Other parts of the system have mandatory 3-6 second processing pauses
(e.g., data publishing triggers and form upload).

On Mon, Dec 7, 2015 at 12:07 PM, Yaw Anokwa yanokwa@nafundi.com wrote:

Kishor,

You have to build some server to accept the post and that server must
implement these APIs...

https://bitbucket.org/javarosa/javarosa/wiki/OpenRosaAPI
https://bitbucket.org/javarosa/javarosa/wiki/FormListAPI
https://bitbucket.org/javarosa/javarosa/wiki/FormSubmissionAPI

Unless you have a really good reason, it probably doesn't make much
sense to replace Aggregate, which is a Tomcat server backed with
MySQL, with another Tomcat server backed with MySQL.

Yaw

Need ODK consultants? Nafundi provides form design, server setup,
in-field training, and software development for ODK. Go to
https://nafundi.com to get started.

On Mon, Dec 7, 2015 at 7:51 PM, Kishor Bachhav kishorbachhav@gmail.com wrote:

Hi,

I am planning to use Tomacat server with mysql as backend. How can I use
http post from Collect itself?

Useful notes from Collect says Like forms, data does not have to be sent
to
Aggregate. You write an HTTP post to any web server or use an offline
processor like Kobo Post Processor. You can also retrieve them from
/odk/instances folder on your Android device's SD card.

I want to use this HTTP Post. Does anybody have any idea How can I use
the
same? After giving tomcat server url, Submit will automatically do http
post..right?
Am I doing wrong by bypassing Aggregate? I am not sure how much aggregate
can scale for request. Application server are kind of proven module.

Regards
Kishor

--
You received this message because you are subscribed to the Google Groups
"ODK Developers" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to opendatakit-developers+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups
"ODK Developers" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to opendatakit-developers+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
Mitch Sundt
Software Engineer
University of Washington
mitchellsundt@gmail.com

Yaw,

Thanks for giving valuable suggestions. I Have more questions on this but
let me find it out on my own and if i did not get it I will come back to
you.

··· On Tuesday, December 8, 2015 at 1:38:04 AM UTC+5:30, Yaw Anokwa wrote: > > Kishor, > > You have to build some server to accept the post and that server must > implement these APIs... > > https://bitbucket.org/javarosa/javarosa/wiki/OpenRosaAPI > https://bitbucket.org/javarosa/javarosa/wiki/FormListAPI > https://bitbucket.org/javarosa/javarosa/wiki/FormSubmissionAPI > > Unless you have a really good reason, it probably doesn't make much > sense to replace Aggregate, which is a Tomcat server backed with > MySQL, with another Tomcat server backed with MySQL. > > Yaw > -- > Need ODK consultants? Nafundi provides form design, server setup, > in-field training, and software development for ODK. Go to > https://nafundi.com to get started. > > On Mon, Dec 7, 2015 at 7:51 PM, Kishor Bachhav <kishor...@gmail.com > wrote: > > Hi, > > > > I am planning to use Tomacat server with mysql as backend. How can I use > > http post from Collect itself? > > > > Useful notes from Collect says Like forms, data does not have to be sent > to > > Aggregate. You write an HTTP post to any web server or use an offline > > processor like Kobo Post Processor. You can also retrieve them from > > /odk/instances folder on your Android device's SD card. > > > > I want to use this HTTP Post. Does anybody have any idea How can I use > the > > same? After giving tomcat server url, Submit will automatically do http > > post..right? > > Am I doing wrong by bypassing Aggregate? I am not sure how much > aggregate > > can scale for request. Application server are kind of proven module. > > > > Regards > > Kishor > > > > > > -- > > You received this message because you are subscribed to the Google > Groups > > "ODK Developers" group. > > To unsubscribe from this group and stop receiving emails from it, send > an > > email to opendatakit-developers+unsubscribe@googlegroups.com > . > > For more options, visit https://groups.google.com/d/optout. >

Mitch,

Thanks for details on the way collect submits request to Aggregate. Right
now facing with many dilemmas but let me do some homework before I ask next
set of questions.

··· On Tuesday, December 8, 2015 at 1:54:30 AM UTC+5:30, Mitch wrote: > > how many tablets are you expecting to attempt to submit at peak times? > > Keep in mind that each ODK Collect submits its filled-in forms one at a > time. So if each data collector collects 100 surveys, they are sent one > after another and are not sent all-at-once (there is limited wifi / > cellular bandwidth off of your device; it does not make sense to send them > all-at-once if all of those submissions need to subdivide that bandwidth > and end up trickling their data into the server). > > And it is unlikely every data collector will return to your field office > at exactly the same time and all begin submitting data simultaneously. > > ==> I doubt you need to worry. > > We have never tested the system, but a single server should handle at > least 20 submissions per second, and can handle more if you configure your > server with a larger JVM (the JVM size, server socket connection pool, idle > reclamation settings, database connection pool, and GC rate will be the > limiting factors). > > But, again, you are likely to reach a wifi / cellular bandwidth limit > and/or network bandwidth limit at some point. > > Everything except the database connection pool are configuration settings > you specify when setting up Tomcat (the pool is configured within our > configuration settings: > > destroy-method="close" > > > > > > > > > > > > > > > > > ----------------------------- > On AppEngine, everything auto-scales, so you are limited by Google's > distributed-denial-of-service (DDoS) throttling logic. > > Google will spin up as many copies of ODK Aggregate as necessary to handle > the incoming requests, but will moderate that by its DDoS algorithm and the > daily $ amount you have configured for your billing (i.e., if you set a > maximum of $2/day, Google is not going to spin up 1000 servers for you). > --------------------------- > > Other parts of the system have mandatory 3-6 second processing pauses > (e.g., data publishing triggers and form upload). > > > > On Mon, Dec 7, 2015 at 12:07 PM, Yaw Anokwa <yan...@nafundi.com > wrote: > >> Kishor, >> >> You have to build some server to accept the post and that server must >> implement these APIs... >> >> https://bitbucket.org/javarosa/javarosa/wiki/OpenRosaAPI >> https://bitbucket.org/javarosa/javarosa/wiki/FormListAPI >> https://bitbucket.org/javarosa/javarosa/wiki/FormSubmissionAPI >> >> Unless you have a really good reason, it probably doesn't make much >> sense to replace Aggregate, which is a Tomcat server backed with >> MySQL, with another Tomcat server backed with MySQL. >> >> Yaw >> -- >> Need ODK consultants? Nafundi provides form design, server setup, >> in-field training, and software development for ODK. Go to >> https://nafundi.com to get started. >> >> On Mon, Dec 7, 2015 at 7:51 PM, Kishor Bachhav <kishor...@gmail.com > wrote: >> > Hi, >> > >> > I am planning to use Tomacat server with mysql as backend. How can I use >> > http post from Collect itself? >> > >> > Useful notes from Collect says Like forms, data does not have to be >> sent to >> > Aggregate. You write an HTTP post to any web server or use an offline >> > processor like Kobo Post Processor. You can also retrieve them from >> > /odk/instances folder on your Android device's SD card. >> > >> > I want to use this HTTP Post. Does anybody have any idea How can I use >> the >> > same? After giving tomcat server url, Submit will automatically do http >> > post..right? >> > Am I doing wrong by bypassing Aggregate? I am not sure how much >> aggregate >> > can scale for request. Application server are kind of proven module. >> > >> > Regards >> > Kishor >> > >> > >> > -- >> > You received this message because you are subscribed to the Google >> Groups >> > "ODK Developers" group. >> > To unsubscribe from this group and stop receiving emails from it, send >> an >> > email to opendatakit-developers+unsubscribe@googlegroups.com >> . >> > For more options, visit https://groups.google.com/d/optout. >> >> -- >> You received this message because you are subscribed to the Google Groups >> "ODK Developers" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to opendatakit-developers+unsubscribe@googlegroups.com >> . >> For more options, visit https://groups.google.com/d/optout. >> > > > > -- > Mitch Sundt > Software Engineer > University of Washington > mitche...@gmail.com >