Multimodal Input for ODK Survey

Hi all,

I've been working on a project to make health forms more accessible on a tablet by displaying large text and incorporating speech I/O. It seems likely the best way to accomplish this is by extending ODK 2.0, but I'm not sure where best to start working, particularly given the ongoing code restructure. Does anyone have any suggestions?

It's not clear if you need 2.0. I've got some pending code that will
make working with customizable text a lot easier in ODK Collect.
Speech I/O, I don't know exactly what you mean, so can't comment on
that.

Either way, I'd suggest you at least wait for the code restructure to finish.

Yaw

··· -- Need ODK services? http://nafundi.com provides form design, server setup, professional support, and software development for ODK.

On Tue, Jul 7, 2015 at 2:58 AM, jasonford312@gmail.com wrote:

Hi all,

I've been working on a project to make health forms more accessible on a tablet by displaying large text and incorporating speech I/O. It seems likely the best way to accomplish this is by extending ODK 2.0, but I'm not sure where best to start working, particularly given the ongoing code restructure. Does anyone have any suggestions?

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to the Google Groups "ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

By speech I/O, I mean reading questions/prompts through text-to-speech and taking answers from automatic speech recognition. Is there a controller class that's uncoupled from all of the view components?

··· On Tuesday, July 7, 2015 at 7:36:18 AM UTC-5, Yaw Anokwa wrote: > It's not clear if you need 2.0. I've got some pending code that will > make working with customizable text a lot easier in ODK Collect. > Speech I/O, I don't know exactly what you mean, so can't comment on > that. > > Either way, I'd suggest you at least wait for the code restructure to finish. > > Yaw > -- > Need ODK services? http://nafundi.com provides form design, server > setup, professional support, and software development for ODK. > > On Tue, Jul 7, 2015 at 2:58 AM, wrote: > > Hi all, > > > > I've been working on a project to make health forms more accessible on a tablet by displaying large text and incorporating speech I/O. It seems likely the best way to accomplish this is by extending ODK 2.0, but I'm not sure where best to start working, particularly given the ongoing code restructure. Does anyone have any suggestions? > > > > -- > > -- > > Post: opendatakit@googlegroups.com > > Unsubscribe: opendatakit+unsubscribe@googlegroups.com > > Options: http://groups.google.com/group/opendatakit?hl=en > > > > --- > > You received this message because you are subscribed to the Google Groups "ODK Community" group. > > To unsubscribe from this group and stop receiving emails from it, send an email to opendatakit+unsubscribe@googlegroups.com. > > For more options, visit https://groups.google.com/d/optout.

Reading questions/prompts from TTS should be pretty easy to do. Not
clear you'll get good results once you move beyond English though.
Might be easier just to record audio snippets and play those.
Nafundi's got some pending changes to Collect that make autoplaying of
question and select items more user friendly.

Getting answers from speech recognition is also pretty
straight-forward as far as the extensions to Collect. I'd probably
make a custom keyboard that allows for audio input. Don't know if
Google allows for offline speech recognition, so that might be a
limitation. Oh, and accuracy, especially in noisy environments.

https://code.google.com/p/opendatakit/wiki/CollectSourceCodeOverview
has a good code overview.

Yaw

··· -- Need ODK services? http://nafundi.com provides form design, server setup, professional support, and software development for ODK.

On Tue, Jul 7, 2015 at 9:13 AM, jasonford312@gmail.com wrote:

By speech I/O, I mean reading questions/prompts through text-to-speech and taking answers from automatic speech recognition. Is there a controller class that's uncoupled from all of the view components?

On Tuesday, July 7, 2015 at 7:36:18 AM UTC-5, Yaw Anokwa wrote:

It's not clear if you need 2.0. I've got some pending code that will
make working with customizable text a lot easier in ODK Collect.
Speech I/O, I don't know exactly what you mean, so can't comment on
that.

Either way, I'd suggest you at least wait for the code restructure to finish.

Yaw

Need ODK services? http://nafundi.com provides form design, server
setup, professional support, and software development for ODK.

On Tue, Jul 7, 2015 at 2:58 AM, jasonford312@gmail.com wrote:

Hi all,

I've been working on a project to make health forms more accessible on a tablet by displaying large text and incorporating speech I/O. It seems likely the best way to accomplish this is by extending ODK 2.0, but I'm not sure where best to start working, particularly given the ongoing code restructure. Does anyone have any suggestions?

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to the Google Groups "ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en


You received this message because you are subscribed to the Google Groups "ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.