ODK in different languages

Support
17

Another possibility is that your hosting service or wherever you are
running your tomcat server is behind a proxy (e.g., Apache HTTPD) and that
proxy is adding or stripping headers from the requests. One of these
headers specifies the incoming character set, and if absent, will cause
this issue.

··· On Thu, Sep 22, 2016 at 12:42 PM, Saad Omer wrote:

Hi guys,

I have tried the whole instruction set below on a fresh installation of
aggregate, but this is to confirm that the ODK Aggregate database (and
subsequently aggregate dashboard) is still storing/showing ????? instead of
the Burmese characters I am sending via ODK collect.

My whole database and all fields are in utf8_general_ci collation. I have
also tested inserting Burmese characters manually in database, which are
stored OK and also visible on dashboard via browser (so language conversion
for display should not be a problem). However, the full value chain of data
submission from ODK collect to database to Aggregate is not working well.

Where do we go from here now?

Regards,

Saad

From: opendatakit@googlegroups.com [mailto:opendatakit@googlegroups.com]
*On Behalf Of *Yaw Anokwa
Sent: Friday, September 16, 2016 1:42 AM

To: ODK Community
Subject: Re: Re[3]: Re[2]: [ODK Community] ODK in different languages

Saad,

I bet Mitch is correct, but before you drop the DB, make sure that
everything is indeed UTF-8 by running this query: SHOW VARIABLES LIKE
'character_set%'; It should say utf8 on everything but maybe
character_set_filesystem which will probably be binary.

Then try a simple one question form with a submission of old ASCII
letters, another with acçéñts, and then a third with Burmese and see if the
Aggregate UI, export to CSV, or raw database values show the correct thing.

Yaw

--

Need ODK consultants? Nafundi provides form design, server setup, in-field
training, and software development for ODK. Go to https://nafundi.com to
get started.

On Thu, Sep 15, 2016 at 8:40 PM, Saad Omer saad@saadaan.com wrote:

Thanks Mitch. So far I am trying to experiment on a working instance,
since it has sample forms loaded. However, I have tried all steps you
mentioned below, and it does not seem to work (only getting ?????? against
database submission). I was trying to avoid the reinstallation but it seems
as the only option left to test.

Let me do it and share observations with everyone.

From: opendatakit@googlegroups.com [mailto:opendatakit@googlegroups.com]
*On Behalf Of *Mitch Sundt
Sent: Friday, September 16, 2016 1:22 AM

To: ODK Community
Subject: Re: Re[3]: Re[2]: [ODK Community] ODK in different languages

Once you stop the MySQL server, configure it, and restart it, you probably
need to drop the old database and re-create it with the
create_db_and_user.sql script that ODK Aggregate's installer generated.

I do not know whether any existing data is retrievable / repairable. I
suspect it is lost. Unless you configured ODK Collect to delete data after
submission, you can re-send the data from ODK Collect by going to the Send
Finalized Form screen and long-pressing the Toggle All button.

On Thu, Sep 15, 2016 at 12:35 PM, Saad Omer saad@saadaan.com wrote:

Dear Mitch,

Thank you very much for the tutorial.

I broke your advice into step-wise approach; first step is to fix
database, second is to fix aggregate web layer for displaying Burmese
characters.

I am having issues at the first step. I am using MySQL, and have changed
full database character set to utf8_unicode_ci, but still the submissions
are being displayed as ??????. I am using phpmyadmin to view the database
in browser, and not using Aggregate web portal currently to view.

Can someone offer some help?

Regards,

Saad

From: opendatakit@googlegroups.com [mailto:opendatakit@googlegroups.com]
*On Behalf Of *Mitch Sundt
Sent: Thursday, September 15, 2016 9:59 PM

To: ODK Community
Subject: Re: Re[3]: Re[2]: [ODK Community] ODK in different languages

W.r.t. ODK Aggregate:

(1) when setting up your own server, the database character set must be
configured to be UTF-8.

See the documentation for your database to find how to change this
setting. MySQL defaults to latin-1 character set.

Failure to do this will cause the website's Submissions tab to show ?????
for field values.

In rare cases, you might need to install a language pack for your
particular language. If you can't see the characters in your language when
using the Translate choice on https://opendatakit.org/, then this may be
the problem.

(2) when downloading CSVs, you cannot double-click them to open them --
Excel will assume a latin-1 character set and convert everything into
????'s. To open them, you must first open Excel then manually import the
file.

See https://opendatakit.org/help/form-design/workarounds/#csv_output

==============

And, finally, the display language for the non-data-field text on the ODK
Aggregate website is only in English. Considerable work needs to be done
before it can be translated into multiple languages. And all data fields
containing times and dates are reported in UTC time (and there may be some
errors in those due to numerous issues around date-time handling within the
javarosa layer).

On Wed, Sep 14, 2016 at 1:48 PM, Saad Omer saad@saadaan.com wrote:

Dear Ronald/Yaw,

Thank you so much for bearing with my beginner level questions and
clarifying everything. Now I completely understand the process, and will
try to implement it via example forms shared. I am much obliged for your
time, help and patience with me J

Now my subsequent question: Does ODK Aggregate support the other language
(in my case, Burmese)? I tried submitting some Burmese text via form,
however it was displayed as ???????? in the dashboard as well as the CSV
exported file. How to enable aggregate to store foreign language content?

Regards,
Saad

From: opendatakit@googlegroups.com [mailto:opendatakit@googlegroups.com]
*On Behalf Of *Yaw Anokwa
Sent: Wednesday, September 14, 2016 11:21 PM
To: ODK Community
Subject: Re: Re[3]: Re[2]: [ODK Community] ODK in different languages

Hi Saad,

ODK Collect supports language in two ways -- at the device level and at
the form level.

If your device locale in your Android device's settings is set to
something besides English (e.g., French), every app on that device that has
translations will change to that language.

In the case of French, ODK's buttons and menus have those translations and
so you'll see that change. And if you don't believe me, here are the French
translations in ODK Collect's source code. https://github.com/
opendatakit/collect/blob/master/collect_app/src/main/
res/values-fr/strings.xml

Regardless of your device locale, you can design forms in as many
languages as you'd like. http://xlsform.org/#language describes how this
is done in the XLSForm. Once you do that, you can press the Menu key in ODK
Collect, and then use Change Language option.

So to summarize, you can have a French tablet that has forms where you can
toggle between English, Japanese, and Spanish. And you can set the default
language in that form to English, Japanese or Spanish.

If you aren't seeing languages at the form level, it means you probably
haven't designed the form correctly. I've attached an example.

Yaw

--

Need ODK consultants? Nafundi provides form design, server setup, in-field
training, and software development for ODK. Go to https://nafundi.com to
get started.

On Wed, Sep 14, 2016 at 5:40 PM, Ronald Munjoma simbiso@gmail.com wrote:

Hi Saad.

In your XLSForm or XML file. You should have the translated language.

Hope we are on the same page. I am talking about running your survey in
more than one language. Is that what you are trying to achieve?

Best and Regards
Ronald Munjoma

--
Sent from myMail app for Android

Wednesday, 14 September 2016, 07:32PM +02:00 from Saad Omer <
saad@saadaan.com>:

Another language where? Do you mean in the OS (Android)?

On Sep 14, 2016 10:25 PM, "Ronald Munjoma" <simbiso@gmail.com https://e-aj.my.com/compose/?mailto=mailto%3Asimbiso@gmail.com> wrote:

Hi Saad.

Do you have another language apart from the default language? The option
will only show if you have more than one language.

Best and Regards
Ronald Munjoma

--
Sent from myMail app for Android

Wednesday, 14 September 2016, 07:09PM +02:00 from Saad Omer <
saad@saadaan.com
https://e-aj.my.com/compose/?mailto=mailto%3Asaad@saadaan.com>:

Hi Ronald,

I don't see any option in the app related to language change. In the
attached image, the GENERAL SETTINGS tab only gives standard options of the
app, which do not include language option. Am I doing it right?

I hope you are not talking about ODK 2, are you?

Regards,
Saad

On Sep 12, 2016 7:52 PM, "ronald munjoma" <simbiso@gmail.com https://e-aj.my.com/compose/?mailto=mailto%3Asimbiso@gmail.com> wrote:

Hi Saad,

On the device, after you open the form, you can choose an alternate
language (using the menu options while within the form).

From that point onward, this language becomes the default used when
opening this form on that device. You have to do this on every device.

Best and Regards

Ronald Munjoma

On 10 September 2016 at 22:06, Saad <saad@saadaan.com https://e-aj.my.com/compose/?mailto=mailto%3Asaad@saadaan.com> wrote:

Can you mention the option of setting default language? From where to
activate it?

--

Post: opendatakit@googlegroups.com
https://e-aj.my.com/compose/?mailto=mailto%3Aopendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
https://e-aj.my.com/compose/?mailto=mailto%3Aopendatakit%252Bunsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

You received this message because you are subscribed to the Google Groups
"ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to opendatakit+unsubscribe@googlegroups.com
https://e-aj.my.com/compose/?mailto=mailto%3Aopendatakit%2Bunsubscribe@googlegroups.com
.
For more options, visit https://groups.google.com/d/optout.

--

Best and Regards

Ronald Munjoma

+263 775 625 283

Ronald Munjoma

about.me/ronaldmunjoma

--

Post: opendatakit@googlegroups.com
https://e-aj.my.com/compose/?mailto=mailto%3Aopendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
https://e-aj.my.com/compose/?mailto=mailto%3Aopendatakit%252Bunsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

You received this message because you are subscribed to a topic in the
Google Groups "ODK Community" group.
To unsubscribe from this topic, visit https://groups.google.com/d/
topic/opendatakit/hNdMlCCzbH0/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
opendatakit+unsubscribe@googlegroups.com
https://e-aj.my.com/compose/?mailto=mailto%3Aopendatakit%2Bunsubscribe@googlegroups.com
.
For more options, visit https://groups.google.com/d/optout.

--

Post: opendatakit@googlegroups.com
https://e-aj.my.com/compose?To=opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
https://e-aj.my.com/compose?To=opendatakit%2Bunsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

You received this message because you are subscribed to the Google Groups
"ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to opendatakit+unsubscribe@googlegroups.com
https://e-aj.my.com/compose/?mailto=mailto%3Aopendatakit%2Bunsubscribe@googlegroups.com
.
For more options, visit https://groups.google.com/d/optout.

--

Post: opendatakit@googlegroups.com
https://e-aj.my.com/compose/?mailto=mailto%3Aopendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
https://e-aj.my.com/compose/?mailto=mailto%3Aopendatakit%252Bunsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

You received this message because you are subscribed to a topic in the
Google Groups "ODK Community" group.
To unsubscribe from this topic, visit https://groups.google.com/d/
topic/opendatakit/hNdMlCCzbH0/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
opendatakit+unsubscribe@googlegroups.com
https://e-aj.my.com/compose/?mailto=mailto%3Aopendatakit%2Bunsubscribe@googlegroups.com
.
For more options, visit https://groups.google.com/d/optout.

--

Post: opendatakit@googlegroups.com
https://e-aj.my.com/compose?To=opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
https://e-aj.my.com/compose?To=opendatakit%2Bunsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

You received this message because you are subscribed to the Google Groups
"ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to opendatakit+unsubscribe@googlegroups.com
https://e-aj.my.com/compose/?mailto=mailto%3Aopendatakit%2Bunsubscribe@googlegroups.com
.
For more options, visit https://groups.google.com/d/optout.

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

You received this message because you are subscribed to the Google Groups
"ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

You received this message because you are subscribed to a topic in the
Google Groups "ODK Community" group.
To unsubscribe from this topic, visit https://groups.google.com/d/
topic/opendatakit/hNdMlCCzbH0/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

You received this message because you are subscribed to the Google Groups
"ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Mitch Sundt
Software Engineer
University of Washington
mitchellsundt@gmail.com

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

You received this message because you are subscribed to a topic in the
Google Groups "ODK Community" group.
To unsubscribe from this topic, visit https://groups.google.com/d/
topic/opendatakit/hNdMlCCzbH0/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

You received this message because you are subscribed to the Google Groups
"ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Mitch Sundt
Software Engineer
University of Washington
mitchellsundt@gmail.com

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

You received this message because you are subscribed to a topic in the
Google Groups "ODK Community" group.
To unsubscribe from this topic, visit https://groups.google.com/d/
topic/opendatakit/hNdMlCCzbH0/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

You received this message because you are subscribed to the Google Groups
"ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

You received this message because you are subscribed to a topic in the
Google Groups "ODK Community" group.
To unsubscribe from this topic, visit https://groups.google.com/d/
topic/opendatakit/hNdMlCCzbH0/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Post: opendatakit@googlegroups.com
Unsubscribe: opendatakit+unsubscribe@googlegroups.com
Options: http://groups.google.com/group/opendatakit?hl=en

You received this message because you are subscribed to the Google Groups
"ODK Community" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to opendatakit+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
Mitch Sundt
Software Engineer
University of Washington
mitchellsundt@gmail.com