Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Info

Jump to the Introduction for the history and background of this issue.

Table of Contents

...

Bug Reports/Observations with the new translation engine

...

Below are some of the bug reports/observations noted during testing.

Description of IssueNoted byDate AddedStatusAdditional Notes on testing, fixes
     
     

 

 

 

 

 

Table of Contents

 

Introduction

A custom machine translation tool for the Latin American and Caribbean Regional At-Large Organisation (LACRALO) mailing lists was implemented around early 2011. However several issues or factors continue to negatively impact the working of the machine translation tool and in turn, has lead to great difficulty in communication and collaboration with the English and Spanish speaking communities in the LAC region.

...

 

 

 

...

 

Bug Reports/Observations with the new translation engine

...

 

 

Previous bug reports against older version of the translation tool.

 StatusDate AddedDescriptionAdditional Notes
(Noted by Dev Anand Teelucksingh and Satish Babu)
Status
colourGreen
titleFIXED
 
28 Feb 2016

Subject line in body of translated email has the sender and first line of the email on the same line, when the sender and first line should be on separate lines. Two examples:

The converted body text was included immediately after the subject and from line in translated emails. A new line character was inserted between sender name and first body text line to separate them.

Initial testing complete; additional testing in progress.

Example: https://community.icann.org/x/AofDAw

 

 

(Noted by Satish Babu) 
Status
colourGreen
titleFIXED
28 Feb 2016

There is an empty space in the beginning of most (but not all) lines in the translated email

After investigation it appears empty spaces may have been added by the email client or by Google Translate API.

Space removed before all translated lines in mailing list emails to resolve the issue.

Tested with mail IDs Outlook, Yahoo, Gmail. Verified that translated emails are not indented; empty spaces are not appearing at the beginning of lines.

Example: https://community.icann.org/x/vYPDAw

(Noted by Satish Babu) 
Status
colourGreen
titleFIXED
28 February 2016

At the end of the message, the sender's name starts with a lower case ('dev Anand', although it is 'Dev Anand' in the original message
EN (original): http://mm.icann.org/pipermail/new-transbot-en/2016-February/000080.html ES (translated): http://mm.icann.org/pipermail/new-transbot-es/2016-February/000068.html

Google Translate understands 'Dev' as an abbreviation and as a rule converts it to all lowercase.

Name was hardcoded to fix 'Dev' to begin with a capital letter.

Tested with mail IDs Outlook, Yahoo, Gmail. Verified that name is appearing correctly with first letter capitalized.

Example: https://community.icann.org/x/ooPDAw

(Noted by Satish Babu) 
Status
colourGreen
titleFIXED
28 February 2016

'Transbot' is mis-spelled as 'tansbot' (third line from the bottom)
EN (original): http://mm.icann.org/pipermail/new-transbot-en/2016-February/000080.html ES (translated): http://mm.icann.org/pipermail/new-transbot-es/2016-February/000068.html

Misspelling was hardcoded. Applied hardcode fix to correct spelling of 'tansbot' to 'transbot' in translated emails.

Tested with mail IDs Outlook, Yahoo, Gmail. Verified that spelling is now appearing correctly as 'transbot.'

Example: https://community.icann.org/x/oILDAw

(Noted by Dev Anand Teelucksingh
Status
colourRedGreen
titleCriticalFIXED
April 17 2016

the transbot can't handle cedilla - as At-Large Staff signature lists a staff member with a cedilla in her name, any message from At-Large Staff will result in a message not translated
See

The April thread with the subject line "CALL FOR MEMBERS: At-Large Public Interest Working Group" on EN : http://mm.icann.org/pipermail/new-transbot-en/2016-April/thread.html and ES : http://mm.icann.org/pipermail/new-transbot-es/2016-April/thread.html showed how the issue was isolated after several variations of the original email were tried.

This is a critical bug, as any cedilla in any word in an email would result in the email not being translated.

The issue has been resolved specific to the reported cases of broken emails caused by the cedilla character in the AL Staff signature.

As a larger issue, it is still in progress. Efforts around the reported case led to wider investigation into how the transbot and email applications handle Unicode characters. This is important UTF-8 compliance work and requires extensive testing.

Recent tests with a wider set of characters using Outlook have been successful. Tests with those same characters have been inconsistent with Gmail and Yahoo. The team is continuing to research, test, and make progress.

Examples: https://community.icann.org/x/pYrDAw

Noted by Dev Anand Teelucksingh 
Status
colourGreen
titleFIXED
April 17 2016

The phrase "This Working Group is open to interested members of the At-Large community." gets translated to

"Este grupo de trabajo está abierto a los miembros interesados \u200b\u200bde la comunidad de alcance."

Not sure why it repeatedly happens for that phrase: See
EN: http://mm.icann.org/pipermail/new-transbot-en/2016-April/000090.html
ES: http://mm.icann.org/pipermail/new-transbot-es/2016-April/000078.html

The issue was related to zero-width space, which was being injected by Google Translate API.

Zero-width space is used after characters that aren't followed by a visible space, but after which there may be a line break (source). It was encoded into the Unicode and was appearing as /u200b.

To fix, it was replaced in the translated text with no space.

Tested with mail IDs Outlook, Yahoo, Gmail. Verified that phrase is translated correctly without additional characters.

Example: https://community.icann.org/x/t4PDAw