Natural Language Processing
Separate the punctuation before translation
A journey through moses rules with Botie.
Natural Language Processing · A journey with Botie
First visit? Learn the workshop controlsBotie's notebook
How Could a Translation System Compare Text Consistently?
Part 1 of 3
A statistical translation system learns from recurring pieces of text. If a word beside a comma is treated differently from the same word elsewhere, its evidence becomes fragmented. But blindly separating every period would damage abbreviations and numbers.