Natural Language Processing

Separate the punctuation before translation

A journey through moses rules with Botie.

Natural Language Processing · A journey with Botie

First visit? Learn the workshop controls

Botie's notebook

How Could a Translation System Compare Text Consistently?

Part 1 of 3

A statistical translation system learns from recurring pieces of text. If a word beside a comma is treated differently from the same word elsewhere, its evidence becomes fragmented. But blindly separating every period would damage abbreviations and numbers.

Sources for this history