This is the command tmx-tokenizep that can be run in the OnWorks free hosting provider using one of our multiple free online workstations such as Ubuntu Online, Fedora Online, Windows online emulator or MAC OS online emulator
PROGRAM:
NAME
tmx-tokenize - tokenizes translation units on a tmx file.
SYNOPSIS
tmx-tokenize file.tmx # creates t_file.tmx
tmx-tokenize -o=out.tmx file.tmx
DESCRIPTION
Although this script is bundled in "XML::TMX", it has a soft dependency on
"Lingua::FreeLing3". Soft means that the dependency is not ensured at install time, and
other features of the module can still be used without "Lingua::FreeLing3". Nevertheless,
if you want to use this tool you should install that module.
At the moment the supported languages are the same as supported by FreeLing3: English,
Spanish, Russian, Portuguese and Italian.
It your TMX file includes any other language, they will be maintained without a change.
This behavior can change in the future, as a basic regexp based tokenizer might be
implemented.
Use tmx-tokenizep online using onworks.net services
