active curation of bi-text resources in commercial localization … · active curation of bi-text...
TRANSCRIPT
![Page 1: Active Curation of Bi-Text Resources in Commercial Localization … · Active Curation of Bi-Text Resources in Commercial Localization Workflows Dave Lewis TCD, Andrzej Zydroń XTM](https://reader033.vdocuments.us/reader033/viewer/2022050420/5f8f39038dd41d1289078cf1/html5/thumbnails/1.jpg)
Active Curation of Bi-Text Resources in Commercial Localization Workflows
Dave Lewis TCD, Andrzej Zydroń XTM International
![Page 2: Active Curation of Bi-Text Resources in Commercial Localization … · Active Curation of Bi-Text Resources in Commercial Localization Workflows Dave Lewis TCD, Andrzej Zydroń XTM](https://reader033.vdocuments.us/reader033/viewer/2022050420/5f8f39038dd41d1289078cf1/html5/thumbnails/2.jpg)
• Open Data on the Web: W3C Semantic Web standards allow data to be published on Web – Fine-grained URI-based inter-linking – Extensible meta-data – Standard Query APIs
• Enables a Localization Web – Terms and translations become linkable resources – Meta-data from L10n workflows adds value – Leverage in training Machine Translation and
Automatic Term Extraction
The Localization Web
The Localization Web = Decentralised Annotated Global Translation Memory and Term Base
![Page 3: Active Curation of Bi-Text Resources in Commercial Localization … · Active Curation of Bi-Text Resources in Commercial Localization Workflows Dave Lewis TCD, Andrzej Zydroń XTM](https://reader033.vdocuments.us/reader033/viewer/2022050420/5f8f39038dd41d1289078cf1/html5/thumbnails/3.jpg)
Web of Multilingual Content
![Page 4: Active Curation of Bi-Text Resources in Commercial Localization … · Active Curation of Bi-Text Resources in Commercial Localization Workflows Dave Lewis TCD, Andrzej Zydroń XTM](https://reader033.vdocuments.us/reader033/viewer/2022050420/5f8f39038dd41d1289078cf1/html5/thumbnails/4.jpg)
Domain Terminology
![Page 5: Active Curation of Bi-Text Resources in Commercial Localization … · Active Curation of Bi-Text Resources in Commercial Localization Workflows Dave Lewis TCD, Andrzej Zydroń XTM](https://reader033.vdocuments.us/reader033/viewer/2022050420/5f8f39038dd41d1289078cf1/html5/thumbnails/5.jpg)
• Rich word and phrase resources to assist translators
Babelfy: Public Lexical Resources
![Page 6: Active Curation of Bi-Text Resources in Commercial Localization … · Active Curation of Bi-Text Resources in Commercial Localization Workflows Dave Lewis TCD, Andrzej Zydroń XTM](https://reader033.vdocuments.us/reader033/viewer/2022050420/5f8f39038dd41d1289078cf1/html5/thumbnails/6.jpg)
• Translation suggestions can be fed into MT for more reliable translation
Links to BabelNet offer suggestions for Definitions and Translations
![Page 7: Active Curation of Bi-Text Resources in Commercial Localization … · Active Curation of Bi-Text Resources in Commercial Localization Workflows Dave Lewis TCD, Andrzej Zydroń XTM](https://reader033.vdocuments.us/reader033/viewer/2022050420/5f8f39038dd41d1289078cf1/html5/thumbnails/7.jpg)
Babelfy & Babelnet offer more term suggestions
![Page 8: Active Curation of Bi-Text Resources in Commercial Localization … · Active Curation of Bi-Text Resources in Commercial Localization Workflows Dave Lewis TCD, Andrzej Zydroń XTM](https://reader033.vdocuments.us/reader033/viewer/2022050420/5f8f39038dd41d1289078cf1/html5/thumbnails/8.jpg)
• Public resources may not always yield the right definitions or translations for the context
• Need to track human validation/rejection to train automatic term extraction
![Page 9: Active Curation of Bi-Text Resources in Commercial Localization … · Active Curation of Bi-Text Resources in Commercial Localization Workflows Dave Lewis TCD, Andrzej Zydroń XTM](https://reader033.vdocuments.us/reader033/viewer/2022050420/5f8f39038dd41d1289078cf1/html5/thumbnails/9.jpg)
Active Curation of Linked Language Resources
The company has also reduced its production capacity by ceasing manufacture of chest freezers and freestanding microwave ovens
Extraction & Segmentation
production capacity
capacité de production
✔
✔ Annotation with Existing Terms
chest freezer
microwave oven
réfrigérateur
four à micro-onde
?
??
?
Auto suggestion from Babelfy/Babelnet
D'autre part, la société a réduit sa capacité de production en arrêtant la production de réfrigérateur et de fours micro-onde pose-libre
Machine Translate with Term Translations
MT Vendor ?
D'autre part, la société a réduit sa capacité de production en arrêtant la production de congélateurs coffres et do fours micro-ondes pose-libre
✗
congélateurs coffres
fours micro-ondes
✔
Postedit and capture terms in context
✔✔
✔
✔
✔
✔
PE
PE
PE
PE
PE
PE
PE
✗
PE
✔
![Page 10: Active Curation of Bi-Text Resources in Commercial Localization … · Active Curation of Bi-Text Resources in Commercial Localization Workflows Dave Lewis TCD, Andrzej Zydroń XTM](https://reader033.vdocuments.us/reader033/viewer/2022050420/5f8f39038dd41d1289078cf1/html5/thumbnails/10.jpg)
• CSV of the Web: tables and JSON meta-data
• JSON-Linked Data • Provenance Vocabulary • Data Catalogue • Open Annotation • ITS2.0 Vocabulary • Also:
– Provenance Plan – Open Data Rights Language
Linked Data Based on W3C Standards
![Page 11: Active Curation of Bi-Text Resources in Commercial Localization … · Active Curation of Bi-Text Resources in Commercial Localization Workflows Dave Lewis TCD, Andrzej Zydroń XTM](https://reader033.vdocuments.us/reader033/viewer/2022050420/5f8f39038dd41d1289078cf1/html5/thumbnails/11.jpg)
Language Resource
s
Language Workers
Language Technology
Language Lifecycle Dependencies
![Page 12: Active Curation of Bi-Text Resources in Commercial Localization … · Active Curation of Bi-Text Resources in Commercial Localization Workflows Dave Lewis TCD, Andrzej Zydroń XTM](https://reader033.vdocuments.us/reader033/viewer/2022050420/5f8f39038dd41d1289078cf1/html5/thumbnails/12.jpg)
Parallel Text &
Term base
Posteditors Machine Translation
Active Curation: Dynamic MT Retraining
• Tighten curation cycle: from projects to segments
– Prioritise postedits for retraining
• Prioritise Term Identification by posteditors
• Assemble MT-ready, lexically-rich term bases
![Page 13: Active Curation of Bi-Text Resources in Commercial Localization … · Active Curation of Bi-Text Resources in Commercial Localization Workflows Dave Lewis TCD, Andrzej Zydroń XTM](https://reader033.vdocuments.us/reader033/viewer/2022050420/5f8f39038dd41d1289078cf1/html5/thumbnails/13.jpg)
• TermWeb/XTM/DCU • Introducing Next Gen Machine Translation
• Massive scale bilingual dictionaries • BabelNet
• Automatic Term Extraction: forced decoding
• Dynamic retraining • Optimal segment translation route • L3Data curation, sharing
Next Generation Machine Translation
![Page 14: Active Curation of Bi-Text Resources in Commercial Localization … · Active Curation of Bi-Text Resources in Commercial Localization Workflows Dave Lewis TCD, Andrzej Zydroń XTM](https://reader033.vdocuments.us/reader033/viewer/2022050420/5f8f39038dd41d1289078cf1/html5/thumbnails/14.jpg)
Data Management Lifecycles
Publish
Correct & refine
Lex-concept lifecycle Correct &
refine Discover &
use
Discover & use
Correct & refine
Bitext lifecycle
Discover data
(Re)train-MT
Revise and annotate
Publish
Content lifecycle
Publish
I18n & source QA
Trans QA
Post-edit
Automated translation
Consume Create
![Page 15: Active Curation of Bi-Text Resources in Commercial Localization … · Active Curation of Bi-Text Resources in Commercial Localization Workflows Dave Lewis TCD, Andrzej Zydroń XTM](https://reader033.vdocuments.us/reader033/viewer/2022050420/5f8f39038dd41d1289078cf1/html5/thumbnails/15.jpg)
• Better in-context postediting: – XTM-Easyling
• Feeding term suggestions from posteditor to Terminology Management – XTM-Interverbum
• Dynamic Retraining – XTM-DCU
• Bilingual Dictionary SMT improvements – XTM-DCU
• NER, terminology enforcements, forced decoding – XTM-Interverbum-DCU
• Postediting prioritisation and term flagging – TCD-DCU-XTM
• Publishing interlinks of parallel text, lexically rich term bases – TCD: DG-T TM, EurVoc, Snomed-CT, LEMON, BabelNet
• Closing the loop – operational instrumentation of postediting – XTM
Systems Integration