TAUS  MACHINE  TRANSLATION  SHOWCASE  

Hunnect’s Use Case 15:50 – 16:10 Wednesday, 10 April 2013 Sándor Sojnóczky Hunnect

Now You Got Your MT……

I.  Background information II.  Challenges and tasks

1.  Retraining 2.  Pricing 3.  Margin calculation and quality assessment

III.  Immediate MT successes IV.  Product specific MT engines V.  Post-editing: success stories VI. What is next?

     

Now You Got Your MT……

Background information •  MT implementation completed in 2010 •  Language pair: English - Hungarian •  Over 100 MT projects •  Successful online training for post-editors •  Growing demand for our MT solutions

     

Transla(on  (12  days)  

Edi(ng  (4  days)  

Proofing  (3  days)  

MT  (1  day)  

Post-­‐edi(ng  (9  days)  

Proofing  (3  days)  

Free  (6  days)  32  %  saving  in  (me  

C  

o  

s  

t  

Timeframe  

Now You Got Your MT……

Business Model – Timeframe

(based on a TEP project of 34,000 words / 26,000 no match)

MT  (1  day)  

Post-­‐edi(ng  (8  days)  

Proofing  (3,5  days)  

Free  (6,5  days)  35  %  saving  in  (me  

Business Model – Pricing (LSP)

Margin Margin

Proofing

Bilingual editing

Translation

Biling. proofing

Post-editing

Machine  trans.  

25%

5%

20%

50%

45%

5%

30%  

20%

Now You Got Your MT……

50%

33%  

9%

8%

TEP MT/PE Margin %

Now You Got Your MT……

Business Model – Pricing (Post-editor)

PE actual  

Daily  output

Unit paid

Total paid

TR PE plan

2,500 5,000

1.00 0.60 (-40%)

2,500 3,000

(+20%)

2,520

(+1%)

4,200

0.60 (-40%)

Now You Got Your MT……

Challenges and tasks

1.  (Re)training 2.  Pricing your MT projects 3.  Margin calculation 4.  Quality assessment    

Now You Got Your MT……

Retraining activities •  Content selection

•  Post-edited content •  New translated materials

•  Frequency •  Build a routine

     

Now You Got Your MT……

Pricing your MT projects §  Pricing matrix based on

•  Raw MT output assessed (error typology) •  Post-editor’s feedback on

•  Raw output •  Post-editing tasks

     

Now You Got Your MT……

Margin calculation and quality assessment

•  Margins

•  Plan vs. actual margins •  The sliding scale (not for all)

•  Quality assessment

Now You Got Your MT……

Immediate successes

•  IT (software) •  Technical content •  Electronic equipment •  Controlled Language

Now You Got Your MT……

Further improvements

•  Product vs. domain-specific MT engines •  Product-specific aids •  Retraining, retraining…  

 

Now You Got Your MT……

Post-editing: success stories

•  How to achieve targets?

•  How we measure success?

 

Now You Got Your MT……

What is next?    

 

TAUS  MACHINE  TRANSLATION  SHOWCASE  

TAUS Dynamic Quality Framework Tools 15:50 – 16:10 Wednesday, 10 April 2013 Rahzeb Choudhury TAUS

This slide may not be used or copied without permission from TAUS

Metrics  

•  We need to go up and down in quality and the translation

industry’s use of quality evaluation models and metrics needed to reflect this,

•  We need industry benchmarking to strengthen and improve the credibility of quality assurance processes,

•  We need to lower cost of quality assurance at buyers and providers.

" We achieve this through an industry shared knowledge base and shared tools for benchmarking.

Metrics:  Dynamic  Quality  Framework  

Metrics:  DQF  ü  CA  Technologies  ü  Cisco  ü  Dell  ü  EMC  ü  eBay    ü  Google  ü  HewleN  Packard  ü  Intel  ü  Medtronic  ü  MicrosoQ  ü  Oracle  ü  Philips  ü  PTC  ü  Siemens  ü  Spil  Games  ü  Yahoo!          

Metrics:  Best  Prac8ces  

Metrics:  Appropriateness  

Metrics:  Tools  

Metrics:  Repor8ng  

ü  See  how  you  compare  against  peers  ü  Drill  down  to  see  the  impact  of  individuals    ü  Assess  correla(on  between  automated  metrics  and  

human  evalua(on  ü  Shared  learning  to  feed  fundamental  research      Apply  objec8ve  criteria  and  raise  the  credibility  of  transla8on  quality  assurance  func8on  across  the  industry  

Metrics:  Common  Goals