quality outputs powered by crowd motivation and technology - commercial and pro bono perspectives,...

18

Upload: taus-enabling-better-translation

Post on 19-Jan-2017

151 views

Category:

Presentations & Public Speaking


0 download

TRANSCRIPT

Page 1: Quality outputs powered by crowd motivation and technology - commercial and pro bono perspectives, Xavier Maza, IDISC & Olga Blasco, Rosetta Foundation
Page 2: Quality outputs powered by crowd motivation and technology - commercial and pro bono perspectives, Xavier Maza, IDISC & Olga Blasco, Rosetta Foundation

• Founded in 1987, iDISC’s mission is to provide products and services that improve communications and information processing to help them distribute any content in any language and in any device or format.

• Offices in Barcelona, Mexico DF and Xalapa, Sao Paulo, Buenos Aires and Seattle.

• 100 fulltime worldwide professionals and more than 500 translators

• 50 million words translated in 2015 into SPANISH, PORTUGUESE, CATALAN, GALICIAN, BASQUE, QUECHUA, GUARANI, KICHE and AYMARA

ABOUT US

iDISC Information Technologies, S.L. – [email protected] – www.idisc.com – Tel.: 93 778 73 00

Page 3: Quality outputs powered by crowd motivation and technology - commercial and pro bono perspectives, Xavier Maza, IDISC & Olga Blasco, Rosetta Foundation

• QUALITY• TIMELINESS• COST

Giving TIME and MONEY for granted.

As professional technicians we like to concentrate on the third, QUALITY

A SURVIVAL GUIDE:

iDISC Information Technologies, S.L. – [email protected] – www.idisc.com – Tel.: 93 778 73 00

GOOD LUCK!IN CAPITAL LETTERS

Page 4: Quality outputs powered by crowd motivation and technology - commercial and pro bono perspectives, Xavier Maza, IDISC & Olga Blasco, Rosetta Foundation

QUALITY FOR PROFITThings happen by Good Luck, in CAPITAL LETTERS

LA BUENA SUERTE (GOOD LUCK) a book by:ÁLEX ROVIRA & FERNANDO TRÍAS DE BES

A SURVIVAL GUIDE:

iDISC Information Technologies, S.L. – [email protected] – www.idisc.com – Tel.: 93 778 73 00

Page 5: Quality outputs powered by crowd motivation and technology - commercial and pro bono perspectives, Xavier Maza, IDISC & Olga Blasco, Rosetta Foundation

OUR VALUES

TO LOOK FOREMPOWERING TRANSLATORS

TRUST IN PROFESSIONALSSMALLER STRUCTURES OF SPECIALISED TRANSLATORS

PAY THE MOSTSPEND THE LEAST

iDISC Information Technologies, S.L. – [email protected] – www.idisc.com – Tel.: 93 778 73 00

TO AVOIDMICROMANAGEMENTREWORK, DOUBLE-CHECKREDUNDANCYWASTE

Page 6: Quality outputs powered by crowd motivation and technology - commercial and pro bono perspectives, Xavier Maza, IDISC & Olga Blasco, Rosetta Foundation

IS THIS ENOUGH?

No.

iDISC Information Technologies, S.L. – [email protected] – www.idisc.com – Tel.: 93 778 73 00

Page 7: Quality outputs powered by crowd motivation and technology - commercial and pro bono perspectives, Xavier Maza, IDISC & Olga Blasco, Rosetta Foundation
Page 8: Quality outputs powered by crowd motivation and technology - commercial and pro bono perspectives, Xavier Maza, IDISC & Olga Blasco, Rosetta Foundation

Founded by Reinhard Schäler in 2009

Mission = To eradicate the knowledge gap based on linguistic discrimination

Over 10 million words by EOY 2015 = EUR 1.5 million (Value In Kind) to Non Profits

Trommons open source crowdsourcing platform

+12,000 volunteers, 400 people joining per month on average in 2016

+250 non profit organizations world-wide

+100 languages

Only 2 members of staff in Dublin, largely volunteer-based

QUICK FACTSHEET

Page 9: Quality outputs powered by crowd motivation and technology - commercial and pro bono perspectives, Xavier Maza, IDISC & Olga Blasco, Rosetta Foundation

PROJECT BASED CROWDSOURCING

Matching content with volunteer skills and interests

Page 10: Quality outputs powered by crowd motivation and technology - commercial and pro bono perspectives, Xavier Maza, IDISC & Olga Blasco, Rosetta Foundation

PROS & CONS FOR CROWD MOTIVATION

Translate text, not segments= full ownership

Inclusive = everyone is welcome

5-Star Translation Rating System & Comment field for feedback

Badge Recognitition System

TM use is not centralised= up to the translator

Potential quality / trust issues

Lack of interactive collaboration & past project lookup

Participation-based, not output-based

Page 11: Quality outputs powered by crowd motivation and technology - commercial and pro bono perspectives, Xavier Maza, IDISC & Olga Blasco, Rosetta Foundation

HOW DOES IT AFFECT QUALITY RATINGS?

2015 Quality Ratings across nearly 2,000 tasks.Star Rating of 1-5 , where 1= “Many Errors” and 5=“Few errors”, 3 is Default Setting

Despite obvious information asymmetry across individual reviewers regarding their experience of quality models, we find a pattern of positive reinforcement in the higher ratings even when fixes are needed.

Page 12: Quality outputs powered by crowd motivation and technology - commercial and pro bono perspectives, Xavier Maza, IDISC & Olga Blasco, Rosetta Foundation

FEEDBACK FROM OUR NGO CLIENTS

Extracted from Organization Survey 2014.

One-one-meetings with selected 20 NGO clients in Q4-15 Q1-16 corroborated this data.

A 2016 survey focused on quality expectations in progress…

Page 13: Quality outputs powered by crowd motivation and technology - commercial and pro bono perspectives, Xavier Maza, IDISC & Olga Blasco, Rosetta Foundation

VOLUNTEER SURVEY 2012

Page 14: Quality outputs powered by crowd motivation and technology - commercial and pro bono perspectives, Xavier Maza, IDISC & Olga Blasco, Rosetta Foundation

FEEDBACK FROM OUR VOLUNTEERS

Extracted from Volunteer Survey 2014. Currently high retention of active volunteers. Utilization is 25 % of total capacity.2016 survey will take place in Q4.

Page 15: Quality outputs powered by crowd motivation and technology - commercial and pro bono perspectives, Xavier Maza, IDISC & Olga Blasco, Rosetta Foundation

CREATING A VIRTUOUS CIRCLE

Motivation

Trust

TechnologySelection

Quality

Page 16: Quality outputs powered by crowd motivation and technology - commercial and pro bono perspectives, Xavier Maza, IDISC & Olga Blasco, Rosetta Foundation

CEO of Special Olympics International, Mary Davis:

“The partnership between The Rosetta Foundation and Special Olympics is one that is valued and cherished by us across the entire Movement. The Rosetta

Foundation volunteer translators are providing words of empowerment through their work. What they do for Special Olympics is truly life changing as we continue together to try to remove barriers to information and resources

for people working to transform the lives of 5 million Special Olympics athletes across the world.”

From the Press Release of May 2016in Washington D.C.:Words of Empowerment: Special Olympics and The Rosetta Foundation Continue Valuable Partnership that Removes Barriers to Information

MAKING A DIFFERENCE

Page 17: Quality outputs powered by crowd motivation and technology - commercial and pro bono perspectives, Xavier Maza, IDISC & Olga Blasco, Rosetta Foundation

REFERENCES

De Wille, Tabea (2014) Competence and Motivation in Volunteer Translators: The Example of the Translation Commons, Dissertation (Master of Science), Department of Computer Science & Information Systems, University of Limerick. Supervisor: Reinhard Schäler.

De Wille, Tabea (2015) Technology in a multi-language community: Opportunities and challenges. EXATEC Presentation. ADAPT Centre, CSIS, University of Limerick.

De Wille, Tabea; Exton, Chris; Schäler, Reinhard (2015) Before Knowledge Management: Quality Expectations in Volunteer Translation. ECKM Presentation. ADAPT Centre, CSIS, University of Limerick.

www.trommons.org

The Rosetta Foundation (2012) Volunteer SurveyThe Rosetta Foundation (2014) Volunteer SurveyThe Rosetta Foundation (2014) Organization Survey

Page 18: Quality outputs powered by crowd motivation and technology - commercial and pro bono perspectives, Xavier Maza, IDISC & Olga Blasco, Rosetta Foundation

Passeig del Progrés, 9608640 Olesa de Montserrat BarcelonaT: (+34) 93.778.73.00E: [email protected]: www.idisc.com

iDISC Information Technologies, S.L.

CONTACT us

Unit 13, Classon House, Dundrum Business Park, Dublin 14IrelandT: (+353) (0) 86 785 1749E: [email protected]: www.therosettafoundation.org

THE ROSETTA FOUNDATION

Xavier MazaClient Services [email protected]

Olga BlascoExecutive [email protected]