ux alive conference speaker is eileen chang (odesk) presentations

24
© 2015 Upwork Inc. Proprietary and confidential. Do not distribute. What’s In It For Me? Get users to take action through A/B testing & agile design Eileen Chang | Sr. Product Marketer | Upwork

Upload: ux-alive-conference

Post on 11-Apr-2017

628 views

Category:

Design


1 download

TRANSCRIPT

© 2015 Upwork Inc. Proprietary and confidential. Do not distribute.

What’s In It For Me?Get users to take action through A/B testing & agile design

Eileen Chang | Sr. Product Marketer | Upwork

© 2015 Upwork Inc. Proprietary and confidential. Do not distribute.

Hello! A quick intro...

2

© 2015 Upwork Inc. Proprietary and confidential. Do not distribute.

Upwork (formerly Elance-oDesk)

● Global platform for businesses to hire, work with, and pay freelance professionals○ 4M registered clients○ 9M registered freelancers representing 2800 skills○ $1B worth of work on our platform annually

3

© 2015 Upwork Inc. Proprietary and confidential. Do not distribute.

The evolution of our homepage

4

© 2015 Upwork Inc. Proprietary and confidential. Do not distribute.

In 2014, our homepage looked like this:

5

© 2015 Upwork Inc. Proprietary and confidential. Do not distribute.

We tried a new approach

● 1 week ● 1 marketer● 2 designers● 1 writer● Result: 2 testable concepts

6

© 2015 Upwork Inc. Proprietary and confidential. Do not distribute.

We tested two concepts with users

7

A B

© 2015 Upwork Inc. Proprietary and confidential. Do not distribute.

Most preferred Concept A

8

A B

© 2015 Upwork Inc. Proprietary and confidential. Do not distribute.

We further tested and refined Concept “A”

9

Test v1 prototype

Get feedback

Adjust

Test v2 prototype

Get feedback

Adjust

Test v3 prototype

Get feedback

Adjust

Day 1 Day 2 Day 3

© 2015 Upwork Inc. Proprietary and confidential. Do not distribute.

Over 3 days, user feedback vastly improved

10

Day 1 Day 2 Day 3

© 2015 Upwork Inc. Proprietary and confidential. Do not distribute.

Live tested new design with real users

11

Existing New

© 2015 Upwork Inc. Proprietary and confidential. Do not distribute.

New design drove 7.7% increase in signup rate

12

Existing New

© 2015 Upwork Inc. Proprietary and confidential. Do not distribute.

Lessons and tips

13

© 2015 Upwork Inc. Proprietary and confidential. Do not distribute.

#1:Identify where users stumble

14

© 2015 Upwork Inc. Proprietary and confidential. Do not distribute.

Use tools to help uncover user needs

15

Purpose Example Tools

Site Analytics

User Feedback

● Customer support● Sales reps● Community forums● User surveys and interviews

Prototyping & Testing

© 2015 Upwork Inc. Proprietary and confidential. Do not distribute.

#2:Do small experiments to validate hypotheses

16

© 2015 Upwork Inc. Proprietary and confidential. Do not distribute.

#3:Get feedback early and often

17

© 2015 Upwork Inc. Proprietary and confidential. Do not distribute.

#4:There’s always room for (more) improvement

18

© 2015 Upwork Inc. Proprietary and confidential. Do not distribute.

What follow-on experiments can you try?

19

Show example tasks Show freelancer types

© 2015 Upwork Inc. Proprietary and confidential. Do not distribute.

What follow-on experiments can you try?

20

Merchandise tasks Merchandise freelancers

+69% click-through rate+1.1% signup rate

© 2015 Upwork Inc. Proprietary and confidential. Do not distribute.

What follow-on experiments can you try?

21

Search results Category pages

© 2015 Upwork Inc. Proprietary and confidential. Do not distribute.

What follow-on experiments can you try?

22

Search results Category pages +1.3% signup rate

© 2015 Upwork Inc. Proprietary and confidential. Do not distribute.

Thankswww.upwork.com

© 2015 Upwork Inc. Proprietary and confidential. Do not distribute.

Questions?

24