designing for sensors & the future of experiences

Designing for Sensors & the Future of Experiences*@jeremyjohnson

jeremy johnson

jeremy johnson

@jeremyjohnson

FUTURE

http://www.neatorama.com/2012/05/27/back-to-the-future-in-lego/

http://en.wikipedia.org/wiki/Bruce_Sterling

futurist

http://www.core77.com/blog/events/notes_from_bruce_sterling_at_cca_4659.asp

“Design and Futurism are not the same thing - design is a method of action and futurism is a method of vision.”

Tablet?Phone?

WTF?

BACKER!

My computer can see!

My house has feelings.

Bank in pocket

Who did this?

Designers

YOU’VE PICKED THE RIGHT CAREER PATH

AMIRITE?

YOUDesigners

Developers

Product owners

Marketing

Engineers

“social media experts”

2012YOU

Design Thinking refers to the methods and processes for investigating ill-defined problems, acquiring information, analyzing knowledge, and positing solutions in the design and planning fields. As a style of thinking, it is generally considered the ability to combine empathy for the context of a problem, creativity in the generation of insights and solutions, and rationality to analyze and fit solutions to the context.

http://en.wikipedia.org/wiki/Design_thinking

tomorrow HERE 8pmFREE

AMIRITE?

http://www.macrumors.com/2012/05/23/apple-design-chief-jonathan-ive-knighted-in-buckingham-palace/

DESIGN

UX

http://uxdesignjobs.net/

It's a Great Time to Be a Designer

http://www.uie.com/events/ux_immersion/2012/

“The pebble watch has raised over six million dollars on Kickstarter. The Nest thermostat sold out its first production run in a few days. Square is using design to rethink the finance industry. Mainstream business magazines are writing about the need for designers.”

http://www.lukew.com/ff/entry.asp?1548

- Jared Spool 2012

http://www.lukew.com/ff/entry.asp?1548

- Jared Spool 2012

“The pebble watch has raised over six million dollars on Kickstarter. The Nest thermostat sold out its first production run in a few days. Square is using design to rethink the finance industry. Mainstream business magazines are writing about the need for designers.”

“People at the boardroom and level are paying attention the value of design. Experience design is more mission critical than ever before.”

http://plyojump.com/classes/internet_era.php

#OG

http://ffffound.com/image/9325691faffcca17f8fd28c0cc8c2386594ddfce

#OG

hard

Hardware Software

http://www.clusterflock.org/2012/05/a-timeline-of-toronto-storefronts.html

http://boingboing.net/2012/05/26/spacex-mission-control-vs-nas.html?utm_source=feedburner&utm_medium=feed&utm_campaign=Feed%3A+boingboing%2FiBag+%28Boing+Boing%29

web appsdesktop apps RIAs

mobile apps touch apps ??

UX

patent 8,179,604:http://www.stuff-review.com/2012-05/google-imagines-rings-for-hand-gesture-input-with-project-glass/

Software

Sensors HARDWARE

Software

Sensors HARDWARE

AWESOME!

Things are moving fast.

Things are hard to predict.

As Designers, we own this.

Softwaretrends

http://youtu.be/GfxxRKBgos8?t=17m

“What I see is more and more software is getting integrated into hardware”

- Steve Jobs 1980

LIKE A BOSS

http://daringfireball.net/linked/2012/05/25/inexpensive

Woz wrote, “To me, a personal computer should be small, reliable, convenient to use and inexpensive.” He wrote that in 1977 about a very different machine, but that’s a perfect description of the iPad.

“everything is a screen”

http://www.fastcodesign.com/1665827/microsoft-unleashes-the-kinect-and-promptly-misses-the-point

http://www.fastcodesign.com/1669879/can-we-please-move-past-apples-silly-faux-real-uis

skeuomorphism

DIGITAL First?

“The innovation here is the fluidity of experience and focus on the data, without using traditional user interface conventions of windows and frames. Data becomes the visual elements and controls. Simple gestures and transitions guide the user deeper into content. A truly elegant and unique experience.”http://en.wikipedia.org/wiki/Metro_(design_language)

http://venturebeat.com/2012/05/15/google-chrome-update-lets-you-share-tabs-across-devices/?utm_source=feedburner&utm_medium=feed&utm_campaign=Feed%3A+Venturebeat+%28VentureBeat%29

http://www.theverge.com/2012/5/29/3049493/futulele-ios-ukelele-app-price-video

Sensortrends

A sensor is a device which receives and responds to a signal.

http://en.wikipedia.org/wiki/Sensor

lighttouch

motionsound

temperature

movement

or?

“everything is a Sensor”

http://www.fastcodesign.com/1665827/microsoft-unleashes-the-kinect-and-promptly-misses-the-point

https://twitter.com/alicenwondrlnd/status/207541130840125440

UX Field trip @Initionhttps://twitter.com/search/%23uxfieldtrip

Headquartered in Shoreditch, east London, we are a pioneering creative 3D technology company. http://www.inition.co.uk/

http://cargocollective.com/jayse/Avengers

http://www.useit.com/alertbox/kinect-gesture-ux.html

20 years lapsed between Doug Engelbart's invention of the mouse (1964) and the first commercially feasible mouse-based computer (the Mac in 1984).

User interaction with technology is going above the glass. You no longer need an explicit tool or even direct manipulation to drive a user interface. With the ability of technology, like the Microsoft Kinect, to see users’ movements in space, gestures are being added to traditional methods in new layers of interaction. Designing for this new layer of interaction requires new thinking about dexterity, ergonomics, and whether someone might feel silly or offensive with certain gestures. We are so involved in this space right now, that we’ve had to move our design technologists’ desks to create enough room for all the hand waving design.

http://designmind.frogdesign.com/blog/frogs-2012-technology-trend-predictions.html

Interaction Choreographyby Senior Principal Design Technologist Jared Ficklin

Interaction Choreography?

Designing for this new layer of interaction requires new thinking about dexterity, ergonomics, and whether someone might feel silly or offensive with certain gestures.

19 million

DESIGNER INSIGHT

“Don’t try to figure out how to cram Kinect into an existing UI paradigm, instead design a UI paradigm that’s from the ground-up intended to exploit the Kinect’s functionality.”http://www.teehanlax.com/labs/insights-into-kinect-ui/

DESIGNER INSIGHT

Do they look silly? Will someone of a certain age/race/gender use this?

Fashion

http://store.apple.com/us/product/H9279LL/A

DESIGNER INSIGHT

What do they know from click and touch interfaces? Is there something more natural? Try and unlearn, and imagine.

UI Patterns

DESIGNER INSIGHT

What is helpful and what is potentially scary? Can you keep a snapshot for marketing purposes? How do they know what they’re sharing?

Privacy

http://techcrunch.com/2011/07/03/sexual-activity-tracked-by-fitbit-shows-up-in-google-search-results/

http://www.theverge.com/2012/5/16/3023687/microsoft-interactive-kinect-nuads-spring-release

Microsoft's Kinect sensor can determine how many people are in a room and read their reaction to adverts

http://thenextweb.com/microsoft/2012/05/18/microsoft-speaks-on-privacy-following-nuad-concerns/?utm_source=feedburner&utm_medium=feed&utm_campaign=Feed%3A+TheNextWeb+%28The+Next+Web+All+Stories%29

What sort of opportunities a NUad would have, given the ability of Kinect to ‘see’ users has made some uncomfortable; its abilities make the idea of NUads in the wild something that could be a bit sinister; who wants an advertiser to peer into their living room?

» Great app ecosystem» Good price point» “Life Sensors”» Connected device

http://www.kickstarter.com/projects/cuckoo/cookootm-the-watch-for-the-connected-generation

» Great battery life» Simple display» Connect device

http://boingboing.net/2012/05/16/mute-watch-capacitive-accele.html

The Mutewatch also features a built-in motion sensor. High levels of movement trigger an increase in the intensity of the vibrating alarm and a simple flick of your wrist activates the glowing display. So, whether you're sleeping, on stage giving a presentation or doing your work out, the Mutewatch will keep you updated on your next step.

DESIGNER INSIGHT

What’s the maximum amount of objects you can fit on a screen? What’s the minimum size of an object need to be on the screen? Do you even need a screen?

Screen Resolution

DESIGNER INSIGHT

Ergonomics

Is it comfortable? Age? People with disabilities? Common movements vs. uncommon. How long will they interact?

http://www.theverge.com/2012/5/22/3037563/hologram-like-assistants-new-york-airports

DESIGNER INSIGHT

Distance and Environment

How far do they need to stand? How far do they think they need to stand? Environment design of the area. Eyesight, size of the UI.

http://www.fastcodesign.com/1665252/a-mind-blowing-ui-that-could-finally-make-group-work-intuitive#1

DESIGNER INSIGHT

3D Space

Is it close or far away? What do we infer from spatial positioning? Can you get people to interact in 3D space on a 2D screen?

http://www.techi.com/2012/05/its-one-giant-leap-motion-for-mankind-as-company-unveils-gesture-control-with-200x-accuracy/?utm_source=feedburner&utm_medium=feed&utm_campaign=Feed%3A+techirss+%28Techi%29

http://www.theverge.com/2012/5/21/3033634/leap-3d-motion-control-system-video

DESIGNER INSIGHT

Demographics

Young people performed better with more information being thrown their way. Older people clearly had a penchant for audio over visual cues. But there was a unifying piece: Both groups benefited from haptic feedback. Humans clearly love touch.

http://www.fastcodesign.com/1669758/researchers-glean-deep-ui-lessons-from-a-haptic-steering-wheel

http://venturebeat.com/2012/05/15/google-glasses-design-patent/?utm_source=feedburner&utm_medium=feed&utm_campaign=Feed%3A+Venturebeat+%28VentureBeat%29

http://www.techradar.com/news/world-of-tech/future-tech/google-unveils-project-glass-augmented-reality-glasses-1075064

http://www.theverge.com/2012/5/29/3051038/sergey-brin-google-project-glass-gavin-newsom

“everything is a Sensor”

“everything is a screen”

“everything is a view”

“everything is seamlessly connected”

http://mashable.com/2012/05/23/muppets-band-aid-ar-app/?utm_source=feedburner&utm_medium=feed&utm_campaign=Feed%3A+Mashable+%28Mashable%29

http://www.joystiq.com/2012/05/18/wii-u-patent-shows-off-wiimote-to-wiipad-pointing-and-dragging/

http://www.fastcodesign.com/1669799/mit-creates-amazing-ui-from-levitating-orbs

“Many of the control that users had to have with mouse and a screen can be tangible and more intuitive.”

http://www.zurb.com/article/986/devices-where-we-go-we-dont-need-no-devic

http://www.bgr.com/2012/05/18/microsoft-kinect-surgery-surgical-assistant-testing/

“Up until now, I’d been calling out across the room to one of our technical assistants, asking them to manipulate the image, rotate one way, rotate the other, pan up, pan down, zoom in, zoom out,” says Tom Carrell, a consultant vascular surgeon at Guy’s and St Thomas’. With the Kinect, the surgeon says he had “very intuitive control.”

“very intuitive control.”

http://www.joystiq.com/2012/05/24/this-dude-can-control-a-pipe-organ-using-kinect/

http://www.theverge.com/2012/5/17/3026058/monmouth-monmouthpedia-wikipedia-town

"the world's first Wikipedia town,"

http://churchm.ag/disney-touche/?utm_source=feedburner&utm_medium=feed&utm_campaign=Feed%3A+ChurchMag+%28ChurchMag%29

Forget about retina displays and multi touch surfaces, how would you like to operate your smartphone by simply touch certain parts of your body, like the picture above?

http://techcrunch.com/2012/05/17/vizibility-launches-its-nfc-enabled-business-cards/?utm_source=feedburner&utm_medium=feed&utm_campaign=Feed%3A+Techcrunch+%28TechCrunch%29

With these cards, Vizibility promises, users will be able to wirelessly exchange contact information and share “hand-picked profiles, video bios, verified Google results and more.”

http://kotaku.com/5911130/this-holographic-star-wars-lego-toy-display-is-better-than-all-three-prequels-combined

I could watch this for hours, which is more than I can say for a good half of the actual Star Wars films. YouTube user H1tmonchan caught this video from a toy store window in Steinkjer, Norway.

Hardwaretrends

http://mashable.com/2012/05/16/spareone-phone/?utm_source=feedburner&utm_medium=feed&utm_campaign=Feed%3A+Mashable+%28Mashable%29

sustainable

DESIGNER INSIGHT

Energy

Think about markets where power is a premium. Or devices that are critical for day-to-day work.

http://www.good.is/post/product-of-the-people-see-our-first-design-sketches/?utm_source=feedburner&utm_medium=feed&utm_campaign=Feed%3A+good%2Flbvp+%28GOOD+Main+RSS+Feed%29

collaborative

http://mashable.com/2012/05/28/lgs-1080p-5-inch-display/?utm_source=feedburner&utm_medium=feed&utm_campaign=Feed%3A+Mashable+%28Mashable%29

LG has announced a new 5-inch smartphone

display with a 1920 x 1080 pixel resolution

and a whopping 440ppi pixel density.

pixel less

http://venturebeat.com/2012/05/29/bukobots-600-open-source-3d-printer-close-to-being-a-reality/?utm_source=feedburner&utm_medium=feed&utm_campaign=Feed%3A+Venturebeat+%28VentureBeat%29

Printable

http://boingboing.net/2012/05/28/modkit-a-simple-graphical-pro.html?utm_source=feedburner&utm_medium=feed&utm_campaign=Feed%3A+boingboing%2FiBag+%28Boing+Boing%29

Modular

http://www.theverge.com/2012/5/28/3048020/kinect-kreek-flexible-interface

Flexible

...Kreek features a stretchy piece of fabric with images projected on to it, while Kinect cameras are used to determine exactly where you're touching.

http://www.theverge.com/2012/5/21/3033569/ntt-docomo-double-sided-transparent-touchscreen-prototype

Transparent

transparent touchscreen that can be operated from both sides.

How do you design for the future?

combine empathy for the context of a problem, creativity in the generation of insights and solutions, and rationality to analyze and fit solutions to the context.

Keep an eye on the future

It’s up to you

@jeremyjohnsonjeremyjohnsononline.com