![Page 1: The Increasing Importance of the Graphical User Interface ... · MNM 1 The Increasing Importance of the Graphical User Interface (GUI) in the Digital Age USPTO Design Day April 23,](https://reader033.vdocuments.us/reader033/viewer/2022051601/5ad52ce37f8b9a177c8ca711/html5/thumbnails/1.jpg)
1 MNM
The Increasing Importance of
the Graphical User Interface
(GUI) in the Digital Age
USPTO Design Day
April 23, 2013
Charles L Mauro, CHFP
Chair, IDSA Design Protection Group
President
MauroNewMedia
Draft V5
![Page 2: The Increasing Importance of the Graphical User Interface ... · MNM 1 The Increasing Importance of the Graphical User Interface (GUI) in the Digital Age USPTO Design Day April 23,](https://reader033.vdocuments.us/reader033/viewer/2022051601/5ad52ce37f8b9a177c8ca711/html5/thumbnails/2.jpg)
Copyright
MauroNewMedia, Inc.
2013 All rights reserved
Confidential information 2
MNM
Definition of Graphical User Interface
► “Graphical user interface (GUI) is a
computer program that enables a person
to communicate with a computer through
the use of symbols, visual metaphors,
and pointing devices.”
![Page 3: The Increasing Importance of the Graphical User Interface ... · MNM 1 The Increasing Importance of the Graphical User Interface (GUI) in the Digital Age USPTO Design Day April 23,](https://reader033.vdocuments.us/reader033/viewer/2022051601/5ad52ce37f8b9a177c8ca711/html5/thumbnails/3.jpg)
Copyright
MauroNewMedia, Inc.
2013 All rights reserved
Confidential information 3
MNM
Components of the Graphical User Interface (GUI)
Keyboard
Graphical User Interface (Xerox Star / 1981)
Windows
Network
Printer
Directory
Trash
Folder
Input Device
Mouse
Direct Manipulation
Gesture vs. Text
![Page 4: The Increasing Importance of the Graphical User Interface ... · MNM 1 The Increasing Importance of the Graphical User Interface (GUI) in the Digital Age USPTO Design Day April 23,](https://reader033.vdocuments.us/reader033/viewer/2022051601/5ad52ce37f8b9a177c8ca711/html5/thumbnails/4.jpg)
Copyright
MauroNewMedia, Inc.
2013 All rights reserved
Confidential information 4
MNM
GUI History (Critical Introductions and Design Patent Events)
Xerox
Alto
1973
Xerox
Star
1981
Apple
Newton
1993
iPhone
Gen 1
2007
Glass
2013
MS
Window
1985 1984
Macintosh
128K
Apple Lisa
1983
Englebart’s
On-Line
System (NLS) Dec. 1968
The Mother of All Demos
1960s
?
2018
Xerox Star Patents
for Icons and
screens
Apple v. Microsoft
ruling related to
protection of GUI
USPTO ruling
allowing GUI
design patents
Apple v. Samsung
![Page 5: The Increasing Importance of the Graphical User Interface ... · MNM 1 The Increasing Importance of the Graphical User Interface (GUI) in the Digital Age USPTO Design Day April 23,](https://reader033.vdocuments.us/reader033/viewer/2022051601/5ad52ce37f8b9a177c8ca711/html5/thumbnails/5.jpg)
Copyright
MauroNewMedia, Inc.
2013 All rights reserved
Confidential information 5
MNM
Number of Devices Employing GUI Design Concepts B
illion
s o
f G
UI In
terfa
ce
s
Time
1
10
1984 1983 1973 1991 2007 2012-
2013
1993 1981 2018-20
Based on estimated total number of MS Windows , Apple and Android OS devices covering desktop, tablet and smartphone products
Inflection Point: What
accounts for the dramatic
increase in GUI-based
Interfaces?
![Page 6: The Increasing Importance of the Graphical User Interface ... · MNM 1 The Increasing Importance of the Graphical User Interface (GUI) in the Digital Age USPTO Design Day April 23,](https://reader033.vdocuments.us/reader033/viewer/2022051601/5ad52ce37f8b9a177c8ca711/html5/thumbnails/6.jpg)
Copyright
MauroNewMedia, Inc.
2013 All rights reserved
Confidential information 6
MNM
Connectedness / The Internet of Things
Devices that can be networked over the next 10 years
10 7
10 8
10 9
10 10
10 11
10 12
Computer clients
Hand held devices
Vehicles
Machinery
Home appliances
Pallets / cases
Consumer products
Source: MIT and Forrester Research (The Internet of Things)
Non-computer devices will soon account for the vast majority of
networked devices. The market for such devices is enormous.
![Page 7: The Increasing Importance of the Graphical User Interface ... · MNM 1 The Increasing Importance of the Graphical User Interface (GUI) in the Digital Age USPTO Design Day April 23,](https://reader033.vdocuments.us/reader033/viewer/2022051601/5ad52ce37f8b9a177c8ca711/html5/thumbnails/7.jpg)
Copyright
MauroNewMedia, Inc.
2013 All rights reserved
Confidential information 7
MNM
Functions C
Functions B
Functions A
SDK/GUI
API
App Store
What Happened To The GUI In The Internet of Things ?
Functions A
Functions B
Hardware
Interfaces
GUI Soft
Interfaces
Cloud
Functions C
Functions C
Functions B
Functions A
Cloud
![Page 8: The Increasing Importance of the Graphical User Interface ... · MNM 1 The Increasing Importance of the Graphical User Interface (GUI) in the Digital Age USPTO Design Day April 23,](https://reader033.vdocuments.us/reader033/viewer/2022051601/5ad52ce37f8b9a177c8ca711/html5/thumbnails/8.jpg)
Copyright
MauroNewMedia, Inc.
2013 All rights reserved
Confidential information 8
MNM
Example: Philips HUE Light Bulb
![Page 9: The Increasing Importance of the Graphical User Interface ... · MNM 1 The Increasing Importance of the Graphical User Interface (GUI) in the Digital Age USPTO Design Day April 23,](https://reader033.vdocuments.us/reader033/viewer/2022051601/5ad52ce37f8b9a177c8ca711/html5/thumbnails/9.jpg)
Copyright
MauroNewMedia, Inc.
2013 All rights reserved
Confidential information 9
MNM
Philips HUE Light Bulb: The Information Domain + 3 D’s
Router IP Address
Smart Product IP Address
HUE App IP Address
DOE
Public utilities
Research orgs.
Security firms
Maintenance firms
Data Cloud
IP Address
Dev. Cloud
IP Address
Philips.Com
Apple.Com
Google.Com
iOS developers
Android developers
Device Cloud
IP Address
Device control is now vastly broader and subjectively personalized by GUI
![Page 10: The Increasing Importance of the Graphical User Interface ... · MNM 1 The Increasing Importance of the Graphical User Interface (GUI) in the Digital Age USPTO Design Day April 23,](https://reader033.vdocuments.us/reader033/viewer/2022051601/5ad52ce37f8b9a177c8ca711/html5/thumbnails/10.jpg)
Copyright
MauroNewMedia, Inc.
2013 All rights reserved
Confidential information 10
MNM
Number of Devices Employing GUI Design
Based on estimated total number of MS Windows and Apple OS devices covering desktop, tablet and smartphone products
Time
1
10
1984 1983 1973 1991 2007 2012-
2013
1993 1981 2018-20
One product/device will
have multiple GUI control
interfaces from different
sources.
Billion
s o
f G
UI In
terfa
ce
s
![Page 11: The Increasing Importance of the Graphical User Interface ... · MNM 1 The Increasing Importance of the Graphical User Interface (GUI) in the Digital Age USPTO Design Day April 23,](https://reader033.vdocuments.us/reader033/viewer/2022051601/5ad52ce37f8b9a177c8ca711/html5/thumbnails/11.jpg)
Copyright
MauroNewMedia, Inc.
2013 All rights reserved
Confidential information 11
MNM
Why So Many New GUI Designs?
► OS GUI based on manufacturer’s API
► Apple iOS
► Android OS
► Microsoft OS
► Other protocols and networks (ZigBee…etc.)
Example: Apple iPhone camera feature
• 146 GUI solutions on the Apps Store
• 85 GUI major photo manipulation APPS
• 10 GUI major social media APPS
• Protecting GUI solutions will be a major
problem and opportunity for USPTO and the
legal community.
![Page 12: The Increasing Importance of the Graphical User Interface ... · MNM 1 The Increasing Importance of the Graphical User Interface (GUI) in the Digital Age USPTO Design Day April 23,](https://reader033.vdocuments.us/reader033/viewer/2022051601/5ad52ce37f8b9a177c8ca711/html5/thumbnails/12.jpg)
Copyright
MauroNewMedia, Inc.
2013 All rights reserved
Confidential information 12
MNM
Behavior Of Modern GUI v. Problems With IP Protection
Software Code
Line 1….Line X
FUNCTIONS
FEATURES
DATA
ALGO
Computer
Hardware and
Communications
Network.
GESTURES
FEEDBACK
NAVIGATION
Copyright
Utility
Patents
Trade Dress
User Experience (UX)
Design
Patents
![Page 13: The Increasing Importance of the Graphical User Interface ... · MNM 1 The Increasing Importance of the Graphical User Interface (GUI) in the Digital Age USPTO Design Day April 23,](https://reader033.vdocuments.us/reader033/viewer/2022051601/5ad52ce37f8b9a177c8ca711/html5/thumbnails/13.jpg)
Copyright
MauroNewMedia, Inc.
2013 All rights reserved
Confidential information 13
MNM
Critical Differences Between Product Design and GUI Design
Overall product is described
in orthographic projections.
(Real-world 3D product)
Overall Product (GUI) can only
be described through series of
transitional descriptions.
(Virtually-presented interactive
experience)
![Page 14: The Increasing Importance of the Graphical User Interface ... · MNM 1 The Increasing Importance of the Graphical User Interface (GUI) in the Digital Age USPTO Design Day April 23,](https://reader033.vdocuments.us/reader033/viewer/2022051601/5ad52ce37f8b9a177c8ca711/html5/thumbnails/14.jpg)
Copyright
MauroNewMedia, Inc.
2013 All rights reserved
Confidential information 14
MNM
Apple vs. Samsung (What was Apple trying to protect?)
► Apple initially accused Samsung of infringing:
► ‘381 patent: touchscreen interactions
► ‘915 patent: using an API to scroll through documents
► ‘163 patent: tap-to-zoom
► ‘677 patent: general outline and ornamental design
► ‘087 patent: general outline and ornamental design
► ‘889 patent: ornamental design
► ‘305 patent: GUI for a display screen
► Samsung countersued, accusing Apple of infringing:
► ‘914 patent: mobile phone 3G capabilities
► ‘516 patent: mobile phone 3G capabilities
► ‘711 patent: MP3 playback on a mobile device
► ‘460 patent: device that functions as a phone and a camera
► ‘893 patent: method for remembering user’s place in a gallery
Source: http://www.wired.com/gadgetlab/2012/07/apple-v-samsung-explained/
Apple UX
User
Exp
eri
en
ce
(UX
)
![Page 15: The Increasing Importance of the Graphical User Interface ... · MNM 1 The Increasing Importance of the Graphical User Interface (GUI) in the Digital Age USPTO Design Day April 23,](https://reader033.vdocuments.us/reader033/viewer/2022051601/5ad52ce37f8b9a177c8ca711/html5/thumbnails/15.jpg)
Copyright
MauroNewMedia, Inc.
2013 All rights reserved
Confidential information 15
MNM
Quote From April 13, 2013 Article by Mr. David Kappos
“For the innovators of the 21st century, design
has moved onto a much larger stage. It is
where high function meets high style. And the
traditional disciplines of IP — patents,
trademarks and copyrights — are no longer
ends unto themselves but are now viewed as
component parts of a larger whole.”
![Page 16: The Increasing Importance of the Graphical User Interface ... · MNM 1 The Increasing Importance of the Graphical User Interface (GUI) in the Digital Age USPTO Design Day April 23,](https://reader033.vdocuments.us/reader033/viewer/2022051601/5ad52ce37f8b9a177c8ca711/html5/thumbnails/16.jpg)
Copyright
MauroNewMedia, Inc.
2013 All rights reserved
Confidential information 16
MNM
Thank you
?