© ramesh jain ramesh jain cto, praja inc. and professor emeritus, ucsd [email protected] emergent...
TRANSCRIPT
![Page 1: © Ramesh Jain Ramesh Jain CTO, PRAJA inc. and Professor Emeritus, UCSD rjain@praja.com Emergent Semantics and Experiential Computing](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649de75503460f94ae0797/html5/thumbnails/1.jpg)
© Ramesh Jain
Ramesh Jain
CTO, PRAJA inc.and
Professor Emeritus, [email protected]
Emergent Semanticsand
Experiential Computing
![Page 2: © Ramesh Jain Ramesh Jain CTO, PRAJA inc. and Professor Emeritus, UCSD rjain@praja.com Emergent Semantics and Experiential Computing](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649de75503460f94ae0797/html5/thumbnails/2.jpg)
© Ramesh Jain
Semantics
Meaning Negotiation process: requires agreement
among all involved participants Every User has their ‘personal ontology’ Personal ontology can not be matched
with the system ontology in one step (one query) --- requires an emergent process.
![Page 3: © Ramesh Jain Ramesh Jain CTO, PRAJA inc. and Professor Emeritus, UCSD rjain@praja.com Emergent Semantics and Experiential Computing](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649de75503460f94ae0797/html5/thumbnails/3.jpg)
© Ramesh Jain
Powerful Data Models: Relational
Information Sources
Video Audio SensorsData andStatistics
Text
Index Index Index Index Index
XMLFeature IndexedEarly Developments
![Page 4: © Ramesh Jain Ramesh Jain CTO, PRAJA inc. and Professor Emeritus, UCSD rjain@praja.com Emergent Semantics and Experiential Computing](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649de75503460f94ae0797/html5/thumbnails/4.jpg)
© Ramesh Jain
The Semantic Gulf Data is organized based on data
characteristics. Efficiency and Scalability are primary
User intentions and context are not considered. Query environment does not maintain the state
of the user.
![Page 5: © Ramesh Jain Ramesh Jain CTO, PRAJA inc. and Professor Emeritus, UCSD rjain@praja.com Emergent Semantics and Experiential Computing](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649de75503460f94ae0797/html5/thumbnails/5.jpg)
© Ramesh Jain
Access: Impedance Mismatch
Computers are millions of times faster than humans in arithmetic and logic.
People are millions of times better than computers in perceptual and conceptual tasks. Any one year old can recognize objects!
Current computing environments were designed for people to serve computers.
Consider computers and humans part of a symbiotic system.
![Page 6: © Ramesh Jain Ramesh Jain CTO, PRAJA inc. and Professor Emeritus, UCSD rjain@praja.com Emergent Semantics and Experiential Computing](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649de75503460f94ae0797/html5/thumbnails/6.jpg)
© Ramesh Jain
Semantic Indexing
Video Audio SensorsData andStatistics
Text
Index Index Index Index Index
Index and Link based on Event-graph
![Page 7: © Ramesh Jain Ramesh Jain CTO, PRAJA inc. and Professor Emeritus, UCSD rjain@praja.com Emergent Semantics and Experiential Computing](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649de75503460f94ae0797/html5/thumbnails/7.jpg)
© Ramesh Jain
Information Assimilation
UserEventBase
Model-Based
UpdatingAnd
Linking
Navigationand
VisualizationEnvironment
.
Semantic procedural updating
Semantic links used to display unstructured data
![Page 8: © Ramesh Jain Ramesh Jain CTO, PRAJA inc. and Professor Emeritus, UCSD rjain@praja.com Emergent Semantics and Experiential Computing](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649de75503460f94ae0797/html5/thumbnails/8.jpg)
© Ramesh Jain
Features of Experiential Environment
Natural Action Responses – No unusual metaphors
Query and Presentation spaces must be the same (What-You-See-Is-What-You-Get)
Continuity of User State and Context – Minimize Latency; Feedback
Multimedia Immersion and Exploration
Video games should be the model.
![Page 9: © Ramesh Jain Ramesh Jain CTO, PRAJA inc. and Professor Emeritus, UCSD rjain@praja.com Emergent Semantics and Experiential Computing](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649de75503460f94ae0797/html5/thumbnails/9.jpg)
© Ramesh Jain
Example Applications
![Page 10: © Ramesh Jain Ramesh Jain CTO, PRAJA inc. and Professor Emeritus, UCSD rjain@praja.com Emergent Semantics and Experiential Computing](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649de75503460f94ae0797/html5/thumbnails/10.jpg)
© Ramesh Jain
More than Five Century oldLegacy of GutenbergContinues…Despite all advances in technology…
DocumentWeb: Information Age
![Page 11: © Ramesh Jain Ramesh Jain CTO, PRAJA inc. and Professor Emeritus, UCSD rjain@praja.com Emergent Semantics and Experiential Computing](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649de75503460f94ae0797/html5/thumbnails/11.jpg)
© Ramesh Jain
Strategic Inflection Points
Documents on Web
(Information)
Events on Web(Experience)
1995 2000 2005 2010
Keyword Search
SemanticSearch
ContextualSearch
ImmersiveExperience
Updates and alerts
Ubiquitous Devices
![Page 12: © Ramesh Jain Ramesh Jain CTO, PRAJA inc. and Professor Emeritus, UCSD rjain@praja.com Emergent Semantics and Experiential Computing](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649de75503460f94ae0797/html5/thumbnails/12.jpg)
© Ramesh Jain
EventWeb: Experience Age
FamilySports
Fun
Knowledge
Personal
Finance
Office
![Page 13: © Ramesh Jain Ramesh Jain CTO, PRAJA inc. and Professor Emeritus, UCSD rjain@praja.com Emergent Semantics and Experiential Computing](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649de75503460f94ae0797/html5/thumbnails/13.jpg)
© Ramesh Jain
Top 5 Misconceptions
All users should have Ph.D. in Ontology. User queries are Context-Free. Users must be allowed only one query. Image and Video semantics is in features of
FULL images or video. All information is alpha-numeric.
![Page 14: © Ramesh Jain Ramesh Jain CTO, PRAJA inc. and Professor Emeritus, UCSD rjain@praja.com Emergent Semantics and Experiential Computing](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649de75503460f94ae0797/html5/thumbnails/14.jpg)
© Ramesh Jain
Thanks.
![Page 15: © Ramesh Jain Ramesh Jain CTO, PRAJA inc. and Professor Emeritus, UCSD rjain@praja.com Emergent Semantics and Experiential Computing](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649de75503460f94ae0797/html5/thumbnails/15.jpg)
© Ramesh Jain
Data ExperienceInformation
![Page 16: © Ramesh Jain Ramesh Jain CTO, PRAJA inc. and Professor Emeritus, UCSD rjain@praja.com Emergent Semantics and Experiential Computing](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649de75503460f94ae0797/html5/thumbnails/16.jpg)
© Ramesh Jain
Information Integration: 1
QueryParsing
AndReport
Generation
User
![Page 17: © Ramesh Jain Ramesh Jain CTO, PRAJA inc. and Professor Emeritus, UCSD rjain@praja.com Emergent Semantics and Experiential Computing](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649de75503460f94ae0797/html5/thumbnails/17.jpg)
© Ramesh Jain
![Page 18: © Ramesh Jain Ramesh Jain CTO, PRAJA inc. and Professor Emeritus, UCSD rjain@praja.com Emergent Semantics and Experiential Computing](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649de75503460f94ae0797/html5/thumbnails/18.jpg)
© Ramesh Jain
Time Machine - Replay
Example Apps
![Page 19: © Ramesh Jain Ramesh Jain CTO, PRAJA inc. and Professor Emeritus, UCSD rjain@praja.com Emergent Semantics and Experiential Computing](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649de75503460f94ae0797/html5/thumbnails/19.jpg)
© Ramesh Jain
Information System Evolution: Databases
QueryTranslation
And Response
Users
Queries
Declarative and Stateless
![Page 20: © Ramesh Jain Ramesh Jain CTO, PRAJA inc. and Professor Emeritus, UCSD rjain@praja.com Emergent Semantics and Experiential Computing](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649de75503460f94ae0797/html5/thumbnails/20.jpg)
© Ramesh Jain
Information System Evolution : Personalization
QueryTranslation
And Response
Users
P- Queries
PersonalizationFilters
Queries
Declarative and Stateless
![Page 21: © Ramesh Jain Ramesh Jain CTO, PRAJA inc. and Professor Emeritus, UCSD rjain@praja.com Emergent Semantics and Experiential Computing](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649de75503460f94ae0797/html5/thumbnails/21.jpg)
© Ramesh Jain
Information System Evolution : Contextual Systems
QueryTranslation
And Response
Users
P- Queries
PersonalizationFilters
QueriesContext
UserStates
Declarative and Stateless
![Page 22: © Ramesh Jain Ramesh Jain CTO, PRAJA inc. and Professor Emeritus, UCSD rjain@praja.com Emergent Semantics and Experiential Computing](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649de75503460f94ae0797/html5/thumbnails/22.jpg)
© Ramesh Jain
Contextual Navigation
Context
DataPresentation
System
Query
Query Transformation
What-You-See-Is-What-You-Get (WYSIWYG) Search.
![Page 23: © Ramesh Jain Ramesh Jain CTO, PRAJA inc. and Professor Emeritus, UCSD rjain@praja.com Emergent Semantics and Experiential Computing](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649de75503460f94ae0797/html5/thumbnails/23.jpg)
© Ramesh Jain
Kalman Filtering
Processing
Model
Data
![Page 24: © Ramesh Jain Ramesh Jain CTO, PRAJA inc. and Professor Emeritus, UCSD rjain@praja.com Emergent Semantics and Experiential Computing](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649de75503460f94ae0797/html5/thumbnails/24.jpg)
© Ramesh Jain
Basic Concept
Model: Mathematical State and other relations
Current State = F (Previous State, New Observations)
Models states and transitions based on each source of data
![Page 25: © Ramesh Jain Ramesh Jain CTO, PRAJA inc. and Professor Emeritus, UCSD rjain@praja.com Emergent Semantics and Experiential Computing](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649de75503460f94ae0797/html5/thumbnails/25.jpg)
© Ramesh Jain
Symbolic Kalman Filtering
The Model is Hybrid – combination of symbolic and mathematical.
Each Data Source is an independent observation source.
Model is updated based on its current state and new observations.
Essential for live and sensory data assimilation.
![Page 26: © Ramesh Jain Ramesh Jain CTO, PRAJA inc. and Professor Emeritus, UCSD rjain@praja.com Emergent Semantics and Experiential Computing](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649de75503460f94ae0797/html5/thumbnails/26.jpg)
© Ramesh Jain
Entities and Events
Events are dynamic.
Event
Name
Duration
Location
AttributesData-streams
ProcessesAdjacent StatesRelated Links
Entity
Name
Attributes
Processes(Services)
Objects and Entities
are static.
![Page 27: © Ramesh Jain Ramesh Jain CTO, PRAJA inc. and Professor Emeritus, UCSD rjain@praja.com Emergent Semantics and Experiential Computing](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649de75503460f94ae0797/html5/thumbnails/27.jpg)
© Ramesh Jain
Modeling a Domain
Event Graphs: Capture relationships among events and entities.
Event Transitions: Conditions and probabilities of transitions.
![Page 28: © Ramesh Jain Ramesh Jain CTO, PRAJA inc. and Professor Emeritus, UCSD rjain@praja.com Emergent Semantics and Experiential Computing](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649de75503460f94ae0797/html5/thumbnails/28.jpg)
© Ramesh Jain
Experience:
Direct Observation of or Participation in
Events as a basis of knowledge
![Page 29: © Ramesh Jain Ramesh Jain CTO, PRAJA inc. and Professor Emeritus, UCSD rjain@praja.com Emergent Semantics and Experiential Computing](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649de75503460f94ae0797/html5/thumbnails/29.jpg)
© Ramesh Jain
Objectives
Experiential environments are the next major technology inflexion point.
Unified indexing of assimilated data is essential to implement experience-centric, rather than current information-centric, systems.
Semantics is ubiquitous and emerges with symbiotic interactions among a user and the system.
![Page 30: © Ramesh Jain Ramesh Jain CTO, PRAJA inc. and Professor Emeritus, UCSD rjain@praja.com Emergent Semantics and Experiential Computing](https://reader035.vdocuments.us/reader035/viewer/2022062516/56649de75503460f94ae0797/html5/thumbnails/30.jpg)
© Ramesh Jain
Information Integration: 2
UserIntegratedDatabase