knowledge fusion research workshop st. michaels, maryland october 19-22, 2004 kmcoe surveillance...
TRANSCRIPT
![Page 1: Knowledge Fusion Research Workshop St. Michaels, Maryland October 19-22, 2004 KMCOE Surveillance Imagery Over An Agent-Based Platform Dr. Willie Thompson,](https://reader030.vdocuments.us/reader030/viewer/2022032517/56649cba5503460f94982470/html5/thumbnails/1.jpg)
Knowledge Fusion Research WorkshopSt. Michaels, Maryland October 19-22, 2004 KMCOEKMCOE
Surveillance Imagery Over An Agent-Based
Platform
Dr. Willie Thompson, IIDr. Damian Watkins
![Page 2: Knowledge Fusion Research Workshop St. Michaels, Maryland October 19-22, 2004 KMCOE Surveillance Imagery Over An Agent-Based Platform Dr. Willie Thompson,](https://reader030.vdocuments.us/reader030/viewer/2022032517/56649cba5503460f94982470/html5/thumbnails/2.jpg)
Knowledge Fusion Research WorkshopSt. Michaels, Maryland October 19-22, 2004 KMCOEKMCOE
Agenda
• Overview of Problem Space• Project Motivation & Significance• Project Methodology• Ongoing Work• Future work
![Page 3: Knowledge Fusion Research Workshop St. Michaels, Maryland October 19-22, 2004 KMCOE Surveillance Imagery Over An Agent-Based Platform Dr. Willie Thompson,](https://reader030.vdocuments.us/reader030/viewer/2022032517/56649cba5503460f94982470/html5/thumbnails/3.jpg)
Knowledge Fusion Research WorkshopSt. Michaels, Maryland October 19-22, 2004 KMCOEKMCOE
Environment Challenges
• Limited Resources– Limited energy, processing, & storage– Very limited bandwidth
• Wireless Communications– Open communication medium– Hidden Terminal Effect, Channel contention, noisy
channel– Monitoring may be difficult w/ security infrastructure
• Tactical Environment– Difficult to characterize normal behavior– Nodes prone to enemy capture– Limited analyst intervention
• Dynamic Environment– Mobile nodes and mobile infrastructure– No single concentration points for traffic analysis
![Page 4: Knowledge Fusion Research Workshop St. Michaels, Maryland October 19-22, 2004 KMCOE Surveillance Imagery Over An Agent-Based Platform Dr. Willie Thompson,](https://reader030.vdocuments.us/reader030/viewer/2022032517/56649cba5503460f94982470/html5/thumbnails/4.jpg)
Knowledge Fusion Research WorkshopSt. Michaels, Maryland October 19-22, 2004 KMCOEKMCOE
Role within BORG Research
B3A
Imagery DB
Soldier
HighlightsJCDBGIS...
Requirements,Cognitive
Autonomous Fusion and NavigationDistinct Sources
Data Streams
Content Based Messaging System
AFM
RSSRSSRSS...
Advanced Interactions
Story(VS - UMD)
Visualizations
Commander/Analysts
Tactical Operations Center Workstations
Command and Control
Interactive Fusion and NavigationSummary of Source
Website , Vignette, Requirements
Plans
WWWHeterogeneousData sources
Knowledge Engineering,
Cognitive Models,HCI
Java/C++ Sequal Server/Oracle UML Cognitive Models Sun JXTA
AFM
![Page 5: Knowledge Fusion Research Workshop St. Michaels, Maryland October 19-22, 2004 KMCOE Surveillance Imagery Over An Agent-Based Platform Dr. Willie Thompson,](https://reader030.vdocuments.us/reader030/viewer/2022032517/56649cba5503460f94982470/html5/thumbnails/5.jpg)
Knowledge Fusion Research WorkshopSt. Michaels, Maryland October 19-22, 2004 KMCOEKMCOE
Contributions
• Real-time data management and processing of data streams
• Situational aware and intelligent presentation
• Autonomous and secure agent interaction
![Page 6: Knowledge Fusion Research Workshop St. Michaels, Maryland October 19-22, 2004 KMCOE Surveillance Imagery Over An Agent-Based Platform Dr. Willie Thompson,](https://reader030.vdocuments.us/reader030/viewer/2022032517/56649cba5503460f94982470/html5/thumbnails/6.jpg)
Knowledge Fusion Research WorkshopSt. Michaels, Maryland October 19-22, 2004 KMCOEKMCOE
Project MethodologyData Source•Server•Camera•Archive
![Page 7: Knowledge Fusion Research Workshop St. Michaels, Maryland October 19-22, 2004 KMCOE Surveillance Imagery Over An Agent-Based Platform Dr. Willie Thompson,](https://reader030.vdocuments.us/reader030/viewer/2022032517/56649cba5503460f94982470/html5/thumbnails/7.jpg)
Knowledge Fusion Research WorkshopSt. Michaels, Maryland October 19-22, 2004 KMCOEKMCOE
Real Time Video Transmission
• Real Time Transport Protocol• Java Media Framework• Low power, low CPU power, small
form factor devices
![Page 8: Knowledge Fusion Research Workshop St. Michaels, Maryland October 19-22, 2004 KMCOE Surveillance Imagery Over An Agent-Based Platform Dr. Willie Thompson,](https://reader030.vdocuments.us/reader030/viewer/2022032517/56649cba5503460f94982470/html5/thumbnails/8.jpg)
Knowledge Fusion Research WorkshopSt. Michaels, Maryland October 19-22, 2004 KMCOEKMCOE
Real Time Transport Protocol (RTP)
• Enables steaming media• End-to-end network delivery services• Transport independent( usually
UDP)• Creates sessions between
application• Connectionless protocol
![Page 9: Knowledge Fusion Research Workshop St. Michaels, Maryland October 19-22, 2004 KMCOE Surveillance Imagery Over An Agent-Based Platform Dr. Willie Thompson,](https://reader030.vdocuments.us/reader030/viewer/2022032517/56649cba5503460f94982470/html5/thumbnails/9.jpg)
Knowledge Fusion Research WorkshopSt. Michaels, Maryland October 19-22, 2004 KMCOEKMCOE
Java Media Framework
• Acquisition, Processing, and Delivery of Time-based media
• Time-> nanosecond precision• Create and manage players w/
multiple RTP sessions• Compatible w/AIFF, AU, AVI, GSM, MIDI,
MPEG, QuickTime, RMF, and WAV formats
![Page 10: Knowledge Fusion Research Workshop St. Michaels, Maryland October 19-22, 2004 KMCOE Surveillance Imagery Over An Agent-Based Platform Dr. Willie Thompson,](https://reader030.vdocuments.us/reader030/viewer/2022032517/56649cba5503460f94982470/html5/thumbnails/10.jpg)
Knowledge Fusion Research WorkshopSt. Michaels, Maryland October 19-22, 2004 KMCOEKMCOE
Intelligent Agents• Software Program• Agency and intelligence are the
fundamental underlying capabilities • Autonomy – separate process/thread• Intelligence – hard-coded logic,
complex reasoning, learning.• Implemented w/ JAVA
![Page 11: Knowledge Fusion Research Workshop St. Michaels, Maryland October 19-22, 2004 KMCOE Surveillance Imagery Over An Agent-Based Platform Dr. Willie Thompson,](https://reader030.vdocuments.us/reader030/viewer/2022032517/56649cba5503460f94982470/html5/thumbnails/11.jpg)
Knowledge Fusion Research WorkshopSt. Michaels, Maryland October 19-22, 2004 KMCOEKMCOE
Why use Intelligent Agents?Soldier (Node) Level Detection
AnalysisCommand Level Detection Analysis
•Need an answer quickly•Few data sources•Limited Bandwidth•Solution:
•Autonomous & Intelligent process to gather and display relevant info•Intelligent Agents are autonomous and intelligent
•Have the luxury of time•Abundant Data sources•Bandwidth•Solution:
•Autonomous processes may be used but not necessary
![Page 12: Knowledge Fusion Research Workshop St. Michaels, Maryland October 19-22, 2004 KMCOE Surveillance Imagery Over An Agent-Based Platform Dr. Willie Thompson,](https://reader030.vdocuments.us/reader030/viewer/2022032517/56649cba5503460f94982470/html5/thumbnails/12.jpg)
Knowledge Fusion Research WorkshopSt. Michaels, Maryland October 19-22, 2004 KMCOEKMCOE
Test Methodology
• Invoke JMF methods within Agent based platform.
• Agent Creates RTP session with data source and/or other agents.
• Analyze Performance of RTP and agent communication over wireless network.
![Page 13: Knowledge Fusion Research Workshop St. Michaels, Maryland October 19-22, 2004 KMCOE Surveillance Imagery Over An Agent-Based Platform Dr. Willie Thompson,](https://reader030.vdocuments.us/reader030/viewer/2022032517/56649cba5503460f94982470/html5/thumbnails/13.jpg)
Knowledge Fusion Research WorkshopSt. Michaels, Maryland October 19-22, 2004 KMCOEKMCOE
Test ScenarioPeer-to-Peer network
RTP Session1/UDP RTP Session2/UDP
Streaming Source node
![Page 14: Knowledge Fusion Research Workshop St. Michaels, Maryland October 19-22, 2004 KMCOE Surveillance Imagery Over An Agent-Based Platform Dr. Willie Thompson,](https://reader030.vdocuments.us/reader030/viewer/2022032517/56649cba5503460f94982470/html5/thumbnails/14.jpg)
Knowledge Fusion Research WorkshopSt. Michaels, Maryland October 19-22, 2004 KMCOEKMCOE
Test Platform
Streaming RTP Video Session
flyovervideo150m
Video Source
![Page 15: Knowledge Fusion Research Workshop St. Michaels, Maryland October 19-22, 2004 KMCOE Surveillance Imagery Over An Agent-Based Platform Dr. Willie Thompson,](https://reader030.vdocuments.us/reader030/viewer/2022032517/56649cba5503460f94982470/html5/thumbnails/15.jpg)
Knowledge Fusion Research WorkshopSt. Michaels, Maryland October 19-22, 2004 KMCOEKMCOE
DATA traffic
• Rendering streaming tends to be slow
• Packet Errors and congestion over wireless network– High broadcast, network management
traffic• Approx. 82% of total traffic
– Large packet sizes for video frames • 1 Mega Byte packet size
![Page 16: Knowledge Fusion Research Workshop St. Michaels, Maryland October 19-22, 2004 KMCOE Surveillance Imagery Over An Agent-Based Platform Dr. Willie Thompson,](https://reader030.vdocuments.us/reader030/viewer/2022032517/56649cba5503460f94982470/html5/thumbnails/16.jpg)
Knowledge Fusion Research WorkshopSt. Michaels, Maryland October 19-22, 2004 KMCOEKMCOE
Agent BroadcastTraffic
![Page 17: Knowledge Fusion Research Workshop St. Michaels, Maryland October 19-22, 2004 KMCOE Surveillance Imagery Over An Agent-Based Platform Dr. Willie Thompson,](https://reader030.vdocuments.us/reader030/viewer/2022032517/56649cba5503460f94982470/html5/thumbnails/17.jpg)
Knowledge Fusion Research WorkshopSt. Michaels, Maryland October 19-22, 2004 KMCOEKMCOE
RTP BroadcastTraffic
![Page 18: Knowledge Fusion Research Workshop St. Michaels, Maryland October 19-22, 2004 KMCOE Surveillance Imagery Over An Agent-Based Platform Dr. Willie Thompson,](https://reader030.vdocuments.us/reader030/viewer/2022032517/56649cba5503460f94982470/html5/thumbnails/18.jpg)
Knowledge Fusion Research WorkshopSt. Michaels, Maryland October 19-22, 2004 KMCOEKMCOE
Shortcomings
• Connectionless RTP– Frames are not guaranteed to arrive– Frames arrive out of order
• Inconsistent multiple RTP sessions• High broadcast overhead
– Network management traffic– Agent Communication overhead
![Page 19: Knowledge Fusion Research Workshop St. Michaels, Maryland October 19-22, 2004 KMCOE Surveillance Imagery Over An Agent-Based Platform Dr. Willie Thompson,](https://reader030.vdocuments.us/reader030/viewer/2022032517/56649cba5503460f94982470/html5/thumbnails/19.jpg)
Knowledge Fusion Research WorkshopSt. Michaels, Maryland October 19-22, 2004 KMCOEKMCOE
Future Work
• Agent Cooperation– Create and Manage RTP session– Authenticate and secure hosts
• Run RTP over reliable UDP• Construct Representative Environment
– Real MANET environment • TEALAB CTA04• D. Watkins, C. Scott, “Methodology for Evaluating
the Effectiveness of Intrusion Detection in Tactical Mobile Ad-hoc Networks”, IEEE Wireless Communications and Networking Conference 2004.
– Virtual Environment (VMware)
![Page 20: Knowledge Fusion Research Workshop St. Michaels, Maryland October 19-22, 2004 KMCOE Surveillance Imagery Over An Agent-Based Platform Dr. Willie Thompson,](https://reader030.vdocuments.us/reader030/viewer/2022032517/56649cba5503460f94982470/html5/thumbnails/20.jpg)
Knowledge Fusion Research WorkshopSt. Michaels, Maryland October 19-22, 2004 KMCOEKMCOE
References
• V.S. Subrahmanian, et al, Heterogeneous Agent Systems, MIT Press, 2000
• Java Media Framework, 2.0. Guide: http://java.sun.com/products/java-media/jmf/reference/docs/index.html
• RTP Specification: http://www.faqs.org/rfcs/rfc1889.html
![Page 21: Knowledge Fusion Research Workshop St. Michaels, Maryland October 19-22, 2004 KMCOE Surveillance Imagery Over An Agent-Based Platform Dr. Willie Thompson,](https://reader030.vdocuments.us/reader030/viewer/2022032517/56649cba5503460f94982470/html5/thumbnails/21.jpg)
Knowledge Fusion Research WorkshopSt. Michaels, Maryland October 19-22, 2004 KMCOEKMCOE
Questions?
Comments?