knowledge-based service quality assurance for korea e-government 29 th april 2008 youngkon lee...
TRANSCRIPT
Knowledge-Based Service Quality Assurance for Korea e-Government
29th April 2008
Youngkon Lee (NIA/WSQM TC)
contents
Introduction
Implementation of WSQMS
Quality Data of WSQMS
Connect WSQMS with WS Registry
Update WS Registry
Quality Classification for WS Registry
Modification of WS Registry
Classification
Conclusions
WSQM TC 33
Question
Introduction
We implemented Korea e-Government Web service framework,
but ..
How to guarantee quality of Web services?
How to evaluate Web services?
How to store the quality of Web services?
How to search Web service on quality information?
Answer Implement Web Service Quality Management System (WSQMS)
Store quality data in WSQMS
Connect WSQMS with WS Registry
Modify a part of WS Registry data structure
WSQM TC
Web service provider
44
Quality Test
Implementation of WSQMS
Automatic test by agent
Reference to TAD(Test Assertion Document)
XML type report
Test of performance, conformability, message reliability, and
security
WSQMS
TAD (test assertion
document)
distribute test program
request quality test
auto executionrefer TAD
perform quality test
send quality test result
inspect quality test report
Quality test report(XML)TAD
• response time and throughput
• conformability
• message reliability
• security
Web service system
WSQM TC
Quality contents
Business Value
•Frequency of service use(month/day/hour)• frequency of service use per customer use(month/day/hour)• reputation
Service Level
• performance(response time, throughput)• reliability(usability, accessability, successability)
Interoperability
• conformability(WSDL, SOAP)• WS-I Basic Profile• e-Government WS Basic Profile
Business Processing• message reliability(WS-Reliability)• collaborativeness of WS (WSBPEL) 55
Quality Monitoring
Implementation of WSQMS
Monitoring WS periodically
Measuring of business value, service level, business processing and
interoperability
Web service
Web service
Use service
message notification
refer TAD
TAD
• Interoperability
• conformability
• message reliability
• collaborability of WS
quality analysis
Web service
associate
provide quality report
request quality report
Agent
Agent
message notification
WSQMS
WSQM TC
Type InformationSupport
type
Web service
• number of request• number of success/failure• operating time• max/min response time
• Axis Plug-in• Servlet Filter• Proxy
WS containe
r
• usable memory• number of HTTP requests• number of HTTP failure• data amount of HTTP request/response• max/min number of HTTP threads• number of current operating HTTP threads
• Tomcat 5.x• Sun Application Server 8.x• IIS 5.x
OS
• CPU usage• real memory usable• virtual memory usable• Page In/Out/Fault• disk usage
• Solaris 8/9• HP-UX 11/11i• Windows 2000/XP/2003
66
Operation Monitoring
Implementation of WSQMS
Real time monitoring WS, WS container, OS
Provide quality and operating report
Use WSDM spec and agent architecture
Web service system
Install agent
Request to subscribe operation information
WSQMS
Agent
Notify operation information
System manager
Register manager and service
Download agent
Reports
Provide the operation information
Real-time monitoring forWeb service resource
WSQM TC 77
Quality Factor
MeasurableFactor
EvaluationFactor
• Availability
• Accessability
• Successability
• Response time
• Throughput
Eval.Criteria
No Eval.Criteria
• Security
• Interoperability
• Biz Process
• Management
• Biz Value
• price
• service suitability
• use effect
• service brand
Single Criteria
ComplexCriteria
WSQDL for quality classification
Follows the criteria of WSQM for quality classification
Composed of 4 major quality factors
Quality Data of WSQMS
WSQM TC 88
WSQDL(Web Service Quality Description Language)
Quality Data of WSQMS
Composed of factor, subfactor, property, subproperty, function, and
performance
Concept of quality chain (connected factors)
Target Web services
Quality Factor
Biz process factor
Eval factor
Biz value factor
Measure factor
Property Sub property Function Performance
Sub factor
Sub factor Property Appraisal
Sub factor Property Function Performance
Metric
WSQM TC 99
Why?
Connect WSQMS with WS Registry
User wants to search on quality data
Quality data is variable -> should be synchronized
WSQMS and WS Registry is complementary for each other
How?
Preserve functional independency
Sharing quality data
Implement API of SOAP-based
Automatic operation
WSQM TC 1010
Method 1: WS registry has a reference to WS quality data in WSQMS
How to share Quality Data?
Need no synchronization process for quality data between WS
registry and WSQMS
Restriction in use of quality data at WS registry
Method 2: WS registry has copy of WSQDL from WSQMS Need the synchronization process
Possible to search WS on WS quality data
Connect WSQMS with WS Registry
WSQM TC 1111
Scenario of Method 1
Connect WSQMS with WS Registry
WSQMS initiates WS quality activity
WS Registry provides WSDL
WSQMS provides quality information
Web service provider
register Web service
request new Web service info
provide WSDL of new Web service
Web service
test with agent
store quality data
Connection API
store reference of quality data
provide reference of quality info
WS RegistryWeb Service Quality Management System
Web serviceQuality info
WSQM TC 1212WS Provider
provide WSDL of new WS + request info of quality context
Web service
test with agent
ConnectionAPI
provide info of quality context
WS Registry
WS Registry manager
register quality context
register WS
Scenario of Method 2 WS Registry requests the data of quality context of a new WS
WSQMS provides WSQDL after testing
WS registry parses it and store the quality value as quality context
Web Service Quality Management System
store value of WS quality context
Web serviceQuality info
store quality data
Connect WSQMS with WS Registry
WSQM TC 1313
Connection APIs
classification API name Function description
Search new WS
find_newBusinesses Search new biz entity
find_newServices Search new biz service
find_newBindings Search new binding
find_newtModels Search new tModel
Save WS quality data
save_refOfWSQDL
save_qualityContext
Write reference to quality data in tModelStore the quality context inform.
Modify&delete WS quality data
delete_qualityDataupdate_qualityData
Delete WSQDL tModel Modify WSQDL tModel
Synch WS inform
synch_WSDLSynch periodically WSDL between WSQMS and WS registry
Time inform of updating quality data
get_lastUpdateTimeQDget_lastUpdateTimeQC
Last update time of WSQDLLast update time for quality context
Messaging I/F
Security I/F
Registry Service Receiver
Quality Data Query Manager
Quality Data LC Manager
Quality Data Sender
Registry Service Requester
WSQMS
Messaging I/F
Security I/F
Registry Service Sender
Quality Data Requester
Quality Data LC Requester
Quality Data Receiver
Registry Service Request Receiver
Web Registry
For connection, quality data processing, WS registry service, and messaging
& security APIs are required.
Each module is composed of necessary functions, used by SOAP I/F.
Connect WSQMS with WS Registry
WSQM TC 1414
Question
Update WS Registry
How to preserve the current implementation as possible as?
How to connect with WSQMS seamlessly?
How to organize the quality classification scheme?
Answer
Follow UDDI spec as possible as
Provide APIs for connection in SOAP style
Devise a new data structure such as categoryBag and quality
context
WSQM TC 1515
Method 1: modify overviewDoc
Add <wsqdlURL> tag in <overviewDoc>
Easy to understand, but difficult to process quality data flexibly
Update WS Registry
WSQM TC 1616
Method 2: add qualityBag
Add <qualityBag> tag in
tModel such as
<categoryBag>, storing
quality data reference
in tModel.
Possible independent
processing for quality
reference
Update WS Registry
WSQM TC 1717
Method 3: add qualityContext
Add <qualityBag> tag in
tModel such as method 2
for representing
<qualityContext>
Update WS Registry
WSQM TC 1818
Purpose
Quality Classification for WS Registry
Enable user to search WS on quality data.
Enable high-level composite search on quality data.
For example: Search WS satisfying WS-I interoperability with 128
encryption key for DSIG, responding 0.01 sec.
Issues
How to compose the quality classification scheme?
How to update the value of quality classification item
up-to-date?
WSQM TC 1919
WSQDL
Metric Eval Biz Proc Biz Val
Interop Sec Manage
keySize encAlg
WSQMS UDDI tModel
<qualityBag> <tModelKey=“uddi:uddi.org:wsqm:quality:wsqdl-3344”/>
<qualityContext tModelKey=“uddi:uddi.org:wsqm:eval:security:keySize” value=“128”/>
<qualityContext tModelKey=“uddi:uddi.org:wsqm:eval:security:encAlg” value=“RSA”/>
</qualityBag>
Concept of quality context Path for representing quality factor according to WSQDL quality
chain
Represented as a set in <qualityBag>
Quality Classification for WS Registry
WSQM TC 2020
WSDL 1
Quality context 1 value
Quality context 2 value
Quality context 3 value
WSDL 2
Quality context 1 value
Quality context 2 value
Quality context 3 value
WSDL 3
Quality context 1 value
Quality context 2 value
Quality context 3 value
Quality Context
WSquality
/eval/sec/keySize128: WS1, WS2
64: WS3
/eval/sec/encAlgRSA: WS1
DES: WS2, WS3
/eval/int/ratioWSI99: WS1
< 97: WS3
98: WS2
Quality classification
Quality classification Compose quality classification scheme with quality context Get a quality value on the quality context
Quality Classification for WS Registry
WSQM TC 21
Background
Adopt UN/SPSC classification scheme for WS classification scheme, but
UN/SPSC classification is too complex to use WS classification.
55 segments, 350 families, 3600 classes, 17000 commodities
There are similar classification item and items with no clear criteria for
classification.
Most items in UN/SPSC is for industry of manufacturing.
Need an Advanced classification architecture
Modification of WS Registry Classification
WSQM TC 22
Modification of WS Registry Classification
Method1: caching classification data
• Preserve cache storage for an item of classification scheme accessed once.• Give priority number to the cached data according to its access number • Issues
– Performance degradation due to abnormal access
Classification Scheme for WS Registry
request searchsearch
return result
cache data
result
Cache storage
segment
family
class
commodity
WSQM TC 23
Method 2: make synonym dictionary
• Implement synonym dictionary on the classification scheme.• Issues:
– Objective criteria for deciding synonymy of classification items
segment
family
class
commodity
Refer synonym
search
return result
Synonym dictionary
Classification Scheme for WS Registry
Modification of WS Registry Classification
WSQM TC
segment
family
class
commodity
Classification Scheme for WS Registry
24
Method 3: tagging accessed classification items by user
• User tags classification items accessed with tag named by the user. • User can search more easily based on the tag data• Issues:
– Obstacle of tag data named wrongly.
request search
Return result
Tag classification
Modification of WS Registry Classification
WSQM TC 25
Method 4: implement knowledge ontology for classification
• Define knowledge ontology classification item frequently asked. • For example,
– If a public project related with energy, then find out energy saving, measuring usage of energy, district heating.
• Issues – Difficult to make knowledge rule– Require additional knowledge search system.
Modification of WS Registry Classification
WSQM TC
segment
family
class
commodity
Classification Scheme for WS Registry 26
Method 5: user classification with mapping script
• Make user classification scheme (industry, service, usage,…)• By mapping script, user classification should be synchronized with master
classification.• Issues:
– How to expand user classification flexibly
request search
Return result
User classification
Mapping script
Modification of WS Registry Classification
WSQM TC 27
• After completion of these systems, WSQMS and WS registry, they could
contribute to enhance WS quality more rapidly.
WSQMS has been implemented.
trying to implement connection APIs
plan to modify national WS registry
• Classification scheme is critical for WS dissemination. It needs
continuous modification efforts.
• Further research for connection between national WS registries
Conclusions