application of constraint-based technologies in financial...
TRANSCRIPT
FinRec‘16 Workshop, Bari, Italy
Institute for Software Technology
1
Application of Constraint-based
Technologies in Financial Services
Recommendation
Alexander Felfernig
Graz University of Technology, Austria
Workshop on ConfigurationNovi Sad, 25.-26. Sep. 2014
FinRec‘16
Bari, Italy, June 16th 2016
FinRec‘16 Workshop, Bari, Italy
Institute for Software Technology
2
• Motivation
• Constraint-based Recommendation
• Knowledge Acquisition
• Recommendation Knowledge for e-Learning
• Future Work: New Product Development
• Conclusions
Overview
FinRec‘16 Workshop, Bari, Italy
Institute for Software Technology
3
Motivation
Financial services can be complex
Dependencies between services and additional
restrictions (e.g., limited resources and age limits)
Recommendation algorithms have to take
constraints into account
Knowledge acquisition issues exist (efforts in terms
of knowledge base development & maintenance)
Efficient testing and debugging is needed
FinRec‘16 Workshop, Bari, Italy
Institute for Software Technology
4
Motivation (contd.)
Recommendation process is conversational
Users have to be proactively supported
(e.g., if no solution can be identified)
Sales representatives should not only rely on the
proposed recommendations & explanations
Sales knowledge has to be internalized
Sales knowledge from recommenders should be reused
when training sales representatives
FinRec‘16 Workshop, Bari, Italy
Institute for Software Technology
5
Recommender Systems
• Collaborative: recommendations based on
preferences of „nearest neighbors“
• Content-based: recommendations based on an
analysis of consumed items
• Knowledge-based: usage of constraints (constraint-
based recommendation) or similarities (critiquing)
• Recommendations for groups: i.e., not single users
• Focus of this talk: constraints
D. Jannach, M. Zanker, A. Felfernig, and G. Friedrich, Recommender Systems –
An Introduction, Cambridge University Press, 2010.
FinRec‘16 Workshop, Bari, Italy
Institute for Software Technology
6
Constraint-based
Recommendation as CSP
Variables V = {av,wr,rr}
Domains D = {dom(av)={low,medium,high},
dom(wr)={low,medium,high},
dom(rr)={low,medium,high}}
Constraints C = {c1:not(av = high and wr = high),
c2:not(wr = low and rr = high),
c3:not(rr = high and av = high)}
Customer Requirements CREQ = {r1: av = high,
r2: rr = low}
A. Felfernig and R. Burke.
Constraint-based
Recommender Systems:
Technologies and Research
Issues, ACM International
Conference on Electronic
Commerce (ICEC'08),
Innsbruck, Austria, Aug. 19-
22, pp. 17-26, 2008.
FinRec‘16 Workshop, Bari, Italy
Institute for Software Technology
7
Solutions & Ranking
• Solutions can be determined with CSP solving
• Often there exist many solutions
• Solutions have to be ranked
• Utility-based: ranking of solutions with regard to their
contributions to a set of interest dimensions
• Similarity-based: distance of solution with regard to
optimal values (e.g., less is better, more is better, etc.)
FinRec‘16 Workshop, Bari, Italy
Institute for Software Technology
8
Resolving Inconsistencies in CREQ
c1
Customer Requirements (CREQ) Diagnosis
with Customer Requirements (ri CREQ)
c2
c3
cn
Should be: consistent
But: inconsistent
Diagnosis CREQ:
C (CREQ-) consistent
Minimal(): not ¬‘: ‘
Conflict Set CS CREQ:
CS C inconsistent
Minimal(CS): ¬CS‘: CS‘ CS
A. Felfernig, G. Friedrich, D. Jannach, and M. Stumptner, Consistency-Based Diagnosis of
Configuration Knowledge Bases, Artificial Intelligence, 152(2):213—234, 2004.
r1
r2
rl
CCREQ
A. Felfernig, M. Schubert, and C. Zehentner. An Efficient Diagnosis Algorithm for
Inconsistent Constraint Sets, Artificial Intelligence for Engineering Design, Analysis,
and Manufacturing (AIEDAM), Cambridge University Press, 26(1):53-62, 2012.
FinRec‘16 Workshop, Bari, Italy
Institute for Software Technology
9
Prediction Quality (Precision)
Dataset: Computer Configuration Interaction Log (n= 415 sessions).
avg. #diagnoses: 5.32
std.dev.: 1.67
„Best
First“
# allowed guesses
A. Felfernig, M. Schubert, and S. Reiterer. Personalized Diagnosis for Over-
Constrained Problems, 23rd International Conference on Artificial
Intelligence (IJCAI 2013), Peking, China, (full paper), pp. 1990-1996, 2013.
FinRec‘16 Workshop, Bari, Italy
Institute for Software Technology
10
MyLife
• Alternative approach to financial services advisory
(integrated view on family situation)
• Recommenders determine individual services
• Further constraints used for resource balancing, e.g.,
investments per month should be below amount of
disposable capital
• MyLife features: complete view on contracts,
planning for whole family, visualization of goals
FinRec‘16 Workshop, Bari, Italy
Institute for Software Technology
11
Experiences from
Recommender Projects
• Example FS provider
+Pre-informed customers
+No faulty offers
+Reduced efforts for documenting advisory sessions
+Time savings of ~9mins per customer advisor session
• Reason: automated consistency checks & explanations
• 10% of products sold on the basis of constraint-based
recommenders (loans & funds), ~12.500 products p.a.
FinRec‘16 Workshop, Bari, Italy
Institute for Software Technology
12
Knowledge Acquisition
• Constraints C = {c1, c2, .., cn} have to be maintained
• Knowledge acquisition bottleneck: communication
overheads, too much time needed for maintenance
• Improvements in terms of regression testing and
automated debugging approaches
• If some of the test cases T = {t1, .., tm} are not fulfilled,
corresponding diagnoses can be determined
A. Felfernig, G. Friedrich, D. Jannach, and M. Stumptner, Consistency-Based Diagnosis of
Configuration Knowledge Bases, Artificial Intelligence, 152(2):213—234, 2004.
FinRec‘16 Workshop, Bari, Italy
Institute for Software Technology
13
Inconsistencies and
Redundancies in C
c1
Knowledge
Base (C) Diagnosis
c2
c3
cn
Should be: consistent
But: inconsistent
Diagnosis C: C - consistent
Minimal(): ¬‘: ‘
c1
Redundancy Elimination
(COREDIAG)
c2
c3
cn
Should be: non-redundant
But: redundant
Conflict Set CS C: CS C incons.
Minimal(CS): ¬CS‘: CS‘ CS
R. Bakker, D. Dikker, F. Tempelman, and P. Wogmim.
Diagnosing and solving over-determined constraint
satisfaction problems, 13th Intl. Joint Conf. on AI
(IJCAI’93), San Francisco, CA, pp. 276--281, 1993.
A. Felfernig, C. Zehentner, and B.Blazek. COREDIAG:
Eliminating Redundancy in Constraint Sets. 22nd
International Workshop on Principles of Diagnosis
(DX’11), Murnau, Germany, pp. 219—224, 2011.
C C
c:(C - {c}) C incons.
FinRec‘16 Workshop, Bari, Italy
Institute for Software Technology
14
Testing & Debugging
c1
Knowledge Base (C) Diagnosis
with Test Cases (ti T)
c2
c3
cn
Should be: consistent
But: inconsistent
Diagnosis C:
(C-) {ti} consistent ti T
Minimal(): not ¬‘: ‘
Conflict Set CS C:
ti T: {ti} CS inconsistent
Minimal(CS): ¬CS‘: CS‘ CS
A. Felfernig, G. Friedrich, D. Jannach, and M. Stumptner, Consistency-Based Diagnosis of
Configuration Knowledge Bases, Artificial Intelligence, 152(2):213—234, 2004.
t1
t2
tk
C
T
FinRec‘16 Workshop, Bari, Italy
Institute for Software Technology
15
WeeVis
Knowledge Acquisition
WeeVis: modeling constraint-based recommenders,
wiki-style definition and recommendation (weevis.org)
FinRec‘16 Workshop, Bari, Italy
Institute for Software Technology
16
Knowledge Acquisition:
Experiences
• Most domain experts (no computer science expertise)
are not able to directly develop knowledge bases
• However, there are also exceptions of the rule
• Reduced development efforts compared to
conventional (e.g. Java-based) software development
• More efficient knowledge acquisition due to
automated testing and debugging support
• Needed: test case generation for knowledge bases,
human computation
FinRec‘16 Workshop, Bari, Italy
Institute for Software Technology
17
Recommendation Knowledge
for e-Learning
• Sales representatives should not only rely on
recommendations & explanations
• Expert knowledge about product domain needed
• Means: trainings, e-learning environments
• Issue: e-learning contents needed
• Approach: automated content generation (in our
case: question generation)
FinRec‘16 Workshop, Bari, Italy
Institute for Software Technology
18
StudyBattles User InterfaceStudyBattles
start screen
Learning
applications,
e.g., related
to financial
services
FinRec‘16 Workshop, Bari, Italy
Institute for Software Technology
19
Basic Approach to Question Generation
• Recommendation task represented as CSP
• CSP can be exploited for generating questions …
(1) Given CREQ, which services to recommend?
(2) Inconsistent (CREQ), how to resolve inconsistency?
(3) Redundant (C), how to resolve redundancy?
(4) Inconsistent (C), how to resolve the inconsistency?
• Applicable for further types of well-formedness rules.
A. Felfernig, A. Shehadeh, M. Jeran, C. Gütl, T. Tran, M. Atas, S. Polat Erdeniz,
M. Stettinger, A. Akcay, and S. Reiterer, STUDYBATTLES: A Learning Environment for
Knowledge-based Configuration, submitted to Configuration Workshop 2016.
FinRec‘16 Workshop, Bari, Italy
Institute for Software Technology
20
Future Work:
New Product Development
• New products and services
are developed
• Feedback from customers &
sales needed (e.g., new sums)
• Open Innovation integrates
communities as soon as possible
into new product development
• Group decision support needed,
e.g., in the idea screening phase
FinRec‘16 Workshop, Bari, Italy
Institute for Software Technology
21
New Product Development:
Decision Tasks
Financial
Service
F1 F2 F3 F4 Fn
F21 F22 F41 F42 F43
F411 F412
mandatory
feature
alternative
sub-features
(XOR)
Example decisions: alternative sub-features (XOR),
optional features, and optional sub-features (OR)
optional
feature
A. Felfernig, D. Benavides,
J. Galindo, and F.
Reinfrank.Towards Anomaly
Explanation in Feature
Models, Workshop on
Configuration, Vienna,
Austria, pp. 117-124, ISBN:
979-10-91526-02-9, 2013
optional
sub-features
(OR)
FinRec‘16 Workshop, Bari, Italy
Institute for Software Technology
22
When to disclose preferences
of other users?
Group discussions increase the decision quality, but the
earlier preferences are disclosed, the lower the #comments.
M. Stettinger, A. Felfernig,
G. Leitner, and S. Reiterer.
Counteracting Anchoring
Effects in Group Decision
Making, 23rd Conference
on User Modeling,
Adaptation, and
Personalization (UMAP'15)
(UMAP Best Papers 2015),
Dublin, Ireland, LNCS 9146,
pp. 118-130, 2015.
FinRec‘16 Workshop, Bari, Italy
Institute for Software Technology
23
Ongoing Projects
• WeWant: Enabling Technologies for Group-based
Configuration (Austria Research Promotion Agency)
• PeopleViews: Recommender Systems based on
Human Computation (Austria Research Promotion
Agency)
• AGILE: Adoptive Gateways for dIverse MuLtiple
Environments in the Internet of Things (H2020
Project)
FinRec‘16 Workshop, Bari, Italy
Institute for Software Technology
24
Conclusions
• Constraint-based technologies help to improve the
overall quality of FS advisory processes
• Diagnosis improves efficiency of conversational
recommendation and knowledge engineering
• Improvements: reduced efforts related to customer
advisory and KB development & maintenance, more
efficient content generation
• Open issues: end-user programming support, automated
test case generation, counteracting decision biases
FinRec‘16 Workshop, Bari, Italy
Institute for Software Technology
25
Thank You!