presentation on "recommenders in social learning platforms" at #iknow2014 & #ectel2014...
DESCRIPTION
#recsys for #social #learning platforms, presented at #iknow2014 & #ECTEL2014 in Graz, Sep. 2014TRANSCRIPT
![Page 1: Presentation on "Recommenders in Social Learning Platforms" at #iknow2014 & #ECTEL2014 in Graz, Sep. 2014](https://reader036.vdocuments.us/reader036/viewer/2022081400/54c490ae4a7959936f8b458a/html5/thumbnails/1.jpg)
Which Recommender System Can Best Fit Social Learning Platforms? Soude Fazeli, PhD candidate, OUNL Babak Loni, TU Delft Dr. Hendrik Drachsler, OUNL Prof. dr. Peter Sloep, OUNL
![Page 2: Presentation on "Recommenders in Social Learning Platforms" at #iknow2014 & #ECTEL2014 in Graz, Sep. 2014](https://reader036.vdocuments.us/reader036/viewer/2022081400/54c490ae4a7959936f8b458a/html5/thumbnails/2.jpg)
Pagina 2
Which Recommender System Can Best Fit Social Learning Platforms?
2
A socially-powered, multilingual open learning infrastructure in Europe
Open Discovery Space (ODS)
Recommendations! Which recommender approach best fits ODS platform?
![Page 3: Presentation on "Recommenders in Social Learning Platforms" at #iknow2014 & #ECTEL2014 in Graz, Sep. 2014](https://reader036.vdocuments.us/reader036/viewer/2022081400/54c490ae4a7959936f8b458a/html5/thumbnails/3.jpg)
Pagina 3
1. Content-based 2. Collaborative filtering
Recommender algorithms
✓
![Page 4: Presentation on "Recommenders in Social Learning Platforms" at #iknow2014 & #ECTEL2014 in Graz, Sep. 2014](https://reader036.vdocuments.us/reader036/viewer/2022081400/54c490ae4a7959936f8b458a/html5/thumbnails/4.jpg)
Pagina 4
Sparsity!
Similarity
![Page 5: Presentation on "Recommenders in Social Learning Platforms" at #iknow2014 & #ECTEL2014 in Graz, Sep. 2014](https://reader036.vdocuments.us/reader036/viewer/2022081400/54c490ae4a7959936f8b458a/html5/thumbnails/5.jpg)
Pagina 5
Learning domain has its own data, limitations, and expectations • Too sparse data • Too few 5-star ratings • Often no proper tags and annotations • Can not use only popular reference datasets like MovieLens, Netflix, etc.
Dataset Users
Learning objects
Transactions
Sparsity (%)
MACE 105 5,696 23,032 99.71
OpenScout 331 1,568 2,560 99.51
MovieLens 100k
941 1,512 96,719 93.69
![Page 6: Presentation on "Recommenders in Social Learning Platforms" at #iknow2014 & #ECTEL2014 in Graz, Sep. 2014](https://reader036.vdocuments.us/reader036/viewer/2022081400/54c490ae4a7959936f8b458a/html5/thumbnails/6.jpg)
Pagina 6
RQ: How to generate more accurate and thus more relevant recommendations for the users in social learning platforms by employing graph-based methods?
![Page 7: Presentation on "Recommenders in Social Learning Platforms" at #iknow2014 & #ECTEL2014 in Graz, Sep. 2014](https://reader036.vdocuments.us/reader036/viewer/2022081400/54c490ae4a7959936f8b458a/html5/thumbnails/7.jpg)
Pagina 7
A graph-based recommender system • Implicit networks: a graph
– Nodes: users
– Edges: similarity relationships
– Weights: similarity values
• Improve the process of finding nearest neighbors
– Social Index (S-index) for each user
– H-index: the impact of publications of an author
![Page 8: Presentation on "Recommenders in Social Learning Platforms" at #iknow2014 & #ECTEL2014 in Graz, Sep. 2014](https://reader036.vdocuments.us/reader036/viewer/2022081400/54c490ae4a7959936f8b458a/html5/thumbnails/8.jpg)
Pagina 8
Creating the graph
Algorithm 1 Computing S-index for user u
upon event (COMPUTE S-INDEX| u, NeighborsList) SortedNeighborsList SortDescendingBySimilarityScore(NeighborsList); FinalNeighborsList Normalize(SortedNeighborsList,MaximumSindex); Sindex 0; for ( similarityScore(u,n); n in FinalNeighborsList) do if Sindex <= similairtyScore then Sindex= Sindex+1; else Break; end if
end for updateSindex(Sindex); end event
![Page 9: Presentation on "Recommenders in Social Learning Platforms" at #iknow2014 & #ECTEL2014 in Graz, Sep. 2014](https://reader036.vdocuments.us/reader036/viewer/2022081400/54c490ae4a7959936f8b458a/html5/thumbnails/9.jpg)
Onderwerp via >Beeld >Koptekst en voettekst Pagina 9
Indegree (ua) = 7 Indegree (ub) = 5 S-index (ua ) = 2 S-index (ub ) = 4
![Page 10: Presentation on "Recommenders in Social Learning Platforms" at #iknow2014 & #ECTEL2014 in Graz, Sep. 2014](https://reader036.vdocuments.us/reader036/viewer/2022081400/54c490ae4a7959936f8b458a/html5/thumbnails/10.jpg)
Pagina 10
Collecting recommendations
G(V,E) = CreateSocialGraph(); // V contains users // E contains similarity relations between users
for all u�V do ComputeSindex(u, N); // N contains users who have user u as their neighbor G(V,E′) BFS(u, G(V,E)); // E � E′ where E′ contains: // 1. explicit similarity relations (u,n)� E and // 2. new inferred relations (u, n′) TopItems CollectRecommendations(u, G(V, E′)); UpdateSindex(u,N’); // N’ contains new neighbors found UpdateSocialGraph();
end for
![Page 11: Presentation on "Recommenders in Social Learning Platforms" at #iknow2014 & #ECTEL2014 in Graz, Sep. 2014](https://reader036.vdocuments.us/reader036/viewer/2022081400/54c490ae4a7959936f8b458a/html5/thumbnails/11.jpg)
Pagina 11
Experimental study 1. The method
Memory'based,CFs,
Model'based,CFs,
User'based,
Item'based,
Jaccard,kNN,
Loglikelihood,kNN,
Euclidean,kNN,
MostPopular,
BPRMF,,
BPRSLIM,
Graph'based,CF,
Best'performing,memory'based,
CF,
Best'performing,model'based,CF,
UB1$UB2$
UB3$
IB1$IB2$
IB3$
First$step$ Third$step$Final$comparison$
Second$step$
![Page 12: Presentation on "Recommenders in Social Learning Platforms" at #iknow2014 & #ECTEL2014 in Graz, Sep. 2014](https://reader036.vdocuments.us/reader036/viewer/2022081400/54c490ae4a7959936f8b458a/html5/thumbnails/12.jpg)
Pagina 12
Experimental study 2. Data
1. The datasets contain social data of users such as ratings, tags, reviews, etc. on learning resources. So, their structure, content and target users are quite similar to the ODS dataset.
2. Running recommender algorithms on these datasets enables us to conduct an offline experiment for studying the recommender algorithms before going online with the actual users of the ODS.
3. Both MACE and OpenScout datasets comply with the CAM (Context Automated Metadata) format. CAM is also applied in the ODS project for storing the social data.
Dataset Users Learning objects
Transactions
Sparsity (%)
MACE 105 5,696 23,032 99.71
OpenScout 331 1,568 2,560 99.51
MovieLens 941 1,512 96,719 93.69
![Page 13: Presentation on "Recommenders in Social Learning Platforms" at #iknow2014 & #ECTEL2014 in Graz, Sep. 2014](https://reader036.vdocuments.us/reader036/viewer/2022081400/54c490ae4a7959936f8b458a/html5/thumbnails/13.jpg)
Pagina 13
Experimental study 3. Results 3.1. Memory-based CFs
X-axis: Size of neighbors Y-axis: F1@10
MACE OpenScout MovieLens
![Page 14: Presentation on "Recommenders in Social Learning Platforms" at #iknow2014 & #ECTEL2014 in Graz, Sep. 2014](https://reader036.vdocuments.us/reader036/viewer/2022081400/54c490ae4a7959936f8b458a/html5/thumbnails/14.jpg)
Experimental study 3. Results 3.2. Model-based CFs
0"0.02"0.04"0.06"0.08"0.1"
0.12"0.14"0.16"0.18"0.2"
MACE" OpenScout" MovieLens"
F1@10%
Datasets%
BPRMF"
BPRSLIM"
MostPopular"
Pagina 14
![Page 15: Presentation on "Recommenders in Social Learning Platforms" at #iknow2014 & #ECTEL2014 in Graz, Sep. 2014](https://reader036.vdocuments.us/reader036/viewer/2022081400/54c490ae4a7959936f8b458a/html5/thumbnails/15.jpg)
Pagina 15
Experimental study 3. Results 3.3. Final step
0"
0.05"
0.1"
0.15"
0.2"
0.25"
0.3"
MACE" OpenScout" MovieLens"
F1@10%
Datasets%
Memory<based"
Model<based"
Graph<based"
![Page 16: Presentation on "Recommenders in Social Learning Platforms" at #iknow2014 & #ECTEL2014 in Graz, Sep. 2014](https://reader036.vdocuments.us/reader036/viewer/2022081400/54c490ae4a7959936f8b458a/html5/thumbnails/16.jpg)
Pagina 16
Conclusion
• The aim is to support users of social learning platforms in finding relevant resources
• Graph-based recommender systems can help to deal with sparsity problem in educational domain
![Page 17: Presentation on "Recommenders in Social Learning Platforms" at #iknow2014 & #ECTEL2014 in Graz, Sep. 2014](https://reader036.vdocuments.us/reader036/viewer/2022081400/54c490ae4a7959936f8b458a/html5/thumbnails/17.jpg)
Pagina 17
Ongoing and Further work
• The graph-based recommender already has been integrated with ODS platform
• Using trust relationships
– Explicit vs implicit trust relations (accepted paper at #RecSys2015 in Silicon Valley, US, Oct. 2014)
• User study (November- December 2014) to evaluate user satisfaction
– Novelty, serendipity, diversity: very important for learning domain
![Page 18: Presentation on "Recommenders in Social Learning Platforms" at #iknow2014 & #ECTEL2014 in Graz, Sep. 2014](https://reader036.vdocuments.us/reader036/viewer/2022081400/54c490ae4a7959936f8b458a/html5/thumbnails/18.jpg)
Many thanks to the FIT Fraunhofer Institute, especially Dr. Martin Wolpers and Katja Niemann, for providing us with both the MACE and OpenScout datasets on a short notice. Without their support, this study would not have been possible.
Onderwerp via >Beeld >Koptekst en voettekst Pagina 18
![Page 19: Presentation on "Recommenders in Social Learning Platforms" at #iknow2014 & #ECTEL2014 in Graz, Sep. 2014](https://reader036.vdocuments.us/reader036/viewer/2022081400/54c490ae4a7959936f8b458a/html5/thumbnails/19.jpg)
Pagina 19
soude.fazeli[at]ou[dot]nl
@SoudeFazeli