spectral clustering - houston ml meetup

Clustering for New Discovery in DataPart 2

Houston Machine Learning Meetup

2SCR©

https://energyconferencenetwork.com/machine-learning-oil-gas-2017/

20% off, PROMO code: HML

3SCR©

Roadmap: Method

• Tour of machine learning algorithms (1 session)• Feature engineering (1 session)

– Feature selection - Yan

• Supervised learning (4 sessions)– Regression models -Yan– SVM and kernel SVM - Yan– Tree-based models - Dario– Bayesian method - Xiaoyang– Ensemble models - Yan

• Unsupervised learning (3 sessions)– K-means clustering – DBSCAN - Cheng– Mean shift – Agglomerative clustering – Kunal– Spectral clustering – Yan– Dimension reduction for data visualization - Yan

• Deep learning (4 sessions) _ Neural network

– From neural network to deep learning – Convolutional neural network– Train deep nets with open-source tools

4SCR©

Roadmap: Application

• Business analytics

• Recommendation system

• Natural language processing

• Computer vision

• Energy industry

5SCR©

Clustering Algorithm

• K-Means (King of clustering, many variants)

• DBSCAN (group neighboring points)

• Hierarchical clustering (a hierarchical structure, multiple levels)

• Mean shift (locating the maxima of density)

• Spectral clustering (cares about connectivity instead of proximity)

• Expectation Maximization (k-means is a variant of EM)

• Latent Dirichlet Allocation (natural language processing)

……

6SCR©

Agenda

• Hierarchical clustering

• Mean shift

• Spectral clustering

7SCR©

Referenece: http://www.cvl.isy.liu.se:82/education/graduate/spectral-clustering.html

Spectral Clustering

8SCR©

9SCR©

10SCR©

11SCR©

Add noise to A

12SCR©

13SCR©

Modification I

14SCR©

Min-cut problem

15SCR©

Modification II

16SCR©

17SCR©

Ratio-cut problem

18SCR©

19SCR©

20SCR©

21SCR©

Normalized spectral clustering

Make the clustering less sensitive to the cluster sizes

22SCR©

Normalized symmetric spectral clustering

Less sensitive to the cluster sizes and better separation of clusters

23SCR©

24SCR©

25SCR©

26SCR©

Summary

• Application of spectral clustering in computer vision

27SCR©

Roadmap: Method

• Tour of machine learning algorithms (1 session)• Feature engineering (1 session)

– Feature selection - Yan

• Supervised learning (4 sessions)– Regression models -Yan– SVM and kernel SVM - Yan– Tree-based models - Dario– Bayesian method - Xiaoyang– Ensemble models - Yan

• Unsupervised learning (3 sessions)– K-means clustering – DBSCAN - Cheng– Mean shift – Agglomerative clustering – Spectral clustering – Kunal, Yan– Dimension reduction for data visualization - Yan

• Deep learning (4 sessions) _ Neural network

– From neural network to deep learning – Convolutional neural network– Train deep nets with open-source tools

28SCR©

https://energyconferencenetwork.com/machine-learning-oil-gas-2017/

20% off, PROMO code: HML

29SCR©

Thank you

Slides will be posted on slide share:

http://www.slideshare.net/xuyangela

30SCR©

Parking We are here @ W205

Enter