bigdata machine learning platform
TRANSCRIPT
2015.01
Bigdata Machine Learning Platform
BICubeTM
BICubeTM
http:www.bicube.co.kr
2BICubeTM
Bigdata Machine Learning Platform
Sqoop Flume
HDFS (Hadoop Distributed File System)
Zookeeper
Yarn(2.0)
MapReduce
HivePig
Mahout
Mashup
RDB
Preprocess Classify Cluster Associate Visual
BICube
RDB Mashup SNS Crawler
Authent ication
CubeM
anager
Log Crawler
Machine Learning Engine
Spark
SparkSQL
SparkStream GraphXML
Storm Kafka Akka
BioinfoManipul
Mesos
BICubeTM Architecture
3BICubeTM
Bigdata Machine Learning Platform
• MultiLinearRegression, KoreanMorpheme
• Logistic Regression, SVM, Adaboost, Neural Network
• RandomForest, NaiveBayssian, Timeseries Analysis
• Kmeans, LDA, HMM, PCA, SVD, CRF, TDA
• Covariance, Correlation, ROC, LSA, EigenFace Image
• CF Recommender, ConfusionMatrix, AUC
• Bagging, Wagging, ArcX4,LogitBoost,ModestAdaboost
• SAMME,BinaryClibration, IsonicCalibration...
• Discriminant Adaptive Nearist Neighbor
• Hierachical agglomerative clustering
• Kernel Recursive Least Square,Radial Base Network
• Local scaled density base clustering, EMGaussianMixture
• Sequential minimum optimization,Dual coordinate Descent
• T-Test, F-Test, G-Test, Chi-square-Test Anova etc….
BICubeTM Algorithms
4BICubeTM
Bigdata Machine Learning Platform
Document-Topic Matirx ViewerDocument-Topic Matirx Viewer
Latent Dirichlet Allocation on Hadoop
5BICubeTM
Bigdata Machine Learning Platform
Word-Topic Matirx ViewerWord-Topic Matirx Viewer
Latent Dirichlet Allocation on Hadoop
6BICubeTM
Bigdata Machine Learning PlatformDocument Similarity Visualization
7BICubeTM
Bigdata Machine Learning PlatformDocument Similarity Matrix
8BICubeTM
Bigdata Machine Learning PlatformWord Cloud from SNS
9BICubeTM
Bigdata Machine Learning PlatformOntology from Unstructured Document
10BICubeTM
Bigdata Machine Learning PlatformConfusion Matrix for Accuracy Maesure
11BICubeTM
Bigdata Machine Learning PlatformLatent Semantic Visualization
12BICubeTM
Bigdata Machine Learning PlatformLatent Semantic Visualization
13BICubeTM
Bigdata Machine Learning Platform
3D Visualization on GPU3D Visualization on GPU
Unstructured Document Clustering
14BICubeTM
Bigdata Machine Learning PlatformAssociation Rule from MBA
15BICubeTM
Bigdata Machine Learning Platform
Computer Vision on Hadoop
Image Analysis from Hadoop
16BICubeTM
Bigdata Machine Learning PlatformFace Recognition from Hadoop
17BICubeTM
Bigdata Machine Learning PlatformOLAP Analysis from Data Warehouse
18BICubeTM
Bigdata Machine Learning PlatformGEO Analysis for location data
19BICubeTM
Bigdata Machine Learning PlatformPDF Parser on Hadoop HDFS
20BICubeTM
Bigdata Machine Learning Platform
Trade Market Prediction
Recurrent Neural Network Feedfoward Neural Network(Elman) Counterpropagation Neural Network
Hopfield Neural NetworkBoltzman Neural NetworkNeat Neural NetworkSom Neural NetworkArt 1 Neural NetworkBam Neural NetworkAdaline Neural Network
Stock Market Analysis using ANN
21BICubeTM
Bigdata Machine Learning PlatformLog Analizer for machine data
22BICubeTM
Bigdata Machine Learning PlatformMash-up data from multi-datasource
23BICubeTM
Bigdata Machine Learning PlatformData Visualization
24BICubeTM
Bigdata Machine Learning PlatformData Visualization
25BICubeTM
Bigdata Machine Learning PlatformParallel cordinate & Facet Analysis
26BICubeTM
Bigdata Machine Learning Platform
PointCloud on GPU for Topological Data AnalysisPointCloud on GPU for Topological Data Analysis
3D Point Cloud for TDA
27BICubeTM
Bigdata Machine Learning Platform
Module Manager Add components by yourself–
Module Manager by DIY type
28BICubeTM
Bigdata Machine Learning Platform
Process Manager- Process UI Design Manager
UI Manager by DIY type
