semantics visualizations on mobile devices · • semantic search on text, audio, video • social...

Semantics Visualizations on Mobile Devices Wolfgang Jochum

jochum@spectralmind.com

Spectralmind OG Phorusgasse 8/9 1040 Vienna, Austria

www.spectralmind.com 22. März 2011

2. Potsdamer I­Science Tag

Finding music?

10 Mill. titles – overview?

– finding desired music quickly?

– finding new music? – usability?

Our Vision

making the wealth of music

accessible by everyone

Spectralmind

•  TU Vienna spin-off, founded 2008

•  backed by ~10 years of research

•  intelligent semantic audio solutions

•  audio analysis & indexing technology

Spectralmind

•  independent high-technology company

•  supported by inits, AWS preseed, FFG

•  located in Vienna, Austria

•  research link with TU Vienna

Spectralmind Team

Johann Waldherr Bizdev & Sales – waldherr@spectralmind.com

Thomas Lidy Managing Director – lidy@spectralmind.com

Wolfgang Jochum Head of Technology – jochum@spectralmind.com

Ewald Peiszer Head of R&D– peiszer@spectralmind.com

Overview genre clusters

Music Browsing by Sound Similarity

Visual Music Discovery Product

Detail view titles with cover art

www.sonarflow.com

Underlying Technology

Audio Search Engine

Automatic Labeling

Spectralmind Products

Music Recommendation

Audio files Semantic

Audio analysis

Audio Feature Extraction

•  basic approach

•  sonarflow @ mobile

•  predefined & simple placement

iPhone Launch

late March!

Mobile Visual Music Discovery sonarflow mobile – „music at your fingertips“

www.sonarflow.com

About the Project

• media management and retrieval through mobile devices considering usability and visualization

•  started August 2010

•  3 national partners

•  funded by the FFG COIN program

Overview

•  multimedia mgmt.

•  semantic search on text, audio, video

•  social annotation

•  crowd sourcing

•  semantic audio analysis

•  search & annotation

•  recommendation

•  media visualization

•  interactive interfaces

•  mobile app

•  mobile development

•  multi-platform solutions

Partners

Goals

Advanced and integrated multimedia search over interlinked networks of information by applying semantic technology.

Goals

Novel visualization methods for usable and comprehensive search on multimedia.

Goals

Flexible development framework for mobile application development and the provision of semantic multimedia search and visualization through mobile devices.

Keep in Touch

•  jochum@spectralmind.com

•  http://mouviz.playence.com/

www.spectralmind.com

Thank you!