fyp 2011 poster
DESCRIPTION
Poster for Mathifier (final year project, 2011)TRANSCRIPT
A LaTeX Article
2011-05-15
∫ 2
1 x2 + y2
Abstract
1 Introduction
1
integral from oneto two of x squared
plus y squared
We trained the system by tailoring a transcript consisting of math equations and having different speakers in dif-ferent settings utter the sentences in the tran-script.
Mathifier has a gram-mar different from the english language. The system had to know that instead of having a sub-ject followed by a verb, a number was followed by an operator.
integral from oneto two of x squaredplus y squared
\int _{1}^{2}x^2+y^2
During speech recognition, the rec-ognized sentence is converted to Latex on-the-fly.
A LaTeX Article
2011-05-15
∫ 2
1x2 + y2
Abstract
1 Introduction
1
\int _{1}^{2}x^2+y^2
The Latex code is compiled so that an image in equation form can be displayed.
A LaTeX Article
2011-05-15
∫ 2
1x2 + y2
Abstract
1 Introduction
1
The compiled image is shown to the user in an intuitive interface.
Mathifier uses CMU Sphinx 4, an open-source speech recognition tool designed for research. The
modular design of Sphinx allowed us to modify only certain parts of the system.
linguistfrontend decoder
active listscorerpruner
convert input to features
acoustic modeldictionarylanguage model
Sphinx 4 Architecture
Mathifier Speech Recognition for Math Equations
Mathifier is a system that recognizes speech restricted to the math domain. That is, you speak natural math equations, and Mathifier will recognize your speech,
convert it to Latex, and compile the Latex code into an equation format in real-time.
introduction
credits Students: Salim Batlouni, Hala Karaki, Elie Mekanna. Advisor: Dr. Fadi Zaraket. Co-Advisor: Dr. Fadi Karameh.Final Year Project, ECE department, American University of Beirut. Class of 2011.
Open-source project github.com/cityvideo/math-speech-recognition