CURRICULUM VITAE Roghayeh (Leila) Barmaki, PhD

Homepage: https://sites.udel.edu/rlb/ Computer and Information Sciences

Google Scholar: https://goo.gl/g68aUS

Email: rlb@udel.edu

Data Science Institute

University of Delaware

RESEARCH & TEACHING INTERESTS

Human-Computer Interaction

Multimodal Machine Learning

Natural User Interfaces

Mixed Reality

APPOINTMENTS Aug 2018 – Present Assistant Professor, Department of Computer and Information Sciences, College of

Engineering; Affiliated, Data Science Institute, University of Delaware, Newark, DE

EDUCATION

Jul 2016 – Jul 2018 Postdoctoral Fellow, Laboratory for Computational Sensing and Robotics, Whiting

School of Engineering, Johns Hopkins University, Baltimore, MD

Aug 2012 – Jul 2016 PhD. in Computer Science, University of Central Florida (UCF), Orlando, FL. Dissertation: “Gesture Assessment of Teachers in an Immersive Rehearsal Environment”

Committee: Charles Hughes (Chair), Lisa Dieker, Hassan Foroosh, Gita Sukthankar.

Sep 2010 – Jul 2012 MSc. in Artificial Intelligence, Iran University of Science & Technology (IUST),

Tehran, Iran. Thesis: “An Optimized Method for Motif Discovery Using Graph Mining Approaches.”

Sep 2004 – Sep 2008 B.Sc. in Computer Software Engineering, Kharazmi University, Tehran, Iran. Thesis: “Analysis of Web Search Engines.”

Sep 2000 – Jul 2004 National Organization for Development of Exceptional Talents (NODET or SAMPAD)

Diploma, High School, Ardebil, Iran.

GRANTS

Title: “Virtual Reality Mobile Research Lab to Support Health Sciences Innovations”

University of Delaware, 2018 – 2020, 35,000 USD, Role: Co-PI.

Title: “Can Augmented Reality Help Medical Students Learn Human Anatomy?” Link

Johns Hopkins University, Science of Learning Institute, 2016 – 2018, 200,000 USD, Role: Co-PI

(prepared the proposal), My share: 80 %.

- Featured by Johns Hopkins HUB (Online Magazine, Link)

Title: “Workflow Provenance for Big Data Computational Social Science”

Facebook Research, Under Review, 2019-2020, 50,000 USD, Role: PI.

Title: “Personalized Augmented Reality as an Interactive Teaching Tool for Facial Anatomy” Link

Johns Hopkins Office of the Provost, Digital Education & Learning Technology Acceleration (DELTA),

2018 – 2019, 75,000 USD, Role: Co-I (success rate: 9.3 %).

PATENT

Title: “Reflection-based Holographic Self Augmentation,” Role: Co-Inventor, Status: Under Institutional

Review Process, Disclosure Number: D14694.

PUBLICATIONS

JOURNALS & BOOK CHAPTERS

● R. Barmaki, K. Yu, R. Pearlman, R. Shingles, F. Bork, G. Osgood and N. Navab, “Enhancement of

Anatomical Education Using Augmented Reality: An Empirical Study of Body Painting,” Journal of

Anatomical Sciences Education, 2018 (accepted, Impact Factor: 3.2). Link

● R. Barmaki and C.E. Hughes, “Embodiment Analytics of Practicing Teachers in a Virtual Immersive

Environment,” Journal of Computer Assisted Learning, Special Issue on Multimodal Data for

Learning, vol.34, pp.387–396, 2018 (Impact Factor: 1.859). Link

● B. Minaei*, R. Barmaki, M. Nasiri, “Mining Numerical Association Rules via Multi-Objective Genetic

Algorithms,” International Journal of Information Sciences, vol.233, pp.15–24, 2013 (Impact Factor:

4.83, Cited:76 times). Link * MSc adviser

● R.Beheshti, R. Barmaki, and N. Mozayani, “Negotiations in Holonic Multi-agent Systems,” Recent

Advances in Agent-based Complex Automated Negotiation, vol. 638, pp.107-118, Springer, 2016. Link

CONFERENCE PROCEEDINGS (PEER-REVIEWED)

● Y.M. Chiou and R. Barmaki, “Multi-Party Mixed Reality Interaction for Earth Sciences Education,”

ACM International Conference on Tangible, Embedded and Embodied Interaction (TEI’19),Tempe,

Arizona, USA (submitted) Link

● F. Bork, R. Barmaki, U. Eck, K. Yu, C. Sandor, and N. Navab, “Empirical Study of Non-Reversing

Magic Mirrors for Augmented Reality Anatomy Learning,” in Proc. of the 16th IEEE International

Symposium on Mixed and Augmented Reality (ISMAR’17), Nantes, France, pp.169–176, 2017

(acceptance rate: 17.2%). Link

● R. Barmaki and C. E. Hughes, “Gesturing and Embodiment in Teaching: Investigating the Nonverbal

Behavior of Teachers in a Virtual Rehearsal Environment,” AAAI Symposium on Educational Advances

in Artificial Intelligence (EAAI’18), New Orleans, Louisiana, USA, pp. 7893–7899, 2018. Link

● K. Yu*, R. Barmaki*, M. Unberath, A. Mears, J. Brey, T. Chung, and N. Navab, “On the Accuracy of

Low-cost Motion Capture Systems for Range of Motion Measurements,” In Proceedings of the Imaging

Informatics for Healthcare, Research, and Applications. (SPIE Medical Imaging 2018). Houston, Texas.

International Society for Optics and Photonics, 2018, 10579–10585. Link * Co-first author

● M. Unberath, K. Yu, R. Barmaki, A. Johnson, P. Kazanzides, and N. Navab, “Augment Yourself: Mixed

Reality Self-Augmentation Using Optical See-through Head-mounted Displays and Physical Mirrors,” IEEE VR 2019, Osaka, Japan, 2019 (under review). Link

● F. Bork, R. Barmaki, U. Eck, P. Fallavollita, B. Fuerst, and N. Navab, “Exploring Non-Reversing Magic

Mirrors for Screen-Based Augmented Reality Systems,” in Proc. of the International Conference on IEEE

Virtual Reality (IEEE VR’17), Los Angeles, CA, USA, pp.373–374, 2017. Link

● R. Barmaki and C. E. Hughes, “Towards the Understanding of Gestures and Vocalization Coordination

in Teaching Context,” in Proc. of the 9th International Conference on Educational Data Mining (EDM’

16) Raleigh, NC, USA, pp.633–635, 2016. Link

● R. Barmaki, “Improving Social Communication Skills Using Kinesics,” in Proc. of the CHI Conference

Extended Abstracts on Human Factors in Computing Systems (CHI’ 16), New York, NY, USA, pp.86–

91, 2016 (ACM Student Research Competition Award). Link

● R. Barmaki and C. E. Hughes, “Providing Real-time Feedback for Student Teachers in a Virtual

Rehearsal Environment,” in Proc. of 17th International Conference on Multimodal Interaction (ICMI’15),

ACM, New York, NY, USA, pp.531–537, 2015 (Best Grand Challenges Award). Link

● R. Barmaki, “Multimodal assessment of Teaching Behavior in Immersive Rehearsal Environment –

TeachLivE,” in Proc. of 17th International Conference on Multimodal Interaction (ICMI’15), ACM,

New York, NY, USA, pp.651–655, 2015. Link

● R. Barmaki and C. E. Hughes, “A Case Study to Track Teacher’s Gestures in Virtual Learning

Environments,” in Proc. of 5th International Conference on Learning, Analytics and Knowledge

(LAK’15), ACM, Poughkeepsie, NY, USA, pp. 420–421, 2015. Link

● R. Barmaki, “Multimodal Assessment of Teachers in Immersive Learning Environment,” International

Conference on Learning, Analytics and Knowledge, Poughkeepsie, NY, USA, 2015. Link

● R. Barmaki, “Nonverbal Communication and Teaching Performance,” in Proc. of 7th International

Conference on Educational Data Mining (EDM’14), London, U.K., pp.441–443, 2014. Link

EXTENDED ABSTRACTS

● R. Barmaki, “Development of Real-Time Systems for Biomechanical Analysis of Upper Limb

Movement using Augmented Reality Technology,” Refereed Demo at the IEEE Conference on Virtual

Rehabilitation, Montreal, Canada, 2017. Link

● R. Barmaki, K. Ingraham, C.E. Hughes, “Social Norm Identification for Agent-Based Environments

Using Numeric Association Rule Mining,” Refereed Poster in the ACM 2014 Tapia Conference for

Diversity in Computing, Seattle, Washington, 2014.

HONORS & AWARDS

Fall 2018 Women in Computing Career Mentoring Workshop Travel Award, Sponsored by Computing

Research Association for Women (CRA-W)

Summer 2018 Computing Early Career Researcher Symposium Travel Award, Supported by National

Science Foundation, Computing Community Consortium (CCC), Poster Title: “Immersive

Technologies for Medical Education,” Link

Spring 2018 Johns Hopkins Postdoctoral Enrichment Award Winner, First Place, Link

Spring 2018 Johns Hopkins Postdoctoral Association, Best Audiences’ Choice Presentation Award

Spring 2017 Winner of the Provost's Cross-Disciplinary Postdoctoral Diversity Programming Award at

JHU (2017 – 2018)

Spring 2017 Teaching as Research Fellowship, JHU Teaching Academy, Title: “Teaching the human

musculoskeletal system to pre-meds with the aid of innovative augmented reality technology”

Spring 2016 Winner of the ACM Student Research Competition, the 34th International Conference on

Human Factors in Computing (CHI’16), Sponsored by Microsoft Research, Link

Spring 2016 UCF Computer Science Doctoral Student of the Year Runner-up, Link

Spring 2015 University of Central Florida, Frank Hubbard Engineering Endowed Scholarship

(two years in a row)

Fall 2015 Best Grand Challenges and Poster Award, the 17th ACM International Conference on

Multimodal Interaction (ICMI’15), Link

Spring 2012 Ranked 1st among 32 Computer Engineering graduate students at Iran University of Science

and Technology, Tehran, Iran

DIRECTION & MENTORSHIP

Mathew Bonham, PhD Student, University of Delaware, Summer 2018 – Present

Yan-Ming Chiou, PhD Student, University of Delaware, Spring 2018 – Present

Zhang Guo, PhD Student, University of Delaware, Summer 2018 – Present

Alina Christenbury, Undergraduate Student, University of Delaware, Summer 2018 – Present

Kevin Yu, MSc Student, Technical University of Munich and Johns Hopkins University, 2016 – 2018

Smitha Mahesh, Undergraduate Student in Physics and Philosophy, Johns Hopkins University, 2018

Sarah Peng, AP senior high school student, WISE (Women in Science and Engineering) joint program

with Johns Hopkins and Garrison Forest High School, 2016 – 2017

Areeba Kamal, Undergraduate Student, Mount Holyoke College, Women of Color in Computing-CBDB

Mentoring Program, 2014 – 2015

INVITED TALKS

“Enhancement of Anatomical Education Using Augmented Reality: An Empirical Study of Body

Painting”

o The National Center for Integration of Teaching and Learning (The CRTL Network), Nov

2017, Link

“Immersive Technologies and Interactive Games: Applications in Education and Healthcare Systems”

o University of Delaware, Department of Computer and Information Sciences, Fall 2018

o University of Virginia, School of Engineering and Applied Sciences, Apr 2018

o North Carolina State University, College of Engineering, Mar 2018, Link

o University of Florida, Herbert Wertheim College of Engineering, Mar 2018, Link

o Purdue University, Purdue Polytechnic Institute, Mar 2018

o University of Texas San-Antonio, College of Sciences, Feb 2018

o Rochester Institute of Technology, Golisano College of Computing, Feb 2018

o University at Buffalo, Graduate School of Education, Feb 2018

o University of Delaware, College of Engineering, Sept 2018

o Nara Institute of Science and Technology, Graduate School of Information Science, Ikoma, Japan,

Mar 2018

“Embodied Interactions for Educational Interventions”

o University of North Carolina – Charlotte, College of Engineering, Apr 2017

TEACHING EXPERIENCE

Preparing Future Faculty (PFF) Teaching Program Certificate holder, the National Center for the

Integration of Research, Teaching, and Learning (CIRTL), Fall 2017

Teaching Assistant, UCF (Complexity Theory, Introduction to Algorithms, Java Programming, Discrete

Mathematics, Web-Based Information Technology, Computer Architecture), Fall 2012 – 2015

Instructor, Iran University of Science and Technology (IUST), (Introduction to Algorithms), Spring 2012

Teaching Assistant, IUST, (Introduction to Algorithms, Electrical Circuits, Operating Systems),

Fall 2010 – Fall 2011

PROFESSIONAL EXPERIENCE

Visiting Scholar, Graduate School of Information Science, Nara Institute of Science and Technology,

Japan, Spring 2018

Learn Lab Summer School (Educational Data Mining), Carnegie Mellon University, Summer 2015

Java developer, Faratel Company, Iran, 2008 – 2009

TECHNICAL SKILLS

Programming languages (Visual C++, C#, Java, Python)

Unity Game Engine, and Graphics (OpenGL)

RGBD camera coding (Kinect for Windows, Microsoft HoloLens), and Windows API coding

Data science and statistics platforms (Anaconda, Weka, R, RapidMiner, Stata, Minitab, SPSS), and

complex network analysis tools (Cytoscape, Pajek)

Speech analysis tool (Praat), and multimodal data analysis tools (ANVIL, ELAN, DataVyu, iMotions)

Engineering Software (Matlab), and data visualization tool (Tableau)

Deep learning Frameworks (PyTorch, TensorFlow)

Software development methods (Rational Rose), agile methodologies, and user experience design and

development

ACADEMIC SERVICES

Program Committee – Int. Conf. on Human Factors in Computing Systems (CHI’16 – CHI’19)

Program Committee – Int. Conf. on IEEE Virtual Reality (IEEE VR’19)

Program Committee – Int. Symp. on User Interface Software and Technology (UIST’17)

Program Committee – Int. Conf. on Multimodal Interaction (ICMI’15)

MEMBERSHIPS

Grace – Graduate Women in JHU EECS association, JHU, Fall 2016 – Present

ACM and IEEE Computer Society members, 2015 – Present

Graduate Student Association (GSA) advisory board, UCF, 2013 – 2016

Educational Data Mining, and Society of Learning Analytics Research members, 2013 – Present

ACM/W member, 2012 – present; and CRA/W Alumni, 2012 – 2016

Kharazmi University ACM-ICPC Programming Contest Team, 2006