vikram kamath cannanure, dr. geoff gordon · the software part (qna) was implemented using open...

1
This session talks about an initiative at Carnegie Mellon University to build an online open source teaching tool and complementary interactive video recording and production hardware. Our system consists of a hardware system (TelKart) to record videos, slides, and/or whiteboard, as well as a software system called QnA to create and present lecture notes and assessments through a web interface. The resulting videos, instructions, and assessments can act as part of a course or a stand-alone instructional piece. The software part (QnA) was implemented using open source software, and we used a user-centered approach to building the system, seeking active feedback from instructors. The QnA system is deployed in Carnegie Mellon’s campuses in Pittsburgh and Silicon Valley and is in closed beta to students in the Pittsburgh area. The hardware part (TelKart) records interactive videos, either live streaming or recorded course content. We developed a custom hardware solution through iterative prototyping and refinement. The hardware is deployed at Carnegie Mellon’s Pittsburgh campus. One part of our future work consists of prototyping and evaluating a more lightweight hardware solution. We hope to use this session to talk about our insights deploying the system to computer science courses, including challenges faced in a university setting and future work. We also hope to seek feedback towards making our software system open and employing OER principles in synergy with the university guidelines. Finally, we hope to showcase and seek feedback about our lightweight hardware solution. ABSTRACT HARDWARE The software system (QnA) is used to distribute content and conduct assessment for a course module or an independent instructional piece. QnA is a web interface that allows instructors to embed course material; it has basic content management features like version control, LaTeX for equations or tables, rich text editing, and embedded media. We used structured interviews as well as targeted scenario-based feature design to deploy new features to the software. A typical deployment of a feature would first be done by seeking feedback from the alpha testing faculty giving us the first level feedback. The next iteration would be done by a beta test from a Teaching Assistant, providing the second level of feedback. Finally, we would deploy the system in production, watch user behavior and telemetry data, and work on the final iteration of the feature release. SOFTWARE We have a prototype of a new low-cost version of the system based on a laptop and a tablet. The system uses open source software like OBS studio and QuickTime player to create or stream videos We plan to conduct a formal evaluation of the prototype and submit a publication in the next few months. We hope to open source the setup and publicly setup Do-it- Yourself (DIY) instructions on the web to help instructors create content from their offices. QnA system has gotten positive feedback from instructors and teaching assistants and is rapidly gaining users in the Machine Learning Department. The system is being improved through user-centered design and we hope to make the software open source so instructors can benefit from our effort. The software is in pipeline to become a independent Docker script to make it easy to be deployed once the software is open source. We hope to use this session to seek feedback on making our hardware and software system open and effective towards open education. DISCUSSION & FUTURE WORK CONCLUSION This session presents an innovative system to record videos and deploy them through an online system. The goal of the project is to simulate the physical teaching experience in a classroom through an online environment and distribute content through the web interface. We have used rapid prototyping and user-centered design to improve the system through iterative improvement in a university setting. We seek help from instructors and teaching assistants to get involved in building the software and this helped us ground our ideas and seek internal and external validity before deploying a new feature. Inspired by our hardware setup called TelKart, we hope to deploy a low-cost hardware version of the prototype that can be beneficial to instructors interested in distributing content. The software system called QnA is deployed in campuses of Pittsburgh and Silicon Valley. We hope to open source the software for the benefit of educators. Finally, we hope to seek feedback on our system towards making our beneficial towards open education. REFERENCES QnA Live Site: qna.cs.cmu.edu TelCart. 2016 - This is a blog about our project: https://telcart.wordpress.com/. Sample Recorded Lectures from a camera. 10-601 Machine Learning Spring 2015 https://www.youtube.com/watch?v=m4NlfvrRCdg&index=1&list= PLAJ0alZrN8rD63LD0FkzKFiFgkOmEtltQ. Piazza: http://piazza.com. Gradescope: http://gradescope.com. Carnegie Mellon University Blackboard:http://www.cmu.edu/blackboard/. Open Learning Initiative: https://oli.cmu.edu/. Panopto Video Platform. Platform for Businesses and Universities: https://panopto.com. Stay updated: http://bit.ly/qna-info ACKNOWLEDGEMENTS The hardware components of the TelKart initiative was made possible by Martin Schwartz and his excellent skills with prototyping hardware. We would also like to thank Teaching Assistants whose feedback was essential in prototyping the initial versions of the project. Finally, we would like to thank the Dean of Computer Science, Prof Andrew Moore and Dean Walt Schearer for funding this project. The hardware system consists of a Wacom tablet, camera, Mac Mini, and associated hardware mounted on a custom height-adjustable cart. It is tailored to record interactive videos that provide the freedom to show slides or whiteboard, scribble on slides, or include live camera views. In the context of teaching computer science, this interaction is useful for instructors to write equations and draw graphs (as they might on a physical whiteboard) or to highlight parts of the slides. Carnegie Mellon University Vikram Kamath Cannanure, Dr. Geoff Gordon TelKart and QnA: An Open Teaching System for Computer Science Figure 1: TelKart Hardware Prototype Figure 2: QnA System with rich text and realtime LaTeX editing Figure 3: Typical Feature Deployment Cycle Figure 4: Image upload feature deployed by iterative feedback Figure 5: A low cost Prototype using an iPad an a MacBook Figure 6: Demo of written equations from an iPad Figure 7: An instructor explaining content using slides

Upload: others

Post on 28-May-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Vikram Kamath Cannanure, Dr. Geoff Gordon · The software part (QnA) was implemented using open source software, and we used a user-centered approach to building the system, seeking

This session talks about an initiative at Carnegie Mellon University to build an online open source teaching tool and complementary interactive video recording and production hardware. Our system consists of a hardware system (TelKart) to record videos, slides, and/or whiteboard, as well as a software system called QnA to create and present lecture notes and assessments through a web interface. The resulting videos, instructions, and assessments can act as part of a course or a stand-alone instructional piece.

The software part (QnA) was implemented using open source software, and we used a user-centered approach to building the system, seeking active feedback from instructors. The QnA system is deployed in Carnegie Mellon’s campuses in Pittsburgh and Silicon Valley and is in closed beta to students in the Pittsburgh area.

The hardware part (TelKart) records interactive videos, either live streaming or recorded course content. We developed a custom hardware solution through iterative prototyping and refinement. The hardware is deployed at Carnegie Mellon’s Pittsburgh campus. One part of our future work consists of prototyping and evaluating a more lightweight hardware solution.

We hope to use this session to talk about our insights deploying the system to computer science courses, including challenges faced in a university setting and future work. We also hope to seek feedback towards making our software system open and employing OER principles in synergy with the university guidelines. Finally, we hope to showcase and seek feedback about our lightweight hardware solution.

ABSTRACT

HARDWARE

The software system (QnA) is used to distribute content and conduct assessment for a course module or an independent instructional piece. QnAis a web interface that allows instructors to embed course material; it has basic content management features like version control, LaTeX for equations or tables, rich text editing, and embedded media.

We used structured interviews as well as targeted scenario-based feature design to deploy new features to the software. A typical deployment of a feature would first be done by seeking feedback from the alpha testing faculty giving us the first level feedback. The next iteration would be done by a beta test from a Teaching Assistant, providing the second level of feedback. Finally, we would deploy the system in production, watch user behavior and telemetry data, and work on the final iteration of the feature release.

SOFTWARE

We have a prototype of a new low-cost version of the system based on a laptop and a tablet. The system uses open source software like OBS studio and QuickTime player to create or stream videos We plan to conduct a formal evaluation of the prototype and submit a publication in the next few months. We hope to open source the setup and publicly setup Do-it-Yourself (DIY) instructions on the web to help instructors create content from their offices.

QnA system has gotten positive feedback from instructors and teaching assistants and is rapidly gaining users in the Machine Learning Department. The system is being improved through user-centered design and we hope to make the software open source so instructors can benefit from our effort. The software is in pipeline to become a independent Docker script to make it easy to be deployed once the software is open source. We hope to use this session to seek feedback on making our hardware and software system open and effective towards open education.

DISCUSSION&FUTUREWORK CONCLUSION

This session presents an innovative system to record videos and deploy them through an online system. The goal of the project is to simulate the physical teaching experience in a classroom through an online environment and distribute content through the web interface. We have used rapid prototyping and user-centered design to improve the system through iterative improvement in a university setting. We seek help from instructors and teaching assistants to get involved in building the software and this helped us ground our ideas and seek internal and external validity before deploying a new feature. Inspired by our hardware setup called TelKart, we hope to deploy a low-cost hardware version of the prototype that can be beneficial to instructors interested in distributing content. The software system called QnA is deployed in campuses of Pittsburgh and Silicon Valley. We hope to open source the software for the benefit of educators. Finally, we hope to seek feedback on our system towards making our beneficial towards open education.

REFERENCES

QnA Live Site: qna.cs.cmu.eduTelCart. 2016 - This is a blog about our project: https://telcart.wordpress.com/. Sample Recorded Lectures from a camera. 10-601 Machine Learning Spring 2015 https://www.youtube.com/watch?v=m4NlfvrRCdg&index=1&list=PLAJ0alZrN8rD63LD0FkzKFiFgkOmEtltQ.Piazza: http://piazza.com. Gradescope: http://gradescope.com. Carnegie Mellon University Blackboard:http://www.cmu.edu/blackboard/. Open Learning Initiative: https://oli.cmu.edu/.Panopto Video Platform. Platform for Businesses and Universities: https://panopto.com.

Stay updated: http://bit.ly/qna-info

ACKNOWLEDGEMENTSThe hardware components of the TelKart initiative was made possible by Martin Schwartz and his excellent skills with prototyping hardware. We would also like to thank Teaching Assistants whose feedback was essential in prototyping the initial versions of the project. Finally, we would like to thank the Dean of Computer Science, Prof Andrew Moore and Dean Walt Schearer for funding this project.

The hardware system consists of a Wacom tablet, camera, Mac Mini, and associated hardware mounted on a custom height-adjustable cart. It is tailored to record interactive videos that provide the freedom to show slides or whiteboard, scribble on slides, or include live camera views. In the context of teaching computer science, this interaction is useful for instructors to write equations and draw graphs (as they might on a physical whiteboard) or to highlight parts of the slides.

CarnegieMellonUniversityVikramKamathCannanure,Dr.GeoffGordon

TelKart andQnA:AnOpenTeachingSystemforComputerScience

Figure 1: TelKart Hardware Prototype

Figure 2: QnA System with rich text and realtime LaTeX editing

Figure 3: TypicalFeatureDeploymentCycle

Figure 4: Image upload feature deployed by iterative feedback

Figure 5: A low cost Prototype using an iPad an a MacBook

Figure 6: Demo of written equations from an iPad

Figure 7: An instructor explaining content using slides