july concall
TRANSCRIPT
![Page 1: July concall](https://reader033.vdocuments.us/reader033/viewer/2022052912/55a21cb21a28ab935d8b47d6/html5/thumbnails/1.jpg)
Center for Behavior Imaging @ Georgia Tech
July Concall
Jim RehgGeorgia Tech
July 3, 2012
![Page 2: July concall](https://reader033.vdocuments.us/reader033/viewer/2022052912/55a21cb21a28ab935d8b47d6/html5/thumbnails/2.jpg)
Agenda
• Summer School Recap
• Grand Challenge Update
• Annual Reports
2
![Page 3: July concall](https://reader033.vdocuments.us/reader033/viewer/2022052912/55a21cb21a28ab935d8b47d6/html5/thumbnails/3.jpg)
First Expedition Summer School
3
![Page 4: July concall](https://reader033.vdocuments.us/reader033/viewer/2022052912/55a21cb21a28ab935d8b47d6/html5/thumbnails/4.jpg)
Observation of CfD Students
4
![Page 5: July concall](https://reader033.vdocuments.us/reader033/viewer/2022052912/55a21cb21a28ab935d8b47d6/html5/thumbnails/5.jpg)
Lectures and Labs
• Psychology of autism– Lectures on
development, diagnosis/treatment, outcomes
• ANS– Live recording of EDA with Q sensor– Experiment with basic filtering of EDA signal– Lectures on physiology and autonomics
• Speech– Experiments with speech data (live and recorded)– Pitch tracking and formants via Praat– Word spotting using Nexidia
5
![Page 6: July concall](https://reader033.vdocuments.us/reader033/viewer/2022052912/55a21cb21a28ab935d8b47d6/html5/thumbnails/6.jpg)
Lectures and Labs (cont)
• Vision– Experiments with captured video and Rapid-ABC
– Face pose and smile analysis using Omron SDK
– Predicting discrete smiles and response to name
• Accelerometry– Live recording of accelerometry data
– Experiment with developing a pedometer
– Lectures on modeling and processing accel. Signal
• Group discussion session
6
![Page 7: July concall](https://reader033.vdocuments.us/reader033/viewer/2022052912/55a21cb21a28ab935d8b47d6/html5/thumbnails/7.jpg)
Student Comments
• “…it was a very fruitful and motivational experience to discuss my own research and future work and develop ideas for cooperation and integration into multimodal frameworks.”
• “A great opportunity to become familiar with the Center and ASD.”
• “It was a great opportunity to get to know our team (as well as understand them)”
7
![Page 8: July concall](https://reader033.vdocuments.us/reader033/viewer/2022052912/55a21cb21a28ab935d8b47d6/html5/thumbnails/8.jpg)
Strengths of Summer School
• All students did hands-on experiments with all major modalities in the Expedition
• All students had opportunity to observe individuals with autism in a natural setting
• Exposure to broad range of tools across modalities
• Building connections between students at different sites
• Excellent venue (the CfD team were impressed)
8
![Page 9: July concall](https://reader033.vdocuments.us/reader033/viewer/2022052912/55a21cb21a28ab935d8b47d6/html5/thumbnails/9.jpg)
Areas for Improvement
• Better faculty participation across summer school period
• More focus on multimodal integration
• Use of a common, Expedition-focused dataset across lab projects
• Larger, more ambitious student projects with more time for collaborative work
• More time for discussion
9
![Page 10: July concall](https://reader033.vdocuments.us/reader033/viewer/2022052912/55a21cb21a28ab935d8b47d6/html5/thumbnails/10.jpg)
Discussion Points
• Next summer school should include more non-Expedition participants (faculty and students)
• There is value in having an annual meeting which brings Expedition students together
• Can the summer school fulfill both roles?
• Should we strive for access to a broader autism population?
10
![Page 11: July concall](https://reader033.vdocuments.us/reader033/viewer/2022052912/55a21cb21a28ab935d8b47d6/html5/thumbnails/11.jpg)
Agenda
• Summer School Recap
• Grand Challenge Update
• Annual Reports
11
![Page 12: July concall](https://reader033.vdocuments.us/reader033/viewer/2022052912/55a21cb21a28ab935d8b47d6/html5/thumbnails/12.jpg)
Timeline (Modified)
• July 1 – Integration of completed modules begins
• July 15 – Testing results for modules reported to team (GT)
• Aug 15 – Evaluation of integrated modules (GT)
• Sept 1 – Deadline for integrated systems
– GT testing
• Sept 27-28 – Year 3 Meeting
– Presentation and discussion of Grand Challenge results
12
![Page 13: July concall](https://reader033.vdocuments.us/reader033/viewer/2022052912/55a21cb21a28ab935d8b47d6/html5/thumbnails/13.jpg)
Current Modules
• Keyword spotting on clinician speech (GT)
• Acoustic features and segmented speech (GT)
• Acoustic features and ground truth (USC)
• Ball and face tracking (BU)
• Face tracking, gaze estimation, smile strength estimation (GT)
• Kinect head tracking (GT & BU) – In progress
• Prediction of smile score (GT) – In progress
• ANS analysis (MIT & NE) – In progress
13
![Page 14: July concall](https://reader033.vdocuments.us/reader033/viewer/2022052912/55a21cb21a28ab935d8b47d6/html5/thumbnails/14.jpg)
Items
• Missing kinect data and lack of ANS synchronization in some early sessions– These issues are being addressed in more recent
captures
• 8 recent sessions are being set-aside for testing purposes– We plan to add 2 more by end of summer
• Each site needs to identify a point of contact for testing the integrated modules
14
![Page 15: July concall](https://reader033.vdocuments.us/reader033/viewer/2022052912/55a21cb21a28ab935d8b47d6/html5/thumbnails/15.jpg)
Next Steps
• Our goal is to have analysis results from each site in the final competition
– Please let us know your plans!
• Multi-modal analysis can start now, let us know if you are working on predicting engagement ratings
• Finalizing all completed modules, uploading to repository, and integration into ELAN.
15
![Page 16: July concall](https://reader033.vdocuments.us/reader033/viewer/2022052912/55a21cb21a28ab935d8b47d6/html5/thumbnails/16.jpg)
Agenda
• Summer School Recap
• Grand Challenge Update
• Annual Reports
16
![Page 17: July concall](https://reader033.vdocuments.us/reader033/viewer/2022052912/55a21cb21a28ab935d8b47d6/html5/thumbnails/17.jpg)
Annual Reports
• 2012 annual report is now due
• Each site is requested to submit their annual reports by July 31, 2012.
• After submitting your report, download the entire PDF from Fastlane and send it to Stephanie
• The GT report will include a description of integrated activities across the team
17
![Page 18: July concall](https://reader033.vdocuments.us/reader033/viewer/2022052912/55a21cb21a28ab935d8b47d6/html5/thumbnails/18.jpg)
Questions?
18