presentation for interact 2007. interfacing video capture, editing and publication in a tangible...
Post on 19-Oct-2014
597 views
DESCRIPTION
TRANSCRIPT
![Page 1: Presentation for Interact 2007. Interfacing Video Capture, Editing and Publication in a Tangible Environment](https://reader034.vdocuments.us/reader034/viewer/2022051411/5443e1d5b1af9f680a8b4688/html5/thumbnails/1.jpg)
Interfacing video capture,editing and publication ina tangible environment
By Cati Vaucelle & Hiroshi IshiiTangible Media group
MIT Media Laboratory
![Page 2: Presentation for Interact 2007. Interfacing Video Capture, Editing and Publication in a Tangible Environment](https://reader034.vdocuments.us/reader034/viewer/2022051411/5443e1d5b1af9f680a8b4688/html5/thumbnails/2.jpg)
From textable moviesto moving pictures
… the story of a gui that became a tui
![Page 3: Presentation for Interact 2007. Interfacing Video Capture, Editing and Publication in a Tangible Environment](https://reader034.vdocuments.us/reader034/viewer/2022051411/5443e1d5b1af9f680a8b4688/html5/thumbnails/3.jpg)
Inspiration
When Marcel Proust writesabout having tea and cookies(madeleine), he is inspired byhaving the experience himself,which brings back memoriesto his mind.
![Page 4: Presentation for Interact 2007. Interfacing Video Capture, Editing and Publication in a Tangible Environment](https://reader034.vdocuments.us/reader034/viewer/2022051411/5443e1d5b1af9f680a8b4688/html5/thumbnails/4.jpg)
Textable Movie
By immersion into their ownfootages connected tomemories, people couldbecome engaged into tellingrich, and passionate stories,based on past experience.
Reference: Vaucelle, C., and Davenport, G. ASystem to Compose Movies for Cross CulturalStorytelling: Textable Movie, In S. Göbel et al.(Eds.): TIDSE 2004
![Page 5: Presentation for Interact 2007. Interfacing Video Capture, Editing and Publication in a Tangible Environment](https://reader034.vdocuments.us/reader034/viewer/2022051411/5443e1d5b1af9f680a8b4688/html5/thumbnails/5.jpg)
Ideas behind textable movie
open-ended toolthat allows anyone
to become "video-jockey"
enhance accessibilityto media making
context of storytellingwith real time movie making
![Page 6: Presentation for Interact 2007. Interfacing Video Capture, Editing and Publication in a Tangible Environment](https://reader034.vdocuments.us/reader034/viewer/2022051411/5443e1d5b1af9f680a8b4688/html5/thumbnails/6.jpg)
key points
a command-driven, responsivesystem which mediates, in real time,
the nature (the visualization) of thevideo segments displayed on
the screen
maps descriptive text to media, e.g.various words describing a movie
allows multilingual input, e.g. English,French, Italian
responds immediately to input, e.g.text typed
transcribes text stories to media, e.g.video sequences, sound effects,
video effects
![Page 7: Presentation for Interact 2007. Interfacing Video Capture, Editing and Publication in a Tangible Environment](https://reader034.vdocuments.us/reader034/viewer/2022051411/5443e1d5b1af9f680a8b4688/html5/thumbnails/7.jpg)
International workshop
Mechanismfrom shooting videos to becoming"video-jockey”
The workshop features a design cycle that begins withconcept development and continues onto storyboarding,video production and editing;
as it is realized, participants test and evaluate their video-stories using Textable Movie.
![Page 8: Presentation for Interact 2007. Interfacing Video Capture, Editing and Publication in a Tangible Environment](https://reader034.vdocuments.us/reader034/viewer/2022051411/5443e1d5b1af9f680a8b4688/html5/thumbnails/8.jpg)
Video
![Page 9: Presentation for Interact 2007. Interfacing Video Capture, Editing and Publication in a Tangible Environment](https://reader034.vdocuments.us/reader034/viewer/2022051411/5443e1d5b1af9f680a8b4688/html5/thumbnails/9.jpg)
From GUI to TUI
The tangible potential of the direct use of videocontainer for movie creation presents threeopportunities that are critical to this research
- a need for a more transparent relationship
between shooting and editing
- enhance collaboration at various levels ofproduction: from shooting to experiencing to
creating a composed sound-video
- privilege improvisation for spontaneous creativity
- the reinvestigation of the video & soundmedium, allowing a direct and immediate
understanding of the effects of combining theseelements together
![Page 10: Presentation for Interact 2007. Interfacing Video Capture, Editing and Publication in a Tangible Environment](https://reader034.vdocuments.us/reader034/viewer/2022051411/5443e1d5b1af9f680a8b4688/html5/thumbnails/10.jpg)
Participatory design sessions
Collaboration with the Umea Institute ofDesign - research partner Diana Africano
Moderators from Ireland and Sweden organizeddesign sessions with children as co-partners over aperiod of 8 months.Moderators brought & test existing technology(RFID tags, Ipaqs, cell phones)
![Page 11: Presentation for Interact 2007. Interfacing Video Capture, Editing and Publication in a Tangible Environment](https://reader034.vdocuments.us/reader034/viewer/2022051411/5443e1d5b1af9f680a8b4688/html5/thumbnails/11.jpg)
Participatory design sessions - Craft
![Page 12: Presentation for Interact 2007. Interfacing Video Capture, Editing and Publication in a Tangible Environment](https://reader034.vdocuments.us/reader034/viewer/2022051411/5443e1d5b1af9f680a8b4688/html5/thumbnails/12.jpg)
Participatory design sessions - Craft
![Page 13: Presentation for Interact 2007. Interfacing Video Capture, Editing and Publication in a Tangible Environment](https://reader034.vdocuments.us/reader034/viewer/2022051411/5443e1d5b1af9f680a8b4688/html5/thumbnails/13.jpg)
Participatory design sessions - Craft
![Page 14: Presentation for Interact 2007. Interfacing Video Capture, Editing and Publication in a Tangible Environment](https://reader034.vdocuments.us/reader034/viewer/2022051411/5443e1d5b1af9f680a8b4688/html5/thumbnails/14.jpg)
In parallel design sketches
![Page 15: Presentation for Interact 2007. Interfacing Video Capture, Editing and Publication in a Tangible Environment](https://reader034.vdocuments.us/reader034/viewer/2022051411/5443e1d5b1af9f680a8b4688/html5/thumbnails/15.jpg)
In parallel design sketches
![Page 16: Presentation for Interact 2007. Interfacing Video Capture, Editing and Publication in a Tangible Environment](https://reader034.vdocuments.us/reader034/viewer/2022051411/5443e1d5b1af9f680a8b4688/html5/thumbnails/16.jpg)
First working prototypes
![Page 17: Presentation for Interact 2007. Interfacing Video Capture, Editing and Publication in a Tangible Environment](https://reader034.vdocuments.us/reader034/viewer/2022051411/5443e1d5b1af9f680a8b4688/html5/thumbnails/17.jpg)
Participatory design sessions
![Page 18: Presentation for Interact 2007. Interfacing Video Capture, Editing and Publication in a Tangible Environment](https://reader034.vdocuments.us/reader034/viewer/2022051411/5443e1d5b1af9f680a8b4688/html5/thumbnails/18.jpg)
Participatory design sessions - hardware
![Page 19: Presentation for Interact 2007. Interfacing Video Capture, Editing and Publication in a Tangible Environment](https://reader034.vdocuments.us/reader034/viewer/2022051411/5443e1d5b1af9f680a8b4688/html5/thumbnails/19.jpg)
Participatory design sessions - hardware
![Page 20: Presentation for Interact 2007. Interfacing Video Capture, Editing and Publication in a Tangible Environment](https://reader034.vdocuments.us/reader034/viewer/2022051411/5443e1d5b1af9f680a8b4688/html5/thumbnails/20.jpg)
Participatory design sessions - hardware
![Page 21: Presentation for Interact 2007. Interfacing Video Capture, Editing and Publication in a Tangible Environment](https://reader034.vdocuments.us/reader034/viewer/2022051411/5443e1d5b1af9f680a8b4688/html5/thumbnails/21.jpg)
First tests - video
QuickTime™ and aMPEG-4 Video decompressor
are needed to see this picture.
![Page 22: Presentation for Interact 2007. Interfacing Video Capture, Editing and Publication in a Tangible Environment](https://reader034.vdocuments.us/reader034/viewer/2022051411/5443e1d5b1af9f680a8b4688/html5/thumbnails/22.jpg)
First GUI - video
![Page 23: Presentation for Interact 2007. Interfacing Video Capture, Editing and Publication in a Tangible Environment](https://reader034.vdocuments.us/reader034/viewer/2022051411/5443e1d5b1af9f680a8b4688/html5/thumbnails/23.jpg)
Collaborative Content Creation
Moving Pictures enables a meaningful, spontaneous and collaborative approachto video creation, selection and sequencing.
The tangible metaphor of a token symbolizes a single shot and refers to thedifferent shots in a storyboard.
![Page 24: Presentation for Interact 2007. Interfacing Video Capture, Editing and Publication in a Tangible Environment](https://reader034.vdocuments.us/reader034/viewer/2022051411/5443e1d5b1af9f680a8b4688/html5/thumbnails/24.jpg)
Building the final prototype
![Page 25: Presentation for Interact 2007. Interfacing Video Capture, Editing and Publication in a Tangible Environment](https://reader034.vdocuments.us/reader034/viewer/2022051411/5443e1d5b1af9f680a8b4688/html5/thumbnails/25.jpg)
Moving PicturesWe synthesize performance and
editing to facilitate a flow between
improvisation and
postproduction of a movie.
Our multi-user system is targeted
for 10-12 year olds. It integrates
different layers of complexity,from digitizing the media and
performing a movie, to storyboardinga more complex narrative.
Reference: Vaucelle, C., Africano, D.,Davenport, G., Wiberg, M., and Fjellstrom,O. 2005. Moving pictures: looking out/looking in.In ACM SIGGRAPH 2005
![Page 26: Presentation for Interact 2007. Interfacing Video Capture, Editing and Publication in a Tangible Environment](https://reader034.vdocuments.us/reader034/viewer/2022051411/5443e1d5b1af9f680a8b4688/html5/thumbnails/26.jpg)
storyboard
+
video
jockey
![Page 27: Presentation for Interact 2007. Interfacing Video Capture, Editing and Publication in a Tangible Environment](https://reader034.vdocuments.us/reader034/viewer/2022051411/5443e1d5b1af9f680a8b4688/html5/thumbnails/27.jpg)
camera
![Page 28: Presentation for Interact 2007. Interfacing Video Capture, Editing and Publication in a Tangible Environment](https://reader034.vdocuments.us/reader034/viewer/2022051411/5443e1d5b1af9f680a8b4688/html5/thumbnails/28.jpg)
camera
![Page 29: Presentation for Interact 2007. Interfacing Video Capture, Editing and Publication in a Tangible Environment](https://reader034.vdocuments.us/reader034/viewer/2022051411/5443e1d5b1af9f680a8b4688/html5/thumbnails/29.jpg)
camera
![Page 30: Presentation for Interact 2007. Interfacing Video Capture, Editing and Publication in a Tangible Environment](https://reader034.vdocuments.us/reader034/viewer/2022051411/5443e1d5b1af9f680a8b4688/html5/thumbnails/30.jpg)
camera
Two video camera
![Page 31: Presentation for Interact 2007. Interfacing Video Capture, Editing and Publication in a Tangible Environment](https://reader034.vdocuments.us/reader034/viewer/2022051411/5443e1d5b1af9f680a8b4688/html5/thumbnails/31.jpg)
tokens
Blue and yellow tokens to record
![Page 32: Presentation for Interact 2007. Interfacing Video Capture, Editing and Publication in a Tangible Environment](https://reader034.vdocuments.us/reader034/viewer/2022051411/5443e1d5b1af9f680a8b4688/html5/thumbnails/32.jpg)
The system is composed of:two video cameras with token recognition, a video jockey to perform instantlythe videos and sounds captured, a storyboard to compose a final movie.
![Page 33: Presentation for Interact 2007. Interfacing Video Capture, Editing and Publication in a Tangible Environment](https://reader034.vdocuments.us/reader034/viewer/2022051411/5443e1d5b1af9f680a8b4688/html5/thumbnails/33.jpg)
General user interaction observationsObserving morethan 200 childrenfrom Boston, Dublinand Umea showedhow intuitive thesystem is.
![Page 34: Presentation for Interact 2007. Interfacing Video Capture, Editing and Publication in a Tangible Environment](https://reader034.vdocuments.us/reader034/viewer/2022051411/5443e1d5b1af9f680a8b4688/html5/thumbnails/34.jpg)
Observations - collecting video clips on the streets of Dublin
![Page 35: Presentation for Interact 2007. Interfacing Video Capture, Editing and Publication in a Tangible Environment](https://reader034.vdocuments.us/reader034/viewer/2022051411/5443e1d5b1af9f680a8b4688/html5/thumbnails/35.jpg)
Observations - getting to know the Moving Pictures platform
by retrieving their collected data
![Page 36: Presentation for Interact 2007. Interfacing Video Capture, Editing and Publication in a Tangible Environment](https://reader034.vdocuments.us/reader034/viewer/2022051411/5443e1d5b1af9f680a8b4688/html5/thumbnails/36.jpg)
Observations - figuring out the video storyboard without explanation
Video
![Page 37: Presentation for Interact 2007. Interfacing Video Capture, Editing and Publication in a Tangible Environment](https://reader034.vdocuments.us/reader034/viewer/2022051411/5443e1d5b1af9f680a8b4688/html5/thumbnails/37.jpg)
Results - children as co-designersGroup 1 of 7 12 year-old girls and group 2 of 5 11 year-old boys and6 11 year-old girls.
General interaction: Half of the children understood it withoutinstruction.
Confidence in the system: The lack of explanation on what to dowith Moving Pictures made the children exchange ideas andexplore the system with each other.
The use of the tokens: The children actively used the tokens for dataretrieval.
![Page 38: Presentation for Interact 2007. Interfacing Video Capture, Editing and Publication in a Tangible Environment](https://reader034.vdocuments.us/reader034/viewer/2022051411/5443e1d5b1af9f680a8b4688/html5/thumbnails/38.jpg)
Results - children as co-designersThe level of complexity of the interaction: Half of the children retrieveddata created by others and the other half mixed their own footagewith sound effects.
MP cameras versus professional cameras: Children found easy toremember how to interact with them and easy to use. Somechildren like using a smaller camera to carry in the pocket.
Round shape of the table: Preference for a round shaped table tointeract with simultaneously as well as to move around. According tothe children, a square table would have meant a four user table.
Table size: Children suggested that the table should be smaller if usedin a home. However, the table was too small to accommodate morethan eight users at a time.
![Page 39: Presentation for Interact 2007. Interfacing Video Capture, Editing and Publication in a Tangible Environment](https://reader034.vdocuments.us/reader034/viewer/2022051411/5443e1d5b1af9f680a8b4688/html5/thumbnails/39.jpg)
Results - children as co-designersGroup Size: If group bigger than 20, not all participants got a chanceto interact during the process of previewing and arranging moviesand sounds.
Effectiveness of Group Work: Children recommended the workinggroups to be smaller, but they also expressed that it was more funto work in a large group. In contrast, some children expressed thatworking in a group made the work easier and more effective,because participants helped each other in generating ideas formovie making.
Agreement vs disagreement: Many children considered disagreementas being a negative factor in their creative work. They explainedhow they made efforts in achieving a consensus.
![Page 40: Presentation for Interact 2007. Interfacing Video Capture, Editing and Publication in a Tangible Environment](https://reader034.vdocuments.us/reader034/viewer/2022051411/5443e1d5b1af9f680a8b4688/html5/thumbnails/40.jpg)
Final evaluationOur final evaluation consistedof two two-weeks workshop.
Children participatedvoluntarily.
Participants are from: - a localschool in Umea, Sweden- a tailored workshop on videomaking in Dublin, Ireland.
![Page 41: Presentation for Interact 2007. Interfacing Video Capture, Editing and Publication in a Tangible Environment](https://reader034.vdocuments.us/reader034/viewer/2022051411/5443e1d5b1af9f680a8b4688/html5/thumbnails/41.jpg)
Final evaluationIn all sessions, children were freeto choose their role in the film-making activity.
Driven by their personal interests,they chose to be film script-writers, director, actors, camera-men, or scenographers.
Children and moderatorsdiscussed and clarified the tasksfor each role during the sessions.
Most children chose the samerole repeatedly.
![Page 42: Presentation for Interact 2007. Interfacing Video Capture, Editing and Publication in a Tangible Environment](https://reader034.vdocuments.us/reader034/viewer/2022051411/5443e1d5b1af9f680a8b4688/html5/thumbnails/42.jpg)
Themes for the movies
Children chose and selected the following themes:
. Journalistic interviews limited to five shots
. Explorations in the city using more than ten shots
. Five individual shots of the children in front of theirfavorite Dublin place. A five shots criminal story. A theater play using ten shots
The most popular movies were the individual shotsand the criminal story
![Page 43: Presentation for Interact 2007. Interfacing Video Capture, Editing and Publication in a Tangible Environment](https://reader034.vdocuments.us/reader034/viewer/2022051411/5443e1d5b1af9f680a8b4688/html5/thumbnails/43.jpg)
Movie example 1- individual shots of the children in Dublin
![Page 44: Presentation for Interact 2007. Interfacing Video Capture, Editing and Publication in a Tangible Environment](https://reader034.vdocuments.us/reader034/viewer/2022051411/5443e1d5b1af9f680a8b4688/html5/thumbnails/44.jpg)
Movie example 2 - a criminal story
![Page 45: Presentation for Interact 2007. Interfacing Video Capture, Editing and Publication in a Tangible Environment](https://reader034.vdocuments.us/reader034/viewer/2022051411/5443e1d5b1af9f680a8b4688/html5/thumbnails/45.jpg)
Results - Individual shots vs a story
The most complex features of MP were used during a narrative movie
![Page 46: Presentation for Interact 2007. Interfacing Video Capture, Editing and Publication in a Tangible Environment](https://reader034.vdocuments.us/reader034/viewer/2022051411/5443e1d5b1af9f680a8b4688/html5/thumbnails/46.jpg)
Results - Cultural exchange ?
The students did not want to edit the other country’s final movies.
They were excited to watch the variations in the movies and to continue them.
This shows potential for cultural exchange through video making.
![Page 47: Presentation for Interact 2007. Interfacing Video Capture, Editing and Publication in a Tangible Environment](https://reader034.vdocuments.us/reader034/viewer/2022051411/5443e1d5b1af9f680a8b4688/html5/thumbnails/47.jpg)
Exchange - a movie that started in Dublin and finished in Umea
![Page 48: Presentation for Interact 2007. Interfacing Video Capture, Editing and Publication in a Tangible Environment](https://reader034.vdocuments.us/reader034/viewer/2022051411/5443e1d5b1af9f680a8b4688/html5/thumbnails/48.jpg)
Discussion - benefits of TUI such as Moving Pictures
. Allows quick revision of footage
. Invites for improvisation
. Engages in group collaboration
. Sustains children’s attention - with iMovie children lost focus and patience during editing (study for Textable Movie)
. Allows experimentation with movie sequences and alternation of shots
. Constraints children in selecting what is important during capturing (a more natural process for children)
![Page 49: Presentation for Interact 2007. Interfacing Video Capture, Editing and Publication in a Tangible Environment](https://reader034.vdocuments.us/reader034/viewer/2022051411/5443e1d5b1af9f680a8b4688/html5/thumbnails/49.jpg)
Discussion - limitations of TUI such as Moving Pictures
Architecture. Needs scalability design to centralize data for international exchange. Technology should assist the user while capturing content. GUI should better assist the user while navigating through theretrieved content. New communication technology for multiple video platforms
Moving Pictures design features. RFID -> Pattern based technology with any cell phone. Moving Pictures should offer more editing possibilities. We testedtangible tokens as transitions and physical cuts. Moving Pictures should allow users to record and play with theirown sounds
![Page 50: Presentation for Interact 2007. Interfacing Video Capture, Editing and Publication in a Tangible Environment](https://reader034.vdocuments.us/reader034/viewer/2022051411/5443e1d5b1af9f680a8b4688/html5/thumbnails/50.jpg)
ConclusionInterface video capture,editing and publication in aself-contained platform
Understand interfaces thatempower people inexpressing and sharingideas about their socialenvironment
Systems for constructingpersonal content
![Page 51: Presentation for Interact 2007. Interfacing Video Capture, Editing and Publication in a Tangible Environment](https://reader034.vdocuments.us/reader034/viewer/2022051411/5443e1d5b1af9f680a8b4688/html5/thumbnails/51.jpg)
Acknowledgment Media Lab Europe where
Textable Movie + Moving Pictures emerged. GloriannaDavenport who supported this reseach from 2002-2005. DianaAfricano and Oskar Fjellstrom for our collaborative research
on Moving Pictures in 2004 at the Umea Institute of Designin Sweden. Joakim Salberg for the model making. JennyFredriksson for co-observing the participatory design sessions in
Sweden. Michael John Gorman, Leo Mc Kenna, the Ark inDublin, Vincent Le Bail, Eoghan Kidney, the School of Ostermalm.Brendan Tangney at Trinity College. Diana Africano, Adam Boulanger,the conference reviewers for their feedback on the paper. The tangiblemedia group - past and present members - the storynetworks group andCarol Strohecker at MLE and The MIT Media Lab community.
![Page 52: Presentation for Interact 2007. Interfacing Video Capture, Editing and Publication in a Tangible Environment](https://reader034.vdocuments.us/reader034/viewer/2022051411/5443e1d5b1af9f680a8b4688/html5/thumbnails/52.jpg)
Contact
Interfacing Video Capture, Editing and Publication in a Tangible Environment
www.media.mit.edu/~cati
Cati Vaucelle and Hiroshi IshiiMIT Media LaboratoryTangible Media Group
Research group’s web site tangible.media.mit.eduEmail {cati, ishii}@media.mit.edu