design engineering collaborative at uc berkeley a microsoft mindsumo challenge submission by grant...
TRANSCRIPT
Design Engineering Collaborative at UC Berkeley
Unleashing Creativity With the Xbox Kinect
A Microsoft Mindsumo Challenge Submission
By Grant Buster
For this challenge I focused on:
Using the Xbox Kinect to:Create an empowered design toolPromote 3D artistic expressionMake freeform modeling capable and funRemove limits on creative expression
Design Engineering Collaborative at UC Berkeley
Traditional sketching is…
BeautifulFreeformLimited to a 2D plane
Design Engineering Collaborative at UC Berkeley
3D printing pens (3Doodler) are…
Awesome for sketches but cannot make computer models
Design Engineering Collaborative at UC Berkeley
Current 3D modeling software is great at…
Engineering modelingExtrusionsRotations
Design Engineering Collaborative at UC Berkeley
Current 3D modeling software is also bad at…
Abstract shapes3D Art
Design Engineering Collaborative at UC Berkeley
But why limit design of 3 dimensional objects
to a 2 dimensional computer screen?
Design Engineering Collaborative at UC Berkeley
You could draw anything in 3D using…
Design Engineering Collaborative at UC Berkeley
An Infrared Pen with variable intensity
The Xbox Kinect
A standard computer
The GUI would be a combination of…
Design Engineering Collaborative at UC Berkeley
Photoshop tools & Solidworks tools
With visual feedback as to where your pen is
The software would…
Acquire the 3D location of the infrared pen using the Kinect’s stereo imaging.Read the intensity of the infrared signal and translate it to the “brush stroke” weight. Determine the orientation of the pen for ideal brush paths.Correlate the velocity of brush strokes with brush weight. Use the GUI’s user input to apply the specified 2D cross section for the “brush”.Output a 3D model of what the user draws.
Design Engineering Collaborative at UC Berkeley
This would be a better interface than Leap Motion because…
Leap Motion’s sensor is limited to a 2x2x2 foot cube. The Xbox Kinect can image an entire room.Current Leap Motion software is good at using you hand positions to manipulate, rotate and exhibit current models. From the Leap Motion website: “you can point, wave, reach, and grab. Even pick something up and put it down.” Creating something is a different story…This Kinect software would change the way people create things from scratch in 3D, as opposed to just manipulating them.
Design Engineering Collaborative at UC Berkeley
This proposed software would fuse the raw creativity of drawing with the
beauty of 3D modeling in a revolutionary new experience. Imagine
play dough for the 21st century.
Design Engineering Collaborative at UC Berkeley
The Kinect has been used for gaming, robotics, education, and even fitness. I think it’s time to be
used to empower the design community.
Design Engineering Collaborative at UC Berkeley