uncertainty in grasping and feeding
DESCRIPTION
Uncertainty in Grasping and Feeding. Frank van der Stappen Utrecht University Shanghai, China, May 9, 2011. Outline. Algorithmic Automation Grasping: finger misplacements Feeding: pose variations Inaccurate manipulators and imprecise parts. RISC: 15 Years Ago. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Uncertainty in Grasping and Feeding](https://reader030.vdocuments.us/reader030/viewer/2022033022/568135de550346895d9d535e/html5/thumbnails/1.jpg)
Uncertainty in Grasping and Feeding
Frank van der Stappen
Utrecht University
Shanghai, China, May 9, 2011
![Page 2: Uncertainty in Grasping and Feeding](https://reader030.vdocuments.us/reader030/viewer/2022033022/568135de550346895d9d535e/html5/thumbnails/2.jpg)
Outline
• Algorithmic Automation
• Grasping: finger misplacements
• Feeding: pose variations
• Inaccurate manipulators and imprecise parts
![Page 3: Uncertainty in Grasping and Feeding](https://reader030.vdocuments.us/reader030/viewer/2022033022/568135de550346895d9d535e/html5/thumbnails/3.jpg)
RISC: 15 Years Ago
‘Simplicity in the factory’ [Whitney 86] instead of ‘ungodly complex robot hands’ [Tanzer & Simon 90]
Reduced Intricacy in Sensing and Control [Canny &
Goldberg 94]:• simple ‘planable’ physical actions, by• simple, reliable hardware components• simple or even no sensors
![Page 4: Uncertainty in Grasping and Feeding](https://reader030.vdocuments.us/reader030/viewer/2022033022/568135de550346895d9d535e/html5/thumbnails/4.jpg)
Algorithmic Automation
• Complete,• efficient, and• provably correct planning algorithms
using • geometry,• data structures, and• modeling and
simulation
planner
![Page 5: Uncertainty in Grasping and Feeding](https://reader030.vdocuments.us/reader030/viewer/2022033022/568135de550346895d9d535e/html5/thumbnails/5.jpg)
Outline
• Algorithmic Automation
• Grasping: finger misplacements
• Feeding: pose variations
• Inaccurate manipulators and imprecise parts
![Page 6: Uncertainty in Grasping and Feeding](https://reader030.vdocuments.us/reader030/viewer/2022033022/568135de550346895d9d535e/html5/thumbnails/6.jpg)
Grasp Analysis
• Form Closure: Analysis of Instantaneous Velocities [1870s]
• Force Closure: Analysis of Forces and Moments [1970s]
– 4 fingers sufficient for most 2D parts– 7 fingers sufficient for most 3D parts
• 2nd Order Immobility: Analysis in Configuration Space [1990s]
– 3 fingers sufficient for most 2D parts– 4 fingers sufficient for most 3D parts
![Page 7: Uncertainty in Grasping and Feeding](https://reader030.vdocuments.us/reader030/viewer/2022033022/568135de550346895d9d535e/html5/thumbnails/7.jpg)
Wrench Analysis
Force closure: wrenches w1,…,wk induced by fingers should be able to resist any external wrench [Lakshminarayana 1978], so
w1,…,wk form a positive basis for wrench space, so
convex hull of w1,…,wk has O in its interior.
w1
w2
w3w4
![Page 8: Uncertainty in Grasping and Feeding](https://reader030.vdocuments.us/reader030/viewer/2022033022/568135de550346895d9d535e/html5/thumbnails/8.jpg)
Computing the Grasps or Fixtures
• Four points along four edges
4a,3a,2a,1a edges
4321 )a,a,a,a(FC :Output
4321 a and ,a,a,a on points with grasps ofset
complexity )1(O
n edges
![Page 9: Uncertainty in Grasping and Feeding](https://reader030.vdocuments.us/reader030/viewer/2022033022/568135de550346895d9d535e/html5/thumbnails/9.jpg)
Output-Sensitive Grasp Synthesis
• Naïve:
• Output-sensitive:
)a,a,a,a(FC compute do )a,a,a,a( allfor 43214321
)a,a,a,a(FC compute do )P(Q)a,a,a,a( allfor 43214321 })a,a,a,a(FC|)a,a,a,a{()P(Q compute 43214321 )n(O 2
)Kn(O 2
)1(O)n(O 4 x )n(O 4=
)K(O|))P(Q(|O )1(O )K(Ox =
![Page 10: Uncertainty in Grasping and Feeding](https://reader030.vdocuments.us/reader030/viewer/2022033022/568135de550346895d9d535e/html5/thumbnails/10.jpg)
Algorithmic Approach
2D
2D
2D
nn
n²
? n²
naive: n combinations
4smart: ± n operations
2
data structure
![Page 11: Uncertainty in Grasping and Feeding](https://reader030.vdocuments.us/reader030/viewer/2022033022/568135de550346895d9d535e/html5/thumbnails/11.jpg)
Finger Misplacement
• Algorithm reports continuous set of all four-finger grasps
• Some grasps are very sensitive to finger mispacements
• Postprocessing step in ‘configuration space’ of all grasps: [Ponce et al 1995, vdS et al 2000]
– determine grasp that minimizes sensivity to finger misplacement
– select the grasps that allow for a given misplacement of all fingers
![Page 12: Uncertainty in Grasping and Feeding](https://reader030.vdocuments.us/reader030/viewer/2022033022/568135de550346895d9d535e/html5/thumbnails/12.jpg)
Independent Grasp Regions in 2D
• Identify combinations of regions on part boundary that allow for independent finger placements [Nguyen 1988].
w1
w2
w3w4
![Page 13: Uncertainty in Grasping and Feeding](https://reader030.vdocuments.us/reader030/viewer/2022033022/568135de550346895d9d535e/html5/thumbnails/13.jpg)
Insensitivity to Finger Misplacements
• Place fingers at the centers of the independent grasp regions: allowed misplacement is computable.
![Page 14: Uncertainty in Grasping and Feeding](https://reader030.vdocuments.us/reader030/viewer/2022033022/568135de550346895d9d535e/html5/thumbnails/14.jpg)
Independent Grasp Regions in 3D
• Given a rectilinear polyhedron, identify all combinations of 7 patches that admit independent finger placement.
Boundary is subdivided into n patches of size ε x ε to guarantee allowed misplacement of ε/2.
εε
![Page 15: Uncertainty in Grasping and Feeding](https://reader030.vdocuments.us/reader030/viewer/2022033022/568135de550346895d9d535e/html5/thumbnails/15.jpg)
Different Algorithmic Challenges
• Red-blue containments and crossings instead of red-blue intersections
![Page 16: Uncertainty in Grasping and Feeding](https://reader030.vdocuments.us/reader030/viewer/2022033022/568135de550346895d9d535e/html5/thumbnails/16.jpg)
Caging
• Rigid motion of the fingers
![Page 17: Uncertainty in Grasping and Feeding](https://reader030.vdocuments.us/reader030/viewer/2022033022/568135de550346895d9d535e/html5/thumbnails/17.jpg)
Caging
• Rigid motion of the fingers forces part to move along
![Page 18: Uncertainty in Grasping and Feeding](https://reader030.vdocuments.us/reader030/viewer/2022033022/568135de550346895d9d535e/html5/thumbnails/18.jpg)
Caging
• Fingers cage a part if there exists no motion that takes
the part from its current placement to a remote placement without colliding with a finger.
If the current placement lies in a bounded component of free configuration space then the part is caged.
![Page 19: Uncertainty in Grasping and Feeding](https://reader030.vdocuments.us/reader030/viewer/2022033022/568135de550346895d9d535e/html5/thumbnails/19.jpg)
Outline
• Algorithmic Automation
• Grasping: finger misplacements
• Feeding: pose variations
• Inaccurate manipulators and imprecise parts
![Page 20: Uncertainty in Grasping and Feeding](https://reader030.vdocuments.us/reader030/viewer/2022033022/568135de550346895d9d535e/html5/thumbnails/20.jpg)
Part Feeding
• Feeders based on various actions: push, squeeze, topple, pull, tap, roll, vibrate, wobble, drop, …
Parts Feede
r
![Page 21: Uncertainty in Grasping and Feeding](https://reader030.vdocuments.us/reader030/viewer/2022033022/568135de550346895d9d535e/html5/thumbnails/21.jpg)
Feeding with Fences
• Every 2-dimensional part can be oriented by fences over a conveyor belt.
• Shortest fence design efficiently computable [Berretty, Goldberg, Overmars, vdS 98].
![Page 22: Uncertainty in Grasping and Feeding](https://reader030.vdocuments.us/reader030/viewer/2022033022/568135de550346895d9d535e/html5/thumbnails/22.jpg)
www.durafeed.com
Vibratory Bowl Feeders
• Parts vibrate upward along a helical track.
• Obstacles force wrongly oriented parts back to the bottom of the bowl.
• Design of obstacles.
![Page 23: Uncertainty in Grasping and Feeding](https://reader030.vdocuments.us/reader030/viewer/2022033022/568135de550346895d9d535e/html5/thumbnails/23.jpg)
Algorithmic Trap Design
• Filtering traps for vibratory bowl feeders
![Page 24: Uncertainty in Grasping and Feeding](https://reader030.vdocuments.us/reader030/viewer/2022033022/568135de550346895d9d535e/html5/thumbnails/24.jpg)
• Combination of rejection functionality of traps and reorientation functionality of fences
Blades
![Page 25: Uncertainty in Grasping and Feeding](https://reader030.vdocuments.us/reader030/viewer/2022033022/568135de550346895d9d535e/html5/thumbnails/25.jpg)
Blades
![Page 26: Uncertainty in Grasping and Feeding](https://reader030.vdocuments.us/reader030/viewer/2022033022/568135de550346895d9d535e/html5/thumbnails/26.jpg)
Assumptions
• Parts– identical polyhedra– quasi-static motion– singulated
• Zero friction• No toppling• Locally linear track
![Page 27: Uncertainty in Grasping and Feeding](https://reader030.vdocuments.us/reader030/viewer/2022033022/568135de550346895d9d535e/html5/thumbnails/27.jpg)
Part Reorientation and Rejection
• Reorientation: track pose to blade pose– Blade angle– Blade height
• Rejection: blade pose− Blade width
![Page 28: Uncertainty in Grasping and Feeding](https://reader030.vdocuments.us/reader030/viewer/2022033022/568135de550346895d9d535e/html5/thumbnails/28.jpg)
Modeling
blade angle
blade width wblade height
h
INPUTPolyhedral part P & Center of mass C
OUTPUT
Set of blades b(,h,w) feeding P
ALGORITHM
![Page 29: Uncertainty in Grasping and Feeding](https://reader030.vdocuments.us/reader030/viewer/2022033022/568135de550346895d9d535e/html5/thumbnails/29.jpg)
Blade Space
Blade width
Blade height
Blade angle
hw
• Point represents a blade• Surfaces subdivide space
![Page 30: Uncertainty in Grasping and Feeding](https://reader030.vdocuments.us/reader030/viewer/2022033022/568135de550346895d9d535e/html5/thumbnails/30.jpg)
Critical Surface
Blade width
Blade height
Blade angle
• Critical surface for every initial pose, consisting of patches (one per possible reorientation)– Above surface: part in that pose falls– Below surface: part in that pose survives
S
![Page 31: Uncertainty in Grasping and Feeding](https://reader030.vdocuments.us/reader030/viewer/2022033022/568135de550346895d9d535e/html5/thumbnails/31.jpg)
Critical Arrangement
Blade width
Blade angle
• B is a blade that feeds P1
• Valid solutions: points above all but one surface: 1-level
P1
P2
P3
B
Blade height
![Page 32: Uncertainty in Grasping and Feeding](https://reader030.vdocuments.us/reader030/viewer/2022033022/568135de550346895d9d535e/html5/thumbnails/32.jpg)
Physical Experiments
pose I
blade
track wall
• Discrepancies with prediction by model– Part motion– Part model– Part variations
![Page 33: Uncertainty in Grasping and Feeding](https://reader030.vdocuments.us/reader030/viewer/2022033022/568135de550346895d9d535e/html5/thumbnails/33.jpg)
Uncertainty in Reorientation
![Page 34: Uncertainty in Grasping and Feeding](https://reader030.vdocuments.us/reader030/viewer/2022033022/568135de550346895d9d535e/html5/thumbnails/34.jpg)
Uncertainty in Reorientation
pose A
pose B
![Page 35: Uncertainty in Grasping and Feeding](https://reader030.vdocuments.us/reader030/viewer/2022033022/568135de550346895d9d535e/html5/thumbnails/35.jpg)
Height
Uncertainty in Reorientation
pose I
Angle
Width
Patches of initial part pose I’s critical surface correspond to final part poses
patch Bpatch A
![Page 36: Uncertainty in Grasping and Feeding](https://reader030.vdocuments.us/reader030/viewer/2022033022/568135de550346895d9d535e/html5/thumbnails/36.jpg)
Angle
h=H
Consider cross-section at blade height h
Uncertainty in Reorientation
Height
Width
![Page 37: Uncertainty in Grasping and Feeding](https://reader030.vdocuments.us/reader030/viewer/2022033022/568135de550346895d9d535e/html5/thumbnails/37.jpg)
Angle
Width
blade
Model predicts that the blade reorients the part to pose A after which it is rejected but the experiments shows that it occasionally gets fed in pose B
Uncertainty in Reorientation
patch B
patch A
![Page 38: Uncertainty in Grasping and Feeding](https://reader030.vdocuments.us/reader030/viewer/2022033022/568135de550346895d9d535e/html5/thumbnails/38.jpg)
Alter Patches
width
patch A patch B
angle
w
Pose B may be fed by the blade
![Page 39: Uncertainty in Grasping and Feeding](https://reader030.vdocuments.us/reader030/viewer/2022033022/568135de550346895d9d535e/html5/thumbnails/39.jpg)
width
angle
Adjust width of the patch
Uncertainty in Reorientation
patch A patch B
![Page 40: Uncertainty in Grasping and Feeding](https://reader030.vdocuments.us/reader030/viewer/2022033022/568135de550346895d9d535e/html5/thumbnails/40.jpg)
Outline
• Algorithmic Automation
• Grasping: finger misplacements
• Feeding: pose variations
• Inaccurate manipulators and imprecise parts
![Page 41: Uncertainty in Grasping and Feeding](https://reader030.vdocuments.us/reader030/viewer/2022033022/568135de550346895d9d535e/html5/thumbnails/41.jpg)
Uncertainty
• Determine manipulation plans that work despite given variations in – part shape– manipulator actions
• Analysis• Existence• Synthesis
![Page 42: Uncertainty in Grasping and Feeding](https://reader030.vdocuments.us/reader030/viewer/2022033022/568135de550346895d9d535e/html5/thumbnails/42.jpg)
Imperfect Parts
• For a given task and a family of shapes, plan actions that accomplish the task for any shape in the family
![Page 43: Uncertainty in Grasping and Feeding](https://reader030.vdocuments.us/reader030/viewer/2022033022/568135de550346895d9d535e/html5/thumbnails/43.jpg)
Inaccurate Manipulators
• For a given part, task, and a range of perturbations of any possible action, plan actions such that even the perturbed versions of the actions in the plan accomplish the task
![Page 44: Uncertainty in Grasping and Feeding](https://reader030.vdocuments.us/reader030/viewer/2022033022/568135de550346895d9d535e/html5/thumbnails/44.jpg)
AMPLIFI
New project: Algorithms for manipulation planning with imperfect parts and inaccurate manipulators
Open PhD position, funded by NWO:• MSc degree in computer science or mathematics• interest in (and preferably background) in algorithms design• interest in applications in Robotics and Automation.
![Page 45: Uncertainty in Grasping and Feeding](https://reader030.vdocuments.us/reader030/viewer/2022033022/568135de550346895d9d535e/html5/thumbnails/45.jpg)
Thank You!
Papers available from http://people.cs.uu.nl/frankst/
Joint work with: Mark Overmars, Ken Goldberg, Elon Rimon, Mark de Berg, Xavier Goaoc, Chantal Wentink, Robert-Paul Berretty, Jae-Sook Cheong, Onno Goemans, Mostafa Vahedi, Heinrich Kruger, Herman Haverkort, Anthony Lewandowski, Marshall Anderson, Gordon Smith