impacttough robotics challenge - cabinet office...2020/03/19 · • sensing system is necessary to...
TRANSCRIPT
![Page 1: ImPACTTough Robotics Challenge - Cabinet Office...2020/03/19 · • Sensing system is necessary to localize the position Other problems Durability and Operability [July.25-26, 2018]](https://reader034.vdocuments.us/reader034/viewer/2022042309/5ed57d9f276f24058026912f/html5/thumbnails/1.jpg)
Im PA C T Tou g h R ob otics C h allen g e- A N ation al P roject of Jap an C ab in et O ffice
on D isaster R ob otics
Satoshi Tadokoro
Past Program M anager, Im PA C T Tough R obotics C hallengeD irector, Tough C yberphysicalA I R esearch C enter, Tohoku U niversity
President, International R escue System InstitutePast President, IEEE R obotics and A utom ation Society
1
![Page 2: ImPACTTough Robotics Challenge - Cabinet Office...2020/03/19 · • Sensing system is necessary to localize the position Other problems Durability and Operability [July.25-26, 2018]](https://reader034.vdocuments.us/reader034/viewer/2022042309/5ed57d9f276f24058026912f/html5/thumbnails/2.jpg)
2
Im PA C T -T R C : B ackg ro u n d
• Targ et: Freq u en t n atu ral an d m an -m ad e d isasterR ob otics for E ffective S olu tion
– Preparedness, R esponse and R ecovery, Search and R escue– Im possible for H um an, H igh R isk for H um an, R apid /Efficient Task Execution
• O b jective: Tou g h R ob u st R ob oticss Frag ile Tech n olog ies
Tou g h & R ob u st A ccessibility in extrem e conditions
Sensing in adverse conditions (hearing, w atching and touching)
R ecovery from failure
C om patibility w ith disaster environm ent
![Page 3: ImPACTTough Robotics Challenge - Cabinet Office...2020/03/19 · • Sensing system is necessary to localize the position Other problems Durability and Operability [July.25-26, 2018]](https://reader034.vdocuments.us/reader034/viewer/2022042309/5ed57d9f276f24058026912f/html5/thumbnails/3.jpg)
R ob ot N eed s: R esp o n se to E arth q u ake
3
D isaster M ission Im PA C T -T R C S olu tionIn su fficien cy
![Page 4: ImPACTTough Robotics Challenge - Cabinet Office...2020/03/19 · • Sensing system is necessary to localize the position Other problems Durability and Operability [July.25-26, 2018]](https://reader034.vdocuments.us/reader034/viewer/2022042309/5ed57d9f276f24058026912f/html5/thumbnails/4.jpg)
飛行ロボット
4
![Page 5: ImPACTTough Robotics Challenge - Cabinet Office...2020/03/19 · • Sensing system is necessary to localize the position Other problems Durability and Operability [July.25-26, 2018]](https://reader034.vdocuments.us/reader034/viewer/2022042309/5ed57d9f276f24058026912f/html5/thumbnails/5.jpg)
5
A erial Platform for Disaster Survey[Nonami, ACSL]
5
![Page 6: ImPACTTough Robotics Challenge - Cabinet Office...2020/03/19 · • Sensing system is necessary to localize the position Other problems Durability and Operability [July.25-26, 2018]](https://reader034.vdocuments.us/reader034/viewer/2022042309/5ed57d9f276f24058026912f/html5/thumbnails/6.jpg)
Northern Kyushu Heavy Rain Flood
6
[Nonami, ACSL; Tadokoro, Tohoku U]
![Page 7: ImPACTTough Robotics Challenge - Cabinet Office...2020/03/19 · • Sensing system is necessary to localize the position Other problems Durability and Operability [July.25-26, 2018]](https://reader034.vdocuments.us/reader034/viewer/2022042309/5ed57d9f276f24058026912f/html5/thumbnails/7.jpg)
Northern Kyushu Heavy Rain Flood
7
Ortho Image (a part)Resolution: 2 cm / pixel
Purpose: Out-of-Sight Information GatheringPlace: Toho Village, Fukuoka PrefectureSpeed: 60 km/hFlight Time: 7 min<Achievement>
Information was gathered by aerial robot Data were give to FDMA, CAO, Fukuoka Pref., etc. The data quality and the robot specification were enough for the needs. Various lessons were learned
(out-of-sight flight, position sharing, map of electric cables, support system, local information sharing system)
[Nonami, ACSL; Tadokoro, Tohoku U]
![Page 8: ImPACTTough Robotics Challenge - Cabinet Office...2020/03/19 · • Sensing system is necessary to localize the position Other problems Durability and Operability [July.25-26, 2018]](https://reader034.vdocuments.us/reader034/viewer/2022042309/5ed57d9f276f24058026912f/html5/thumbnails/8.jpg)
R em ote S ou n d S ou rce Exp loration[Nakadai, TITECH; Kumon, Kumamoto U; Okuno, Waseda U]
8
![Page 9: ImPACTTough Robotics Challenge - Cabinet Office...2020/03/19 · • Sensing system is necessary to localize the position Other problems Durability and Operability [July.25-26, 2018]](https://reader034.vdocuments.us/reader034/viewer/2022042309/5ed57d9f276f24058026912f/html5/thumbnails/9.jpg)
索状ロボット
9
![Page 10: ImPACTTough Robotics Challenge - Cabinet Office...2020/03/19 · • Sensing system is necessary to localize the position Other problems Durability and Operability [July.25-26, 2018]](https://reader034.vdocuments.us/reader034/viewer/2022042309/5ed57d9f276f24058026912f/html5/thumbnails/10.jpg)
Overview: ImPACT Thin Serpentine Robot Project
• Rapid search and rescue for victims trapped in collapsed building• Inspections in a narrow space in plants and infrastructures for daily use
Missions
[Konyo, Tadokoro, Tohoku U]10
![Page 11: ImPACTTough Robotics Challenge - Cabinet Office...2020/03/19 · • Sensing system is necessary to localize the position Other problems Durability and Operability [July.25-26, 2018]](https://reader034.vdocuments.us/reader034/viewer/2022042309/5ed57d9f276f24058026912f/html5/thumbnails/11.jpg)
Self-propelled video scope
Ciliary vibration drive
Mechanism
The ASC can propel forward with the ciliary vibration drive, which generates propulsion force by vibrating tilted cilia wrapped around the flexible robot.
Our conventional approach:Active Scope Camera (ASC)
[IROS 07]
[JRM 0]
[Konyo, Tadokoro, Tohoku U]11
![Page 12: ImPACTTough Robotics Challenge - Cabinet Office...2020/03/19 · • Sensing system is necessary to localize the position Other problems Durability and Operability [July.25-26, 2018]](https://reader034.vdocuments.us/reader034/viewer/2022042309/5ed57d9f276f24058026912f/html5/thumbnails/12.jpg)
Advantages of ASC (1)
Standard industrial video scope (x3) Active Scope Camera (x3)
Lager contact area generates larger propelling force by distributed drive
Big advantage for inspection in a narrow confined space
Whole contacted surface generates driving force
[Konyo, Tadokoro, Tohoku U]12
![Page 13: ImPACTTough Robotics Challenge - Cabinet Office...2020/03/19 · • Sensing system is necessary to localize the position Other problems Durability and Operability [July.25-26, 2018]](https://reader034.vdocuments.us/reader034/viewer/2022042309/5ed57d9f276f24058026912f/html5/thumbnails/13.jpg)
Advantages of ASC (2)
Light flexible continuum body
• Robustness in rubble• Durability
×8.0
Vertical Exploration with Tube-type ASC [IROS2014]
×1.0
[Konyo, Tadokoro, Tohoku U]
13
![Page 14: ImPACTTough Robotics Challenge - Cabinet Office...2020/03/19 · • Sensing system is necessary to localize the position Other problems Durability and Operability [July.25-26, 2018]](https://reader034.vdocuments.us/reader034/viewer/2022042309/5ed57d9f276f24058026912f/html5/thumbnails/14.jpg)
Active Scope Camera Deployment to Construction Accident in Jacksonville
Jan. 4-5, 2008 @ Jacksonville, FL Gathered evidence info. 7 m deep
Shape & direction of RC cracks Shape & cross section of flakes Image of spaces inside
Impossible by other equipment size, mobility, controllability
[Tadokoro, Tohoku UMurphy, USF]
14
![Page 15: ImPACTTough Robotics Challenge - Cabinet Office...2020/03/19 · • Sensing system is necessary to localize the position Other problems Durability and Operability [July.25-26, 2018]](https://reader034.vdocuments.us/reader034/viewer/2022042309/5ed57d9f276f24058026912f/html5/thumbnails/15.jpg)
Project Topics and Groups
Mobility (rubbles, gaps, turning, speed, ...) Sensing (for Search and Navigation) Usability (for quick easy operation)
Insufficient Capabilities in Real Missions
Auditory TactileVision
Hyper mobility by Jet injections
Tadokoro, Konyo (Tohoku Univ.)
Visual SLAMOkatani (Tohoku Univ.)
Image RecognitionYamazaki (Shinshu Univ.)
Realtime speech enhancementPosture estimation
Okuno, Bando (Waseda Univ., AIST)
Offline speech enhancementSaruwatari (Univ. Tokyo)
Contact SensingKonyo (Tohoku Univ.)
Ciliary vibration drive Air-jet floating
Mobility
[Konyo, Tadokoro, Tohoku U]15
![Page 16: ImPACTTough Robotics Challenge - Cabinet Office...2020/03/19 · • Sensing system is necessary to localize the position Other problems Durability and Operability [July.25-26, 2018]](https://reader034.vdocuments.us/reader034/viewer/2022042309/5ed57d9f276f24058026912f/html5/thumbnails/16.jpg)
Advanced Mobility by Air-jet
Head Floating by Air-jet
Key issue: Achieving stability of the lightweight flexible cable in the air
[Ambe, Konyo, Tadokoro, Tohoku U]16
![Page 17: ImPACTTough Robotics Challenge - Cabinet Office...2020/03/19 · • Sensing system is necessary to localize the position Other problems Durability and Operability [July.25-26, 2018]](https://reader034.vdocuments.us/reader034/viewer/2022042309/5ed57d9f276f24058026912f/html5/thumbnails/17.jpg)
Sensory Integration
Detection of Pre-Registered Targets [Konyo, Tadokoro, Tohoku U]17
![Page 18: ImPACTTough Robotics Challenge - Cabinet Office...2020/03/19 · • Sensing system is necessary to localize the position Other problems Durability and Operability [July.25-26, 2018]](https://reader034.vdocuments.us/reader034/viewer/2022042309/5ed57d9f276f24058026912f/html5/thumbnails/18.jpg)
Im ag e recog n ition an d categ orizin g ru b b le• A nalyzing objects in video→ Extracting possible objects
Input Im age D etection of target Im age segm entation
V isu al S u p p ort for V ictim S earch
U nsu p ervised Learn in gC ategorize w ithout prior know ledge using N N (C onvolutional A utoencoder) and autom atically updated.
[Yamazaki, Shinshu U]
18
![Page 19: ImPACTTough Robotics Challenge - Cabinet Office...2020/03/19 · • Sensing system is necessary to localize the position Other problems Durability and Operability [July.25-26, 2018]](https://reader034.vdocuments.us/reader034/viewer/2022042309/5ed57d9f276f24058026912f/html5/thumbnails/19.jpg)
Blind Speech Enhancement
Evaluation in the simulated collapsed house
Input Spectrogram
Microphone
Spectrogram of Enhanced Speech
Ego-noize Speech
[Bando, Kyoto U; Okuno, Waseda U]
19
![Page 20: ImPACTTough Robotics Challenge - Cabinet Office...2020/03/19 · • Sensing system is necessary to localize the position Other problems Durability and Operability [July.25-26, 2018]](https://reader034.vdocuments.us/reader034/viewer/2022042309/5ed57d9f276f24058026912f/html5/thumbnails/20.jpg)
B ottlen eck: C on fin ed S p ace (D istan ce to ob jects, Trackin g failu reb y rap id m ovem en t)
S olu tion s: A d ap tive selection of flam es fromh ig h -sp eed cam era, In teg ration w ith IM U
V isu al S LA M
V isu al Im p rovem en t(o ff-lin e)
[Okatani, Tohoku U]
20
![Page 21: ImPACTTough Robotics Challenge - Cabinet Office...2020/03/19 · • Sensing system is necessary to localize the position Other problems Durability and Operability [July.25-26, 2018]](https://reader034.vdocuments.us/reader034/viewer/2022042309/5ed57d9f276f24058026912f/html5/thumbnails/21.jpg)
P ostu re E stim ation b y IM U an d A cou stic S en sors
D ifficu lty: H ig h acceleratio n b y collision in d eb ris
S olu tion : IM U + M u lti S p eakers + M icrop h on es
S o u n d arrival tim e d ifferen ces E stim ate th e p ostu re
Kalm an filter (U K F) for integrating IM U and acoustic estim ation
Error < 0.2m for the A SC 3m long
[Bando et al., Advanced Robotics, 2015, IROS2016]Advanced Robotics Best Paper Award
[Bando, Kyoto U; Okuno, Waseda U]
21
![Page 22: ImPACTTough Robotics Challenge - Cabinet Office...2020/03/19 · • Sensing system is necessary to localize the position Other problems Durability and Operability [July.25-26, 2018]](https://reader034.vdocuments.us/reader034/viewer/2022042309/5ed57d9f276f24058026912f/html5/thumbnails/22.jpg)
C on tact E stim atio n an d V isio -H ap tic D isp lay
C on tact In form ation for N avig ation• D etection of deadlock by local contacts• Keeping contact area for stable drive • V ibration m otor for excitation
• M achine learning for recognizing the changeof vibration
E stim ation b y D istrib u ted V ib ration S en sors
[Konyo, Tohoku U; Bando, Kyoto U; Okuno, Waseda U]
22
![Page 23: ImPACTTough Robotics Challenge - Cabinet Office...2020/03/19 · • Sensing system is necessary to localize the position Other problems Durability and Operability [July.25-26, 2018]](https://reader034.vdocuments.us/reader034/viewer/2022042309/5ed57d9f276f24058026912f/html5/thumbnails/23.jpg)
Inspection of collapsed house by landslideOkayama, Western Japan Heavy Rain [July.25-26, 2018]
Target: Two-story wooden house collapsed by a landslide due to heavy rain[Konyo, Tadokoro, Tohoku U]
23
![Page 24: ImPACTTough Robotics Challenge - Cabinet Office...2020/03/19 · • Sensing system is necessary to localize the position Other problems Durability and Operability [July.25-26, 2018]](https://reader034.vdocuments.us/reader034/viewer/2022042309/5ed57d9f276f24058026912f/html5/thumbnails/24.jpg)
Passive type air-jet floating ASC was applied
(x2)(x2)Insertion depth: approx. 3 m
• Successfully inserted in 5 m max. through a narrow path• Air-jet floating could surmount rubble with large steps and gaps• Sensing system is necessary to localize the position
Other problems Durability and Operability
[July.25-26, 2018]
Insertion depth: approx. 5 m
[Konyo, Tadokoro, Tohoku U]
Inspection of collapsed house by landslideOkayama, West Japan Heavy Rain
24
![Page 25: ImPACTTough Robotics Challenge - Cabinet Office...2020/03/19 · • Sensing system is necessary to localize the position Other problems Durability and Operability [July.25-26, 2018]](https://reader034.vdocuments.us/reader034/viewer/2022042309/5ed57d9f276f24058026912f/html5/thumbnails/25.jpg)
Fukushima-Daiichi 1st Unit Investigation of the
operating floor (5F) under the dropped roof in order to extract used fuel rods
A cover has been constructed to prevent leakage of radiation.
Balloon in the building has captured image from the hatch.
Pole camera from the cover had limited accessibility.
No solution for heavily crushed area.
25[Konyo, Tadokoro, Tohoku U]25
![Page 26: ImPACTTough Robotics Challenge - Cabinet Office...2020/03/19 · • Sensing system is necessary to localize the position Other problems Durability and Operability [July.25-26, 2018]](https://reader034.vdocuments.us/reader034/viewer/2022042309/5ed57d9f276f24058026912f/html5/thumbnails/26.jpg)
Structural Investigation (Dec 2016 – Feb 2017)
Investigation of roof structure of the op. floor in the 1st Unit under debris Findings:
• Roof iron framework has its original shape.• It can be removed by cutting the structure.
26[Konyo, Tadokoro, Tohoku U]
![Page 27: ImPACTTough Robotics Challenge - Cabinet Office...2020/03/19 · • Sensing system is necessary to localize the position Other problems Durability and Operability [July.25-26, 2018]](https://reader034.vdocuments.us/reader034/viewer/2022042309/5ed57d9f276f24058026912f/html5/thumbnails/27.jpg)
Well Plug of PCV (Dec 2016 – Feb 2017)
Findings• Shift of the lower plate
27
[Konyo, Tadokoro, Tohoku U]
![Page 28: ImPACTTough Robotics Challenge - Cabinet Office...2020/03/19 · • Sensing system is necessary to localize the position Other problems Durability and Operability [July.25-26, 2018]](https://reader034.vdocuments.us/reader034/viewer/2022042309/5ed57d9f276f24058026912f/html5/thumbnails/28.jpg)
Well Plug of PCV (Dec 2016 – Feb 2017)
Findings• Shift of the lower plate
28
[Konyo, Tadokoro, Tohoku U]
![Page 29: ImPACTTough Robotics Challenge - Cabinet Office...2020/03/19 · • Sensing system is necessary to localize the position Other problems Durability and Operability [July.25-26, 2018]](https://reader034.vdocuments.us/reader034/viewer/2022042309/5ed57d9f276f24058026912f/html5/thumbnails/29.jpg)
Dose Rate in Well Plug (Dec 2016 – Feb 2017)
Findings:• The center of well plug has higher dose rate
(C) TEPCO29
[Konyo, Tadokoro, Tohoku U]
![Page 30: ImPACTTough Robotics Challenge - Cabinet Office...2020/03/19 · • Sensing system is necessary to localize the position Other problems Durability and Operability [July.25-26, 2018]](https://reader034.vdocuments.us/reader034/viewer/2022042309/5ed57d9f276f24058026912f/html5/thumbnails/30.jpg)
A ir-Jet A ctive S cop e C am erafor First R esp on d ers
• Portability by using air from air tank of firefighters(6 m in /tank for continuous jet = 20 m in regular operation)
• Lightw eight m eal nozzle by w rought A l-M g alloy better durability• Lightw eight design by lim iting sensors (m icrophone, speaker, IM U )
[Konyo, Tadokoro, Tohoku U]
30