roadbot - rpug toom.pdf · roadbot development goals achieve benchmark performance compliant with...
TRANSCRIPT
![Page 1: Roadbot - RPUG Toom.pdf · Roadbot Development Goals Achieve Benchmark performance compliant with draft ASTM E-950-15 0.97 CC repeatability in IRI, medium, long wavebands Cover the](https://reader036.vdocuments.us/reader036/viewer/2022071511/61313e331ecc515869449cc6/html5/thumbnails/1.jpg)
1
Roadbot
Paul Toom P. Eng. MBAICC, Cherry Systems
Glenn HenninLMI3D
Presented atRPUG 2015
2-5 November 2015Raleigh NC
Dual Line Laser Benchmark Road Profiler
![Page 2: Roadbot - RPUG Toom.pdf · Roadbot Development Goals Achieve Benchmark performance compliant with draft ASTM E-950-15 0.97 CC repeatability in IRI, medium, long wavebands Cover the](https://reader036.vdocuments.us/reader036/viewer/2022071511/61313e331ecc515869449cc6/html5/thumbnails/2.jpg)
Presentation Overview
Introduction of new Roadbot robotic profiler Development Goals Technology Features Designing & Building Roadbot
Performance capabilities Self-guided computer vision steering Initial results What we learned at MnRoad 2015 Next steps Computer vision steering demo
2
![Page 3: Roadbot - RPUG Toom.pdf · Roadbot Development Goals Achieve Benchmark performance compliant with draft ASTM E-950-15 0.97 CC repeatability in IRI, medium, long wavebands Cover the](https://reader036.vdocuments.us/reader036/viewer/2022071511/61313e331ecc515869449cc6/html5/thumbnails/3.jpg)
Roadbot Development Goals
Achieve Benchmark performance compliant with draft ASTM E-950-15 0.97 CC repeatability in IRI, medium, long wavebands
Cover the short waveband True unfiltered profiles (accurate end elevations) Autonomous, self-guided computer vision steering Super smooth pavement capable Easy to configure and operate Obtain Benchmark results independent of
operator’s skill & training3
![Page 4: Roadbot - RPUG Toom.pdf · Roadbot Development Goals Achieve Benchmark performance compliant with draft ASTM E-950-15 0.97 CC repeatability in IRI, medium, long wavebands Cover the](https://reader036.vdocuments.us/reader036/viewer/2022071511/61313e331ecc515869449cc6/html5/thumbnails/4.jpg)
Benefits & Advantages
Benchmark class accuracy first time, every time No confusion re different results from different operators
Save operating costs 1 accurate run is better than 10 bad runs averaged
Safe, fast and easy Performs multiple runs without user intervention Operator supervises at a safe distance from traffic No operator fatigue
Programmable, autonomously follows paths Roads, floors or any other surface
4
![Page 5: Roadbot - RPUG Toom.pdf · Roadbot Development Goals Achieve Benchmark performance compliant with draft ASTM E-950-15 0.97 CC repeatability in IRI, medium, long wavebands Cover the](https://reader036.vdocuments.us/reader036/viewer/2022071511/61313e331ecc515869449cc6/html5/thumbnails/5.jpg)
Roadbot Technology Features
5
All new, Engineered from the ground upDual line lasers rotated 45° for texture rejectionMulti-axis inclinometer referenceAutonomous, self-guided, computer vision steering
Servomotor actuated with PID feedback controlCollision avoidance“Tilter” laser and inclinometer levelling system
Servomotor actuated with PID feedback controlPrecision motor driveStationary ‘U’-turn capability
![Page 6: Roadbot - RPUG Toom.pdf · Roadbot Development Goals Achieve Benchmark performance compliant with draft ASTM E-950-15 0.97 CC repeatability in IRI, medium, long wavebands Cover the](https://reader036.vdocuments.us/reader036/viewer/2022071511/61313e331ecc515869449cc6/html5/thumbnails/6.jpg)
Designing & Building Roadbot
6
Assembled frame withWindow for lasers
Fixed 3” wideRear wheel
Servo-controlled360° steerable 3” wide front wheel
![Page 7: Roadbot - RPUG Toom.pdf · Roadbot Development Goals Achieve Benchmark performance compliant with draft ASTM E-950-15 0.97 CC repeatability in IRI, medium, long wavebands Cover the](https://reader036.vdocuments.us/reader036/viewer/2022071511/61313e331ecc515869449cc6/html5/thumbnails/7.jpg)
Designing & Building Roadbot
7
Multi-axisinclinometer
Accelerometer
2 x Gocator2342 lasers
Servo-controlledTilt controller
Laser mounting plate
![Page 8: Roadbot - RPUG Toom.pdf · Roadbot Development Goals Achieve Benchmark performance compliant with draft ASTM E-950-15 0.97 CC repeatability in IRI, medium, long wavebands Cover the](https://reader036.vdocuments.us/reader036/viewer/2022071511/61313e331ecc515869449cc6/html5/thumbnails/8.jpg)
Designing & Building Roadbot
8
Assembledinstrument “Tilter”
Tilter eliminates errors caused by road camber resulting from:1. Laser roll axis rotation2. Inclinometer roll axis rotation
cross-axis error of longitudinal inclinometer
IMPORTANT:Wheels and lasers are collinear
CompletedRoadbot kernel
![Page 9: Roadbot - RPUG Toom.pdf · Roadbot Development Goals Achieve Benchmark performance compliant with draft ASTM E-950-15 0.97 CC repeatability in IRI, medium, long wavebands Cover the](https://reader036.vdocuments.us/reader036/viewer/2022071511/61313e331ecc515869449cc6/html5/thumbnails/9.jpg)
Designing & Building Roadbot
9
Pivot axis
Outrigger:1. Keeps frame
vertical2. Connects drive
without rotating frame
Encoder DMI
Precision motor drive &suspension
![Page 10: Roadbot - RPUG Toom.pdf · Roadbot Development Goals Achieve Benchmark performance compliant with draft ASTM E-950-15 0.97 CC repeatability in IRI, medium, long wavebands Cover the](https://reader036.vdocuments.us/reader036/viewer/2022071511/61313e331ecc515869449cc6/html5/thumbnails/10.jpg)
Designing & Building Roadbot
10
Completedinternalassembly
Resiliently-mountedelectronics. 2.3GHz quad core single board computer, A-DAS data acquisition and robotics
Resiliently-mountedbatteries in boxes
![Page 11: Roadbot - RPUG Toom.pdf · Roadbot Development Goals Achieve Benchmark performance compliant with draft ASTM E-950-15 0.97 CC repeatability in IRI, medium, long wavebands Cover the](https://reader036.vdocuments.us/reader036/viewer/2022071511/61313e331ecc515869449cc6/html5/thumbnails/11.jpg)
Designing & Building Roadbot
11
Bumper/handle
Flashing amber lights
![Page 12: Roadbot - RPUG Toom.pdf · Roadbot Development Goals Achieve Benchmark performance compliant with draft ASTM E-950-15 0.97 CC repeatability in IRI, medium, long wavebands Cover the](https://reader036.vdocuments.us/reader036/viewer/2022071511/61313e331ecc515869449cc6/html5/thumbnails/12.jpg)
Designing & Building Roadbot
12
Computer Vision Dual cameras
Ultrasonic rangesensors for collision
avoidance
Adjustableslidingmount
Roadbotcomplete
Sunlight-readableLCD display/HMI
![Page 13: Roadbot - RPUG Toom.pdf · Roadbot Development Goals Achieve Benchmark performance compliant with draft ASTM E-950-15 0.97 CC repeatability in IRI, medium, long wavebands Cover the](https://reader036.vdocuments.us/reader036/viewer/2022071511/61313e331ecc515869449cc6/html5/thumbnails/13.jpg)
Precision Profiling MethodsRolling Profilers vs Physics
Conventional rod & level, optical level reference Auto rod & level, spinning laser level reference Rolling auto rod & level, spinning laser level
reference (BMP) Rolling inclinometer, gravity reference (SurPRO) Rolling inclinometer with dual laser slope for
short waveband, gravity reference (Roadbot) Rolling single laser, inertial reference (inertial
profiler, long wavelengths filtered out)
13
![Page 14: Roadbot - RPUG Toom.pdf · Roadbot Development Goals Achieve Benchmark performance compliant with draft ASTM E-950-15 0.97 CC repeatability in IRI, medium, long wavebands Cover the](https://reader036.vdocuments.us/reader036/viewer/2022071511/61313e331ecc515869449cc6/html5/thumbnails/14.jpg)
Gocator 2342 Line Lasers
14
Roadbot uses two line lasers with bridging
Laser Line
Wheel
RoadbotEnd View(alonglongitudinalaxis)
Axle
3” (76mm)
3” (76mm)
3” (76mm)
45°
IMPORTANT:Wheels and lasers are collinear
TriggeredEvery ∆D or4 mm of DMI
Gocator 2342rotated 45°
![Page 15: Roadbot - RPUG Toom.pdf · Roadbot Development Goals Achieve Benchmark performance compliant with draft ASTM E-950-15 0.97 CC repeatability in IRI, medium, long wavebands Cover the](https://reader036.vdocuments.us/reader036/viewer/2022071511/61313e331ecc515869449cc6/html5/thumbnails/15.jpg)
Gocator 2342 Line Lasers
15
190mm
210mm
64mm
140mm
129mm
Both lasers are triggered every ∆D or 4mm of DMI Measurements from the lasers give local slope angle βData acquired via both:
Serial for single bridged point Ethernet LAN for allpoints on line
ActualClearanceDistance
Gocator 2342rotated 45°
![Page 16: Roadbot - RPUG Toom.pdf · Roadbot Development Goals Achieve Benchmark performance compliant with draft ASTM E-950-15 0.97 CC repeatability in IRI, medium, long wavebands Cover the](https://reader036.vdocuments.us/reader036/viewer/2022071511/61313e331ecc515869449cc6/html5/thumbnails/16.jpg)
Dual Line Laser Profiler Method
16Apparatus & Method are Patent Pending
Incremental changes in elevation are computed from distance encoder (∆D), dual line lasers (β) and inclinometer (α)
![Page 17: Roadbot - RPUG Toom.pdf · Roadbot Development Goals Achieve Benchmark performance compliant with draft ASTM E-950-15 0.97 CC repeatability in IRI, medium, long wavebands Cover the](https://reader036.vdocuments.us/reader036/viewer/2022071511/61313e331ecc515869449cc6/html5/thumbnails/17.jpg)
Nulls
17
Nulls where λΝ=W/n, n=1,2,3…∞
Nulls are wavelengths λN of sine wave profile input where inclinometer profiler output is zero because profiler frame always has zero tilt.
![Page 18: Roadbot - RPUG Toom.pdf · Roadbot Development Goals Achieve Benchmark performance compliant with draft ASTM E-950-15 0.97 CC repeatability in IRI, medium, long wavebands Cover the](https://reader036.vdocuments.us/reader036/viewer/2022071511/61313e331ecc515869449cc6/html5/thumbnails/18.jpg)
0.01
0.1
1
0.01 0.1 1 10
Elev
atio
n Ga
in H
(λ)
Wavelength λ (m)
SurPRO
0.01
0.1
1
0.01 0.1 1 10
Elev
atio
n Ga
in H
(λ)
Wavelength λ (m)
SurPRO
Roadbot
Wavelength Response
18First Null atL=76mm
First Null atW=250mm
H(λ)=1.0 for large λ
Short Waveband (0.075-1.6m)
Roll-off due togeometry with Laser Spacing L in Roadbot and Tire Bridging Filter in BMP
Roll-off due to geometry with 0.25m wheel spacing (W)Rolling profiler
![Page 19: Roadbot - RPUG Toom.pdf · Roadbot Development Goals Achieve Benchmark performance compliant with draft ASTM E-950-15 0.97 CC repeatability in IRI, medium, long wavebands Cover the](https://reader036.vdocuments.us/reader036/viewer/2022071511/61313e331ecc515869449cc6/html5/thumbnails/19.jpg)
-0.4
-0.2
0
0.2
0.4
0.6
0.8
1
1.2
1.4
0.5 1 1.5 2 2.5 3 3.5 4 4.5 5 5.5 6 6.5 7 7.5 8 8.5 9 9.5
Elev
atio
n Ga
in
Wavelength (m)
Relative Contibutions of Inclinometer and 2 Lasers(W = 1.0 m, L = 0.076 m)
2 Lasers Only
Inclinometer Only
2 Lasers + Incl(Roadbot)
Hybrid ProfilerContributions of Inclinometer & Lasers
19
Inclinometer & wheels alone supply long wavelengths, made possible by making lasers and wheels collinear. Improves long wavelength CC.
10 m
Laser signals are high pass filtered to remove wavelengths longer than 10 m.
![Page 20: Roadbot - RPUG Toom.pdf · Roadbot Development Goals Achieve Benchmark performance compliant with draft ASTM E-950-15 0.97 CC repeatability in IRI, medium, long wavebands Cover the](https://reader036.vdocuments.us/reader036/viewer/2022071511/61313e331ecc515869449cc6/html5/thumbnails/20.jpg)
RoadbotShort Wavelength Extension
20
SurPRO 4000 (orange)
Roadbot (blue)0.076 m/cycle
0.25 m/cycle
Additional Spectral Content
SurPRO extends to 250 mm sufficient for IRI, medium and long wavebandsRoadbot extends to 76 mm to add short waveband response
Roadbot uses a 0.050 m Butterworth LP filter to remove noise.
![Page 21: Roadbot - RPUG Toom.pdf · Roadbot Development Goals Achieve Benchmark performance compliant with draft ASTM E-950-15 0.97 CC repeatability in IRI, medium, long wavebands Cover the](https://reader036.vdocuments.us/reader036/viewer/2022071511/61313e331ecc515869449cc6/html5/thumbnails/21.jpg)
Optical Target SensorHigh Accuracy DMI Target Layout
21
New DMI cal value calculated here and applied to previous 100 feet
New DMI cal value calculated here and applied to previous 100 feet
Average of all previous DMI values applied to final distance
This Optical Target set only required if doing return run
AutomaticStart Line detection
DMI cal value from calibration used as default
AutomaticEnd Line detection
![Page 22: Roadbot - RPUG Toom.pdf · Roadbot Development Goals Achieve Benchmark performance compliant with draft ASTM E-950-15 0.97 CC repeatability in IRI, medium, long wavebands Cover the](https://reader036.vdocuments.us/reader036/viewer/2022071511/61313e331ecc515869449cc6/html5/thumbnails/22.jpg)
Computer Vision Steering
22
How to train the color detection system
2. Better method: Fill green square with the color to be trained
1. Use mouse to pick a single pixel of desired color, or...
+
3. Roadbot analyzes 10,000 pixels in green square and automatically sets HSV color detection parametersAll images were
produced by Roadbot’s two cameras
![Page 23: Roadbot - RPUG Toom.pdf · Roadbot Development Goals Achieve Benchmark performance compliant with draft ASTM E-950-15 0.97 CC repeatability in IRI, medium, long wavebands Cover the](https://reader036.vdocuments.us/reader036/viewer/2022071511/61313e331ecc515869449cc6/html5/thumbnails/23.jpg)
Computer Vision Steering
23
Computer vision line detection and lock on target
1. Stretch out red guidance string at desired offset and tape it down.
Tape won’t affect detection.
2. Trained computer vision detects only one color of string
3. Computer vision locks on string target and draws green line on top of detected string.In Lock, white lines track target line and everything outside white lines is ignored.
All images were produced by Roadbot’s two cameras
![Page 24: Roadbot - RPUG Toom.pdf · Roadbot Development Goals Achieve Benchmark performance compliant with draft ASTM E-950-15 0.97 CC repeatability in IRI, medium, long wavebands Cover the](https://reader036.vdocuments.us/reader036/viewer/2022071511/61313e331ecc515869449cc6/html5/thumbnails/24.jpg)
Computer Vision Steering
24
Outside blue lines “Steering Error!” is declared and if not corrected Roadbot shuts down.
Steering Error declared since detected line is left of blue max allowed steering error line. Center blue line is “zero error”
target for steering system
Steering Error declared since detected line is right of blue max allowed steering error line.
Computer PID feedback control keeps Roadbot on center blue line
All images were produced by Roadbot’s two cameras
![Page 25: Roadbot - RPUG Toom.pdf · Roadbot Development Goals Achieve Benchmark performance compliant with draft ASTM E-950-15 0.97 CC repeatability in IRI, medium, long wavebands Cover the](https://reader036.vdocuments.us/reader036/viewer/2022071511/61313e331ecc515869449cc6/html5/thumbnails/25.jpg)
Additional Guidance Options
Rope, chalk, paint, metal tape line Radio source beacon direction finding Light source beacon direction finding Fog line guidance (constant offset) Programmed path and Gyro referenced
guidance GPS
25
![Page 26: Roadbot - RPUG Toom.pdf · Roadbot Development Goals Achieve Benchmark performance compliant with draft ASTM E-950-15 0.97 CC repeatability in IRI, medium, long wavebands Cover the](https://reader036.vdocuments.us/reader036/viewer/2022071511/61313e331ecc515869449cc6/html5/thumbnails/26.jpg)
Roadbot at MnRoad 2015
26
![Page 27: Roadbot - RPUG Toom.pdf · Roadbot Development Goals Achieve Benchmark performance compliant with draft ASTM E-950-15 0.97 CC repeatability in IRI, medium, long wavebands Cover the](https://reader036.vdocuments.us/reader036/viewer/2022071511/61313e331ecc515869449cc6/html5/thumbnails/27.jpg)
MnRoad 2015Transverse Tined Concrete
27
![Page 28: Roadbot - RPUG Toom.pdf · Roadbot Development Goals Achieve Benchmark performance compliant with draft ASTM E-950-15 0.97 CC repeatability in IRI, medium, long wavebands Cover the](https://reader036.vdocuments.us/reader036/viewer/2022071511/61313e331ecc515869449cc6/html5/thumbnails/28.jpg)
MnRoad 2015Transverse Tined Concrete
28
![Page 29: Roadbot - RPUG Toom.pdf · Roadbot Development Goals Achieve Benchmark performance compliant with draft ASTM E-950-15 0.97 CC repeatability in IRI, medium, long wavebands Cover the](https://reader036.vdocuments.us/reader036/viewer/2022071511/61313e331ecc515869449cc6/html5/thumbnails/29.jpg)
MnRoad 2015Long Asphalt
29
![Page 30: Roadbot - RPUG Toom.pdf · Roadbot Development Goals Achieve Benchmark performance compliant with draft ASTM E-950-15 0.97 CC repeatability in IRI, medium, long wavebands Cover the](https://reader036.vdocuments.us/reader036/viewer/2022071511/61313e331ecc515869449cc6/html5/thumbnails/30.jpg)
MnRoad 2015Long Asphalt
30
![Page 31: Roadbot - RPUG Toom.pdf · Roadbot Development Goals Achieve Benchmark performance compliant with draft ASTM E-950-15 0.97 CC repeatability in IRI, medium, long wavebands Cover the](https://reader036.vdocuments.us/reader036/viewer/2022071511/61313e331ecc515869449cc6/html5/thumbnails/31.jpg)
Roadbot DevelopmentWhat we learned at MnRoad
We’re still fine tuning and improving performanceTuned out PID steering instability “S curves”Best performance on transverse tined concrete and long asphalt with CC repeatability of ~0.99Computer vision color training improvements
Completed and in this presentationUse LED flood fill lights to fill shadows or night useLoose aggregate drive wheel slip on chip sealGocator 2342 worked well; no issuesGenerally very promising results
31
![Page 32: Roadbot - RPUG Toom.pdf · Roadbot Development Goals Achieve Benchmark performance compliant with draft ASTM E-950-15 0.97 CC repeatability in IRI, medium, long wavebands Cover the](https://reader036.vdocuments.us/reader036/viewer/2022071511/61313e331ecc515869449cc6/html5/thumbnails/32.jpg)
Roadbot DevelopmentNext Steps
Complete user interface (HMI)More field testing, goal of CC in high 0.99’s
Co-operation/demonstrations/evaluations with State DOTs and Research OrganizationsCompliance with ASTM E-950-15 draft
Benchmark compliance in all wavebandsShort waveband, included but not required76mm wide footprint, included but not requiredHigh accuracy optical target DMI needed to support short waveband, included but not required
Continuous improvement32
![Page 33: Roadbot - RPUG Toom.pdf · Roadbot Development Goals Achieve Benchmark performance compliant with draft ASTM E-950-15 0.97 CC repeatability in IRI, medium, long wavebands Cover the](https://reader036.vdocuments.us/reader036/viewer/2022071511/61313e331ecc515869449cc6/html5/thumbnails/33.jpg)
Benchmark Profiler Challenge
Host an open Benchmark class rodeo with the goal of finding the best “Ground Truth” deviceIndependent expert Test Manager performs all testing and analyzes data to eliminate biasProponents train Test Manager to operate devicesTest Manager operates devices, manages dataEach run must be completed from start to end before set up and collect any data for next runAnalyze IRI, medium, long & short waveband for repeatability CC & accuracy CC with other devicesTest Manager prepares independent report
33
![Page 34: Roadbot - RPUG Toom.pdf · Roadbot Development Goals Achieve Benchmark performance compliant with draft ASTM E-950-15 0.97 CC repeatability in IRI, medium, long wavebands Cover the](https://reader036.vdocuments.us/reader036/viewer/2022071511/61313e331ecc515869449cc6/html5/thumbnails/34.jpg)
Thanks!To:
Rohan Perera, SMESteve Karamihas, UMTRIDarel Mesher, Tetra Tech
EBAJames Richitt, ICCAdam Kennedy, ICCLeanne Goethe, ICC
For more information please go to: surpro.com intlcybernetics.com
34