#abbyysummit15 - training (6/6): abbyy future technologies

TechnologySummit 2015

© Copyright 2015 ABBYY Technology Summit

ABBYY FUTURE TECHNOLOGIESAND CONNECTED SCENARIOS

Olga Tolstunova, IHQ & Barbara Gross, NAHQ

#ABBYYSummit15

TechnologySummit 2015

2#ABBYYSummit15

Mobile Real-time Data CaptureReceipts Recognition

Technology Development Maturity

ID CaptureDocument comparisonCloud Data CaptureLabels Recognition…

Text ExtractionStructured data extractionIntelligent capture (Compreno)

Spaceship TravelNuclear fusionA couple of other things

TechnologySummit 2015

REAL-TIME MOBILE DATA CAPTUREA Platform for Technology Partnership

#ABBYYSummit15

TechnologySummit 2015

4#ABBYYSummit15

Real-Time Mobile Capture SDK● Works with viewfinder of smartphone

● In real-time – no snap● On device● With any background● In parallel threads

● Enables to create apps, modules or SDKs for applications like:

● Instant data capture ● Translation● Or simply plain text OCR

TechnologySummit 2015

5#ABBYYSummit15

CapturedVerified Sent to

BackendRecognized Structured

Mobile Technology Cooperation Offer

ABBYY Real-Time Capture(Core Technology)

Partners mobile parsing and backend integration

TechnologySummit 2015

Performance, per frame

Processing Mode 1-2 linesin the center ~1/3 of screen Full frame

Text Detection time 0.1 - 0.2s 0.2 - 0.3s 1 - 2sRecognition time* 0.03 – 0.1s 0.1 – 0.2s 0.5 - 1s

Samsung Galaxy A5, Android 5.0.2, EU Languages, 4 threads, 50 images

TechnologySummit 2015

7Confidential

Quality – the Benefit of Video Stream

Mobile Snap+ High resolution - Only one chance

Video Stream- 1 Frame – low resolution+interactive+ results combination

Recognized frames

TechnologySummit 2015

8

Quality. Frames Combination First Test Results

First Algorithm tests, Windows test platform, 10 images, ABBYY IHQ, October

% of Correct Characters

Number of processed Frames 0 1 2 3 4 5 6 7 8 9 10

70

75

80

85

90

95

100EnglishKoreanJapanese

Maximum quality by snap

TechnologySummit 2015

9Confidential

Augmented Reality Scenarios● Output Data• Recognized Text• Coordinates of initial text

segments.• Average height of initial text and

base lines on source image.• Source text color and background

color

● Motion Correction API● Translation module

available for 18 languages

TechnologySummit 2015

10

Augmented reality Scenario. Stages

1. Receiving a frame from smartphone’s camera, focusing etc.

2. Frame analysis: • Conversion to grayscale.• Detection of text segments.

3. Recognition of detected text segments• In parallel in several processing threads.

4. Translation of recognized text • In parallel in several processing threads.• Detection of text color and background color.

5. Drawing the results on the smartphone’s screen (with motion compensation).

ABBYY RTR SDK

TechnologySummit 2015

RECEIPT CAPTURECapturing Receipt Data on Mobile Devices

#ABBYYSummit15

“You may not be there yet, but you are closer than yesterday.”

TechnologySummit 2015

12#ABBYYSummit15

Receipt Capture Roadmap

Loyalty Management& Rewards Programs

Corporate / Personal Expense Management

1 2

POS Receipts from Retail ChainsRelease Q1 2016

Hotels, Transportation, Online Purchases etc…Release TBD

TechnologySummit 2015

13Confidential

Fields Captured● Vendor● Date● Total ● Tax● Address● Phone ● Currency

● Payment type● Purchase type● Card type● Card number● Line items

TechnologySummit 2015

14#ABBYYSummit15

Loyalty--Pre-Trained Retail VendorsAvailable Today● Walmart● Kroger● Costco● Target● The Home Depot● Walgreen(s)● CVS Caremark● Lowe’s● Safeway● McDonald’s ● Macy’s● Rite Aid

● H-E-B● Dollar General● Whole Foods Market● 7-Eleven● Bed Bath & Beyond● Family Dollar Stores● Ross Stores● Starbucks● Wendy’s● Staples● Trader Joe’s● 99 Cent Only

● Dillons● Dollar Tree Stores● Duane Reade● Food 4 Less● Food Lion● Fred Meyer● GIANT● Grocery Outlet ● Kmart● Lucky● Etc…

TechnologySummit 2015

15#ABBYYSummit15

Corporate Expense ManagementExamples of Receipt Types for Corporate Expense Management:

● 1. Tape receipt from a store (we have quite a few, can always use more!)● 2. Tape receipt from a gas station● 3. Tape receipt from a restaurant● 4. Parking ticket● 5. Public transportation ticket● 6. Taxi ticket● 7. Hotel invoice● 8. Car renting invoice● 9. Online booking service invoice

TechnologySummit 2015

Receipt CaptureProduct Offerings

Reasons for choosing:● Mobile Imaging SDKs for iOS & Android on Front End

● Optimize for best image on Mobile Device before recognition using:– Detectors, Image Enhancement & Compression

● FineReader Engine for Windows● Developer has more control their environment ● Currently, most enhancements to Beta Receipt Module

● Cloud OCR SDK● Developer does not have to do as much development work on their part to get up &

running quickly● If a Linux House

16

TechnologySummit 2015

17#ABBYYSummit15

Receipt Demonstration

TechnologySummit 2015

18#ABBYYSummit15

Pass the Baton…

● Try NOW new technologies● Create or renew your solutions● Explore new scenarios● Win new business● Visit www.abbyy.technology

NOW ITS YOUR TURN!

TechnologySummit 2015

19#ABBYYSummit15

QUESTIONS