#abbyysummit15 - training (6/6): abbyy future technologies

TechnologySummit 2015

© Copyright 2015 ABBYY Technology Summit

ABBYY FUTURE TECHNOLOGIESAND CONNECTED SCENARIOS

Olga Tolstunova, IHQ & Barbara Gross, NAHQ

#ABBYYSummit15


2#ABBYYSummit15

Mobile Real-time Data CaptureReceipts Recognition

Technology Development Maturity

ID CaptureDocument comparisonCloud Data CaptureLabels Recognition…

Text ExtractionStructured data extractionIntelligent capture (Compreno)

Spaceship TravelNuclear fusionA couple of other things


REAL-TIME MOBILE DATA CAPTUREA Platform for Technology Partnership

#ABBYYSummit15


4#ABBYYSummit15

Real-Time Mobile Capture SDK● Works with viewfinder of smartphone

● In real-time – no snap● On device● With any background● In parallel threads

● Enables to create apps, modules or SDKs for applications like:

● Instant data capture ● Translation● Or simply plain text OCR


5#ABBYYSummit15

CapturedVerified Sent to

BackendRecognized Structured

Mobile Technology Cooperation Offer

ABBYY Real-Time Capture(Core Technology)

Partners mobile parsing and backend integration


Performance, per frame

Processing Mode 1-2 linesin the center ~1/3 of screen Full frame

Text Detection time 0.1 - 0.2s 0.2 - 0.3s 1 - 2sRecognition time* 0.03 – 0.1s 0.1 – 0.2s 0.5 - 1s

Samsung Galaxy A5, Android 5.0.2, EU Languages, 4 threads, 50 images


7Confidential

Quality – the Benefit of Video Stream

Mobile Snap+ High resolution - Only one chance

Video Stream- 1 Frame – low resolution+interactive+ results combination

Recognized frames


8

Quality. Frames Combination First Test Results

First Algorithm tests, Windows test platform, 10 images, ABBYY IHQ, October

% of Correct Characters

Number of processed Frames 0 1 2 3 4 5 6 7 8 9 10

70

75

80

85

90

95

100EnglishKoreanJapanese

Maximum quality by snap


9Confidential

Augmented Reality Scenarios● Output Data• Recognized Text• Coordinates of initial text

segments.• Average height of initial text and

base lines on source image.• Source text color and background

color

● Motion Correction API● Translation module

available for 18 languages


10

Augmented reality Scenario. Stages

1. Receiving a frame from smartphone’s camera, focusing etc.

2. Frame analysis: • Conversion to grayscale.• Detection of text segments.

3. Recognition of detected text segments• In parallel in several processing threads.

4. Translation of recognized text • In parallel in several processing threads.• Detection of text color and background color.

5. Drawing the results on the smartphone’s screen (with motion compensation).

ABBYY RTR SDK


RECEIPT CAPTURECapturing Receipt Data on Mobile Devices

#ABBYYSummit15

“You may not be there yet, but you are closer than yesterday.”


12#ABBYYSummit15

Receipt Capture Roadmap

Loyalty Management& Rewards Programs

Corporate / Personal Expense Management

1 2

POS Receipts from Retail ChainsRelease Q1 2016

Hotels, Transportation, Online Purchases etc…Release TBD


13Confidential

Fields Captured● Vendor● Date● Total ● Tax● Address● Phone ● Currency

● Payment type● Purchase type● Card type● Card number● Line items


14#ABBYYSummit15

Loyalty--Pre-Trained Retail VendorsAvailable Today● Walmart● Kroger● Costco● Target● The Home Depot● Walgreen(s)● CVS Caremark● Lowe’s● Safeway● McDonald’s ● Macy’s● Rite Aid

● H-E-B● Dollar General● Whole Foods Market● 7-Eleven● Bed Bath & Beyond● Family Dollar Stores● Ross Stores● Starbucks● Wendy’s● Staples● Trader Joe’s● 99 Cent Only

● Dillons● Dollar Tree Stores● Duane Reade● Food 4 Less● Food Lion● Fred Meyer● GIANT● Grocery Outlet ● Kmart● Lucky● Etc…


15#ABBYYSummit15

Corporate Expense ManagementExamples of Receipt Types for Corporate Expense Management:

● 1. Tape receipt from a store (we have quite a few, can always use more!)● 2. Tape receipt from a gas station● 3. Tape receipt from a restaurant● 4. Parking ticket● 5. Public transportation ticket● 6. Taxi ticket● 7. Hotel invoice● 8. Car renting invoice● 9. Online booking service invoice


Receipt CaptureProduct Offerings

Reasons for choosing:● Mobile Imaging SDKs for iOS & Android on Front End

● Optimize for best image on Mobile Device before recognition using:– Detectors, Image Enhancement & Compression

● FineReader Engine for Windows● Developer has more control their environment ● Currently, most enhancements to Beta Receipt Module

● Cloud OCR SDK● Developer does not have to do as much development work on their part to get up &

running quickly● If a Linux House

16


17#ABBYYSummit15

Receipt Demonstration


18#ABBYYSummit15

Pass the Baton…

● Try NOW new technologies● Create or renew your solutions● Explore new scenarios● Win new business● Visit www.abbyy.technology

NOW ITS YOUR TURN!

http://www.abbyy.technology/


19#ABBYYSummit15

QUESTIONS

#abbyysummit15 - training (6/6): abbyy future technologies

Software