![Page 1: Using Joomla, Zoo & SOLR to power Asia's Largest Auction House](https://reader031.vdocuments.us/reader031/viewer/2022020306/54c850b54a7959f4758b4593/html5/thumbnails/1.jpg)
SOLR + Joomla powering the catalog of Asia's Largest Auction House
![Page 2: Using Joomla, Zoo & SOLR to power Asia's Largest Auction House](https://reader031.vdocuments.us/reader031/viewer/2022020306/54c850b54a7959f4758b4593/html5/thumbnails/2.jpg)
Parth LawateStrategic Marketing Manager Joomla
CEO, Techjoomla, Tekdi Web Solutions
@parthlawate, @techjoomla
www.techjoomla.com
Cook
Bookworm Gardener
JUG Pune
Joomla Freak
Trekking
EntrepreneurJoomla Day India
Open Source
Software ArchitechtMarketing
Content Strategy
Hiking
![Page 3: Using Joomla, Zoo & SOLR to power Asia's Largest Auction House](https://reader031.vdocuments.us/reader031/viewer/2022020306/54c850b54a7959f4758b4593/html5/thumbnails/3.jpg)
Tekdi Technologies Pvt. Ltd.@tekdinet
tekdi.net
IOS Apps
CRM
Magento
E Learning Ecommerce
Joomla
Custom Apps
Android
CMS
HTML5
Social Networks
![Page 4: Using Joomla, Zoo & SOLR to power Asia's Largest Auction House](https://reader031.vdocuments.us/reader031/viewer/2022020306/54c850b54a7959f4758b4593/html5/thumbnails/4.jpg)
Techjoomla. For All things Joomla @techjoomla
techjoomla.com
jGive
People Suggest
jomLikeJTicketing
J!Bolo
Broadcast
Invitex
Email Beautifier
SocialAds
J!MailAlerts
REST APIPayments API
Social API
Quick2Cart
![Page 5: Using Joomla, Zoo & SOLR to power Asia's Largest Auction House](https://reader031.vdocuments.us/reader031/viewer/2022020306/54c850b54a7959f4758b4593/html5/thumbnails/5.jpg)
Quick Facts
● The client is a major Art &
Auction house in India & is
one of the largest in Asia.
● Data collation over a
period of 20+ years
● Over 500,000 records with
complex interrelations.
![Page 6: Using Joomla, Zoo & SOLR to power Asia's Largest Auction House](https://reader031.vdocuments.us/reader031/viewer/2022020306/54c850b54a7959f4758b4593/html5/thumbnails/6.jpg)
Quick Facts
● Complex data structure
with 100+ parameters
/fields on each data type
● Graphics Heavy – All
artifacts have High
resolution images
![Page 7: Using Joomla, Zoo & SOLR to power Asia's Largest Auction House](https://reader031.vdocuments.us/reader031/viewer/2022020306/54c850b54a7959f4758b4593/html5/thumbnails/7.jpg)
The Technical Challenge
● Over 100,000 records in
the first phase of migration
● Extremely complex data
relations
● Complex Data types &
Record parameter volume
& complexity
![Page 8: Using Joomla, Zoo & SOLR to power Asia's Largest Auction House](https://reader031.vdocuments.us/reader031/viewer/2022020306/54c850b54a7959f4758b4593/html5/thumbnails/8.jpg)
The Human Challnge
● Use of MS Excel for years to manage
their knowledge base before we
came on board
● Working with the client's research &
archivist team who had almost no
knowledge of any kind of web
technologies
● Getting the team of traditional
archivists to adopt a modern system.
![Page 9: Using Joomla, Zoo & SOLR to power Asia's Largest Auction House](https://reader031.vdocuments.us/reader031/viewer/2022020306/54c850b54a7959f4758b4593/html5/thumbnails/9.jpg)
The Solution
● The data complexity &
relations called for using a
CCK
● We Chose Zoo to serve as a
base for all the
customisations to come
● Custom apps based on this
architechture.
![Page 10: Using Joomla, Zoo & SOLR to power Asia's Largest Auction House](https://reader031.vdocuments.us/reader031/viewer/2022020306/54c850b54a7959f4758b4593/html5/thumbnails/10.jpg)
Term Glossary
● Classification – First level cartegorisation eg. ANTQ
● Sub Classification – arm
● Artifact – Actual Record
● Masterlists – Records that can be used as Associated
records or as a link between 2 or more records
![Page 11: Using Joomla, Zoo & SOLR to power Asia's Largest Auction House](https://reader031.vdocuments.us/reader031/viewer/2022020306/54c850b54a7959f4758b4593/html5/thumbnails/11.jpg)
Starting Small
● 9 Classifications
● 50 + Subsclassifications
● 50,000 Artifacts
![Page 12: Using Joomla, Zoo & SOLR to power Asia's Largest Auction House](https://reader031.vdocuments.us/reader031/viewer/2022020306/54c850b54a7959f4758b4593/html5/thumbnails/12.jpg)
The Work with Zoo
● Custom field types
● Custom association
plugins in order to create
records from relations
● Custom views
![Page 13: Using Joomla, Zoo & SOLR to power Asia's Largest Auction House](https://reader031.vdocuments.us/reader031/viewer/2022020306/54c850b54a7959f4758b4593/html5/thumbnails/13.jpg)
The Early Search
● Custom extension for
parametric search
● One table per classificaton
● CRON based indexer
● MySQL powered with Natural
language support
● Using MySQL soundex for
'did you mean' feature
![Page 14: Using Joomla, Zoo & SOLR to power Asia's Largest Auction House](https://reader031.vdocuments.us/reader031/viewer/2022020306/54c850b54a7959f4758b4593/html5/thumbnails/14.jpg)
We Want Excel !
● Though we got the archivists to use web forms.. they still missed
the ease of excel
● So we gave it to them ! With Hanson table based Mass Edit view
for Zoo.
![Page 15: Using Joomla, Zoo & SOLR to power Asia's Largest Auction House](https://reader031.vdocuments.us/reader031/viewer/2022020306/54c850b54a7959f4758b4593/html5/thumbnails/15.jpg)
Bulk Processing's gotta be there !
● Bulk Edit
● Bulk Delete
● Bulk Add
● Custom Importing Tools
with volume processing &
automapping
![Page 16: Using Joomla, Zoo & SOLR to power Asia's Largest Auction House](https://reader031.vdocuments.us/reader031/viewer/2022020306/54c850b54a7959f4758b4593/html5/thumbnails/16.jpg)
The Data today
● 12 Classifications
● 100 + sub classifications
● 8 Masterlists
● 200,000 artifacts
The Baby's growing up !
![Page 17: Using Joomla, Zoo & SOLR to power Asia's Largest Auction House](https://reader031.vdocuments.us/reader031/viewer/2022020306/54c850b54a7959f4758b4593/html5/thumbnails/17.jpg)
More Data called for an architechture upgrade
![Page 18: Using Joomla, Zoo & SOLR to power Asia's Largest Auction House](https://reader031.vdocuments.us/reader031/viewer/2022020306/54c850b54a7959f4758b4593/html5/thumbnails/18.jpg)
Need for a better search
● 200,000 Records
● Zoo Data structure isnt
optimised for search
● MYSQL based indexer would
hit limits down the line.
Unions across 9 tables (which
could increase) would make
it slower
![Page 19: Using Joomla, Zoo & SOLR to power Asia's Largest Auction House](https://reader031.vdocuments.us/reader031/viewer/2022020306/54c850b54a7959f4758b4593/html5/thumbnails/19.jpg)
Need for a better search...
● Single & 2 letter
autosuggest not supported
by Mysql (3 char min limit
for LIKE)
● Normal search was not as
fast as expected (Brought
down load time for ~0.8secs
to 0.3 secs)
![Page 20: Using Joomla, Zoo & SOLR to power Asia's Largest Auction House](https://reader031.vdocuments.us/reader031/viewer/2022020306/54c850b54a7959f4758b4593/html5/thumbnails/20.jpg)
Getting the data ready for SOLR
● MYSQL Indexer from
earlier phase modified to
create a Data normaliser
to push data to SOLR
● CLI script that reads
records to populate
SOLR index
● Using the PHP-SOLR
library
![Page 21: Using Joomla, Zoo & SOLR to power Asia's Largest Auction House](https://reader031.vdocuments.us/reader031/viewer/2022020306/54c850b54a7959f4758b4593/html5/thumbnails/21.jpg)
Osianama.com
PHP-SOLR Library
Browser
SOLR
Main Index
SuggestionsIndex
planned
Getting SOLR into the picture
● Custom Search replaced
by SOLR
● SOLR hosted on Separate
Amozon instance
● Initial Implementation
was only for search
![Page 22: Using Joomla, Zoo & SOLR to power Asia's Largest Auction House](https://reader031.vdocuments.us/reader031/viewer/2022020306/54c850b54a7959f4758b4593/html5/thumbnails/22.jpg)
Benefits
● Much better natural
language search,
● Better relevance scoring
● Full reindex everyday
● Even browsing is now
SOLR powered which
means MORE SPEED !
● Record counts per category
& sub-category easily
achieved using faceting
● Now using SOLR's suggester
module
● Using separate 'cores' for
main index and suggest
terms index
![Page 23: Using Joomla, Zoo & SOLR to power Asia's Largest Auction House](https://reader031.vdocuments.us/reader031/viewer/2022020306/54c850b54a7959f4758b4593/html5/thumbnails/23.jpg)
Whats coming ?
● Autosuggest directly works off
SOLR (currently piped through
PHP)
● Implement delta indexing,
currently not implemented due
to multitude of relational data.
● Change in a bottom level record
needs to flow through to all
associations
![Page 24: Using Joomla, Zoo & SOLR to power Asia's Largest Auction House](https://reader031.vdocuments.us/reader031/viewer/2022020306/54c850b54a7959f4758b4593/html5/thumbnails/24.jpg)
What else is so
awesome about
this ?
![Page 25: Using Joomla, Zoo & SOLR to power Asia's Largest Auction House](https://reader031.vdocuments.us/reader031/viewer/2022020306/54c850b54a7959f4758b4593/html5/thumbnails/25.jpg)
HTML5 Local Storage
● HTML5 Local storage is
being used to cache data
locally & load used data
faster
● Sets the road for offline
use in the future !
![Page 26: Using Joomla, Zoo & SOLR to power Asia's Largest Auction House](https://reader031.vdocuments.us/reader031/viewer/2022020306/54c850b54a7959f4758b4593/html5/thumbnails/26.jpg)
Google Image Search anyone ?
● Ajax Grid pagination like Google Images
● Preloading & caching of images, CDN backed delivery
![Page 27: Using Joomla, Zoo & SOLR to power Asia's Largest Auction House](https://reader031.vdocuments.us/reader031/viewer/2022020306/54c850b54a7959f4758b4593/html5/thumbnails/27.jpg)
IOS App for IPad
● Powered by RESTful
Webservices writen on top
of Joomla using com_api
● Initial version developed in
HTML5+Cordova (Phonegap)
● Supports offline use of
alredy viewed data
![Page 28: Using Joomla, Zoo & SOLR to power Asia's Largest Auction House](https://reader031.vdocuments.us/reader031/viewer/2022020306/54c850b54a7959f4758b4593/html5/thumbnails/28.jpg)
Even More !The Project is under continuous development. The features here only cover development at the point this
presentation was made.
● Online Sale of Images ,
Downloads & Rights
Managements
● Research & Teaching tools
● Social Network
● Subscription based
privileged access
![Page 29: Using Joomla, Zoo & SOLR to power Asia's Largest Auction House](https://reader031.vdocuments.us/reader031/viewer/2022020306/54c850b54a7959f4758b4593/html5/thumbnails/29.jpg)
Thank You !
● Questions ?
● Interested in developing something similar ?
Drop us an email ! [email protected]
Twitter @techjoomla | @parthlawate