scaling saved searches at ebay kleinanzeigen
TRANSCRIPT
![Page 1: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/1.jpg)
Scaling Saved SearchesServing real time push-notifications for millions
saved searches
466382733
André Charton, Christiane Lemke
![Page 2: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/2.jpg)
![Page 3: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/3.jpg)
Who we are?
![Page 4: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/4.jpg)
ebay
kleinanzeigen
≠
ebay
![Page 5: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/5.jpg)
local platforms
![Page 6: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/6.jpg)
some numbers
![Page 7: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/7.jpg)
19M ads
12M searches/day
![Page 8: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/8.jpg)
0.6M new ads/day
6M saved searches
![Page 9: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/9.jpg)
36.000.000.000
theoretical
matches
![Page 10: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/10.jpg)
p r o c e s s
i t !
![Page 11: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/11.jpg)
make it run,
make it fast,
make it stable,
make it better.Special thx fly to Ramkumar Aiyenger – how see some project in the same way.
![Page 12: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/12.jpg)
hat?
![Page 13: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/13.jpg)
![Page 14: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/14.jpg)
![Page 15: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/15.jpg)
![Page 16: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/16.jpg)
![Page 17: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/17.jpg)
![Page 18: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/18.jpg)
![Page 19: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/19.jpg)
![Page 20: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/20.jpg)
ow?
![Page 21: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/21.jpg)
* * 0/6 * * ?
![Page 22: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/22.jpg)
r e a l t i m e ?
![Page 23: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/23.jpg)
s c a l a b l e ?
![Page 24: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/24.jpg)
C a n
w e
d o
b e t t e r ?
![Page 25: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/25.jpg)
2 0 1 5
![Page 26: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/26.jpg)
src=https://www.esciencecenter.nl/img/main/logo-elastic.png
![Page 27: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/27.jpg)
Percolator
Traditionally you design documents based on your data, store
them into an index, and then define queries via the search
API in order to retrieve these documents. The percolator
works in the opposite direction. First you store queries into an
index and then, via the percolate API, you define documents
in order to retrieve these queries.
src=https://www.elastic.co/guide/en/elasticsearch/reference/current/search-percolate.html
![Page 28: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/28.jpg)
![Page 29: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/29.jpg)
![Page 30: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/30.jpg)
![Page 31: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/31.jpg)
![Page 32: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/32.jpg)
![Page 33: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/33.jpg)
![Page 34: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/34.jpg)
![Page 35: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/35.jpg)
![Page 36: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/36.jpg)
![Page 37: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/37.jpg)
![Page 38: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/38.jpg)
![Page 39: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/39.jpg)
H o w
m a n y
p u s h s
p e r d a y ?
![Page 40: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/40.jpg)
![Page 41: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/41.jpg)
C r e a t e
d e l a y s
f r o m
s i z e
![Page 42: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/42.jpg)
0 - 100: RT
101 - 1000: 1h
1001 - 10000: 2h
> 10000: 6h
![Page 43: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/43.jpg)
a s k
s o l r
![Page 44: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/44.jpg)
s k i p
o n
o v e r l o a d
![Page 45: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/45.jpg)
![Page 46: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/46.jpg)
S e t u p
![Page 47: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/47.jpg)
S e t u p
![Page 48: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/48.jpg)
![Page 49: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/49.jpg)
cloud
![Page 50: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/50.jpg)
cloud
2 data centers
![Page 51: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/51.jpg)
cloud
2 data centers
10 + 3 machines
![Page 52: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/52.jpg)
cloud
2 data centers
10 + 3 machines
![Page 53: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/53.jpg)
replication x1
shards x80
![Page 54: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/54.jpg)
![Page 55: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/55.jpg)
![Page 56: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/56.jpg)
...
![Page 57: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/57.jpg)
l i f e t i m e
o f
a
s e a r c h
![Page 58: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/58.jpg)
![Page 59: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/59.jpg)
s l e e p ...
Z Z Z Z Z Z
![Page 60: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/60.jpg)
Z Z Z Z Z Z
![Page 61: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/61.jpg)
![Page 62: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/62.jpg)
![Page 63: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/63.jpg)
![Page 64: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/64.jpg)
e l a s t i c
f a s t
o n
i n d e x i n g
![Page 65: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/65.jpg)
r e m o v e
s l e e p i n g
s e a r c h e s
![Page 66: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/66.jpg)
o n l y 3 0 %
s e a r c h e s
a r e
o n l i n e
![Page 67: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/67.jpg)
d e s k t o p
![Page 68: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/68.jpg)
a v o i d
d b - r e a d
p e r
s e a r c h
![Page 69: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/69.jpg)
b l o o m
f i l t e r
i n
c o o k i e
![Page 70: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/70.jpg)
src=https://upload.wikimedia.org/wikipedia/commons/thumb/a/ac/Bloom_filter.svg/2000px-Bloom_filter.svg.png
![Page 71: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/71.jpg)
a p p s
![Page 72: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/72.jpg)
d e e p l i n k
o n
r e s u l t
s i z e
![Page 73: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/73.jpg)
![Page 74: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/74.jpg)
s t o r e
s e a r c h e s
l o c a l
![Page 75: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/75.jpg)
b a c k e n d
s y n c
o n
a c t i o n s
![Page 76: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/76.jpg)
S a v e d
S e a r c h
![Page 77: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/77.jpg)
S t a b l e ?
![Page 78: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/78.jpg)
S t a b i l i z e
e l a s t i c
![Page 79: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/79.jpg)
Boost your percolator!Tips & Tricks
![Page 80: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/80.jpg)
“This indeed seems like a
large application of
percolate.”Elastic support, June 2015
![Page 81: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/81.jpg)
Performance linear with number of queries
![Page 82: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/82.jpg)
1.Consider using other systems.
![Page 83: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/83.jpg)
1.Consider using other systems.
“It is worth noting that simple exist matches on a field are probably not a
great application for percolator. This doesn’t utilize any text matching
capability or complex boolean.”
Anything,
anywhere!Everything
for free!
![Page 84: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/84.jpg)
1.Consider using other systems.
![Page 85: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/85.jpg)
2. Optimise your data structure.
![Page 86: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/86.jpg)
2. Optimise your data structure.
![Page 87: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/87.jpg)
2. Optimise your data structure.
![Page 88: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/88.jpg)
3. Filter, filter, filter!
![Page 89: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/89.jpg)
3. Filter, filter, filter!
“The filter only works on the metadata fields.
The query field isn’t indexed by default.”
![Page 90: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/90.jpg)
{
"query":
{...},
"category": CARS
}
{"doc" : {...},
"filters": [
{"or": {"filters":[
{"term":{
"category":CARS
}},
{"term":{
"category":ALL
}}
]}}
]
}
{
"query":
{...},
"category": ALL
}
3. Filter, filter, filter!
![Page 91: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/91.jpg)
… what else can we filter?
3. Filter, filter, filter!
![Page 92: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/92.jpg)
4. Consider prioritising.
![Page 93: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/93.jpg)
Josh:
Flysurfer kite in Hamburg for less
than 300 Euro
Christiane:
Bicycle in Berlin
4. Consider prioritising.
![Page 94: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/94.jpg)
4. Consider prioritising.
Josh:
Flysurfer kite in Hamburg for less
than 300 Euro
Christiane:
Bicycle in Berlin
![Page 95: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/95.jpg)
Josh:
Flysurfer kite in Hamburg for less
than 300 Euro
Christiane:
Bicycle in Berlin
4. Consider prioritising.
HIGH PRIORITYLOW PRIORITY
![Page 96: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/96.jpg)
4. Consider prioritising.
![Page 97: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/97.jpg)
5. Use multipercolate.
![Page 98: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/98.jpg)
5. Use multipercolate.
![Page 99: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/99.jpg)
6. Use parallel multipercolate.
![Page 100: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/100.jpg)
6. Use parallel multipercolate.
● Scenario: 2 shards, replication factor 1 (Shards a1, a2, b1, b2)
-> Queries sent to (a1 OR a2) AND (b1 OR b2)
● Open issue: https://github.com/elastic/elasticsearch/issues/13177
“Currently, to utilise all of your shards, you would need to consider
sending multiple mpercolate requests in parallel.”
![Page 101: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/101.jpg)
6. Use parallel multipercolate.
![Page 102: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/102.jpg)
Outcome
Reduced percolation time:
![Page 103: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/103.jpg)
Outcome
Doubled the number of push notifications:
![Page 104: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/104.jpg)
S t a b i l i z e
e l a s t i c
![Page 105: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/105.jpg)
S t a b l e ?
![Page 106: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/106.jpg)
S t a b i l i z e
p l a t f o r m
![Page 107: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/107.jpg)
6 0 0 0 0 0 0
s e a r c h e s
6 0 0 0 0 0
a d s / d a y
![Page 108: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/108.jpg)
u s i n g
k a f k a
![Page 109: Scaling Saved Searches at eBay Kleinanzeigen](https://reader034.vdocuments.us/reader034/viewer/2022051318/58f2bc021a28ab5e5b8b45c1/html5/thumbnails/109.jpg)
T h a n k
y o u