directorymark ™ : the directory server benchmark bruce weiner mindcraft, inc. 10 jackson street,...
TRANSCRIPT
DirectoryMark™:The Directory Server Benchmark
Bruce WeinerMindcraft, Inc.10 Jackson Street, Suite 111ALos Gatos, CA 95030(408) 395-2404 Fax: (408) [email protected]
DirectoryMark is a trademark of Mindcraft, Inc. and Netscape Communications Corp.
Presented at the Electronic Messaging Association Solution Summit 98
Copyright 1998 Mindcraft, Inc. 2
Contents Big Picture DirectoryMark Components How DirectoryMark Works Run Rules Summary
Copyright 1998 Mindcraft, Inc. 3
Big Picture
DirectoryMark provides a standardized way to test LDAP directory server performance
Rigorous run rules make it possible to compare results
Benchmark with your own data
Copyright 1998 Mindcraft, Inc. 4
DirectoryMark Components dbgen: generates test data scriptgen: generates test script dmmaster: controls test process and reports
results dmclient: uses script to test directory server
performance
Copyright 1998 Mindcraft, Inc. 5
dbgendbgen
How DirectoryMark Works
scriptgenscriptgen
dmmasterdmmaster
directorydirectory
dmclientdmclient
LDIF
LDIF
Copyright 1998 Mindcraft, Inc. 6
DirectoryMark Run Rules System under test Test scenarios Directory sizes and ACLs Test script Warm-up and run Reporting and price/performance Needs resolution
Copyright 1998 Mindcraft, Inc. 7
System Under Test The server(s) running the directory server The server OS The LDAP directory server The networking
Everything except the clients Server NICs, hubs, routers, switches Software in programmable network
devices
Copyright 1998 Mindcraft, Inc. 8
Test Scenarios Scenarios use organizationalPerson Standard scenarios
Loading: incremental loads Messaging: e-mail server simulation Update: last login information update Address look-up: e-mail or PIM client simulation
Copyright 1998 Mindcraft, Inc. 9
Directory Sizes and ACLs Standard directory size classes
Minimum number of ACLs
Class 1: 10,000 50,000 100,000
Class 2: 100,000 250,000 500,000
Class 3: 500,000 750,000 1,000,000
Class 4: 1,000,000 2,500,000 5,000,000
Class 5: 5,000,000 7,500,000 10,000,000
Class 6: 10,000,000 25,000,000 50,000,000
Copyright 1998 Mindcraft, Inc. 10
Test Script Standard directory operations for Address
Look-Up scenario
Binding: Every 5 ops
UID searches: 28%
CN wildcard searches: 24%, * at end
givenName match: 16%
SN match: 8%
CN match: 16%
Not found: 8%
Copyright 1998 Mindcraft, Inc. 11
Warm-Up and Run For each data point of each scenario except
Loading: Warm-up time = 8 minutes Run time = 16 minutes
Total test time = 162 minutes + loading time 2 hours 42 minutes + loading time
Copyright 1998 Mindcraft, Inc. 12
Reporting and Price/Performance Standard Web page reporting form
Includes complete SUT description and configuration
Includes performance for each directory size class reported
Includes price/performance calculation Standard DirectoryMark Operations Per
Second metric Standard pricing guidelines
Standard Web page and Excel spreadsheet
Copyright 1998 Mindcraft, Inc. 13
Needs Resolution
How many ACLs should be required?
Should directory server logging be turned on?
How should cache be warmed up?
Should catalog testing be reported?
Copyright 1998 Mindcraft, Inc. 14
Summary
DirectoryMark provides: A rigorous, standard performance
measurement tool Standardized run rules and reporting to
facilitate comparisons A way to benchmark with your data