mgrid -plsi
DESCRIPTION
MGrid -PLSI. Suntae Hwang Daeyoung Heo PRAGMA 20, 2011.03 Kookmin University, Korea. Contents. Introduce PLSI. MGrid on PLSI. Collaboration Model by MGrid. MGrid Improvement. MGrid Tutorial . MGrid Data Management. PLSI. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: MGrid -PLSI](https://reader036.vdocuments.us/reader036/viewer/2022062520/56816600550346895dd93228/html5/thumbnails/1.jpg)
MGrid-PLSI
Suntae HwangDaeyoung Heo
PRAGMA 20, 2011.03Kookmin University, Korea.
![Page 2: MGrid -PLSI](https://reader036.vdocuments.us/reader036/viewer/2022062520/56816600550346895dd93228/html5/thumbnails/2.jpg)
2Parallel Processing Labs.
Contents
Introduce PLSI
MGrid on PLSI
Collaboration Model by MGrid
MGrid Improvement
MGrid Tutorial
MGrid Data Management
![Page 3: MGrid -PLSI](https://reader036.vdocuments.us/reader036/viewer/2022062520/56816600550346895dd93228/html5/thumbnails/3.jpg)
3Parallel Processing Labs.
PLSI
◎ A nationwide supercomputing infrastruc-ture in Korea.
●7 Korean supercomputing centers● Interconnected by dedicated high performance
network○ KREONET○ The National Research Networks
Partnership and Leadership for the nationwide Supercomputing Infra-structure
Total 1,180 TFlopsBy KISTI, 2010.11http://www.plsi.or.kr
![Page 4: MGrid -PLSI](https://reader036.vdocuments.us/reader036/viewer/2022062520/56816600550346895dd93228/html5/thumbnails/4.jpg)
4Parallel Processing Labs.
Goal of PLSI
◎ Integrated System Management● Assist supercomputing site by pro-
fessional work experience.○ System Monitoring.○ System Operation.
● Improve System Availability
◎ Uniform System Interface and Unified Service
● Improve Usability.
PLSI
Integrated System Management
Unified Service
Uniform System Interface
![Page 5: MGrid -PLSI](https://reader036.vdocuments.us/reader036/viewer/2022062520/56816600550346895dd93228/html5/thumbnails/5.jpg)
5Parallel Processing Labs.
Problem #1: User still feel difficult to use PLSI via Terminal
◎ Why?●Don’t have experience of linux or unix.
●Don’t want to know that systems.
Users feel about PLSI
Difficult
![Page 6: MGrid -PLSI](https://reader036.vdocuments.us/reader036/viewer/2022062520/56816600550346895dd93228/html5/thumbnails/6.jpg)
6Parallel Processing Labs.
Example of Problem #1
◎ Users are not happy to understand what they don’t need.
● Just feels “It is very difficult”#! /bin/ksh# Loadleveler Job command file# @cluster_list = gist.kigi# @job_type = MPICH# @wall_clock_limit = 48:00:00# @class = normal# @resources = ConsumableCpus(1) ConsumableMemory(1gb)# @tasks_per_node = 2# @environment = 1
module load intel/intel_9.1.052module load vasp/vaspmpirun –np $LOADL_TOTAL_TASKS \ –machinefile $LOADL_HOSTFILE \ /home01/applic/vasp/vasp4.6/vasp
What is this?
What do these statements mean?
Where is exe-cutable of ‘VASP’?
mod-ule?
$LOADL_TOTAL_TASK
S?
![Page 7: MGrid -PLSI](https://reader036.vdocuments.us/reader036/viewer/2022062520/56816600550346895dd93228/html5/thumbnails/7.jpg)
7Parallel Processing Labs.
Problem #2, Unnecessary Education
◎ System Details●Policy of each supercomputing centers
○ Wall-clock time limits.○ CPU count limits.○ Memory size limits.○ Etc.
●Execution methods○ By system architecture○ Single or parallel
●Execution System Softwarelike SGE, Loadleveler○ Syntaxes○ Some condition or combinations of ex-
ecution methods
Education
Too much to learn
Users don’t want to know about system de-
tails. However they cannot execute then
application without that knowledge
![Page 8: MGrid -PLSI](https://reader036.vdocuments.us/reader036/viewer/2022062520/56816600550346895dd93228/html5/thumbnails/8.jpg)
8Parallel Processing Labs.
Example of Problem #2.
◎ In ‘VASP’ case
module load intel/intel_9.1.052module load vasp/vaspmpirun –np $LOADL_TOTAL_TASKS \ –machinefile $LOADL_HOSTFILE \ /home01/applic/vasp/vasp4.6/vasp
Minor or Not
Interesting
1. What is ‘VASP’?2. What can I do using ‘VASP’?3. How to make to input data(s)?4. How to analyze the results?5. How to visualize the data?
MajorInterest-
ing
![Page 9: MGrid -PLSI](https://reader036.vdocuments.us/reader036/viewer/2022062520/56816600550346895dd93228/html5/thumbnails/9.jpg)
9Parallel Processing Labs.
Problem #3: Security
◎ Anxiety of Administrator● Password management.
○ Don’t allow easy pass-word.
● Terminal access○ Don’t allow terminal being
open to the unknowns.◎ Restrictions for Security
● Users can access from regis-tration IP only.
● Strongly password system○ Must change in the periods.○ Should be use complex com-
bination of letter.
Security
Administrator can’t trust user’s behavior on secu-
rity.“Users always make a
mistake to manage their accounts”
![Page 10: MGrid -PLSI](https://reader036.vdocuments.us/reader036/viewer/2022062520/56816600550346895dd93228/html5/thumbnails/10.jpg)
10Parallel Processing Labs.
MGrid on PLSI
MGrid can be a solution!
![Page 11: MGrid -PLSI](https://reader036.vdocuments.us/reader036/viewer/2022062520/56816600550346895dd93228/html5/thumbnails/11.jpg)
11Parallel Processing Labs.
Plain PLSI vs. MGrid
LoadLeveler
PLSI
LoadLeveler
Uniform System InterfacePLSIMGrid
Integrated System Management
![Page 12: MGrid -PLSI](https://reader036.vdocuments.us/reader036/viewer/2022062520/56816600550346895dd93228/html5/thumbnails/12.jpg)
12Parallel Processing Labs.
What MGrid can do.
◎Portal Service● Integrated technically into web.
○ Anywhere can be access.○ Independence for security issue
of terminal access.◎Authentication via GSI Infra.◎Provide GUI Toolset.
●Logical Resource Information○ Access uniform information.Hide followings:
Complex of software execution, Policy of supercomputing centers, And anything not interesting.
LoadLeveler
PLSIMGrid
ImproveUsability
![Page 13: MGrid -PLSI](https://reader036.vdocuments.us/reader036/viewer/2022062520/56816600550346895dd93228/html5/thumbnails/13.jpg)
13Parallel Processing Labs.
MGrid solve…
◎ In ‘VASP’ case
module load intel/intel_9.1.052module load vasp/vaspmpirun –np $LOADL_TOTAL_TASKS \ –machinefile $LOADL_HOSTFILE \ /home01/applic/vasp/vasp4.6/vasp
Minor or Not
Interesting
1. What is ‘VASP’?2. What can I do using ‘VASP’?3. How to make to input data(s)?4. How to analyze the results?5. How to visualize the data?
MajorInterest-
ing
Provide GUI Toolset
![Page 14: MGrid -PLSI](https://reader036.vdocuments.us/reader036/viewer/2022062520/56816600550346895dd93228/html5/thumbnails/14.jpg)
14Parallel Processing Labs.
Collaboration Model by MGrid
Collaboration Model
SupercomputingCenters
Operation Center( KISTI )
Software and Technology
( Kookmin Univ. )
![Page 15: MGrid -PLSI](https://reader036.vdocuments.us/reader036/viewer/2022062520/56816600550346895dd93228/html5/thumbnails/15.jpg)
15Parallel Processing Labs.
Collaboration Model by MGrid
MGrid
Centers
KMUKISTI
Tools
PLSIResources
MGrid
PLSI
MGrid provide toolset for users. Indirect access PLSI resources. Divide works.
System operation. Support customers.
![Page 16: MGrid -PLSI](https://reader036.vdocuments.us/reader036/viewer/2022062520/56816600550346895dd93228/html5/thumbnails/16.jpg)
16Parallel Processing Labs.
Collaboration Model : Feedback Cycles
MGrid
Centers
KMUKISTI
Tools
PLSIResources
MGrid
FeedbackFeed
back
Feedback
PLSIwork
work
notify
![Page 17: MGrid -PLSI](https://reader036.vdocuments.us/reader036/viewer/2022062520/56816600550346895dd93228/html5/thumbnails/17.jpg)
17Parallel Processing Labs.
MGrid Improvement
MGridImprovement!
![Page 18: MGrid -PLSI](https://reader036.vdocuments.us/reader036/viewer/2022062520/56816600550346895dd93228/html5/thumbnails/18.jpg)
18Parallel Processing Labs.
Improve #1: IP free
◎ IP free Using HTTP Protocol only Anywhere access to PLSI
Restricted IPPort 2811,45000 ~ 50000
Any IPPort 80
![Page 19: MGrid -PLSI](https://reader036.vdocuments.us/reader036/viewer/2022062520/56816600550346895dd93228/html5/thumbnails/19.jpg)
19Parallel Processing Labs.
Improve #2. Quick Launching
◎ Quick Launching● Provide application specific dialog.
Software Packages
VASP
GAUSSIAN
CHARMM
NAMD
AMBER
![Page 20: MGrid -PLSI](https://reader036.vdocuments.us/reader036/viewer/2022062520/56816600550346895dd93228/html5/thumbnails/20.jpg)
20Parallel Processing Labs.
Improve #3. Automatic Tool Setup
◎ Setup wizard● Manual Automatic
○ Set service’s URL○ Check if services are run-
ning.○ Retrieve and set path of
user’s home
![Page 21: MGrid -PLSI](https://reader036.vdocuments.us/reader036/viewer/2022062520/56816600550346895dd93228/html5/thumbnails/21.jpg)
21Parallel Processing Labs.
MGrid Tutorial
MGridTutorial!
![Page 22: MGrid -PLSI](https://reader036.vdocuments.us/reader036/viewer/2022062520/56816600550346895dd93228/html5/thumbnails/22.jpg)
22Parallel Processing Labs.
Step 1. Access MGrid-PLSI Portal
◎Visit http://mgrid.plsi.or.kr
Sign-in by ceritficate
![Page 23: MGrid -PLSI](https://reader036.vdocuments.us/reader036/viewer/2022062520/56816600550346895dd93228/html5/thumbnails/23.jpg)
23Parallel Processing Labs.
Step 3. Launch MGrid Builder
◎ Move to ‘Workspace’ Tab◎ Click ‘New>MGrid Builder’ on the toolbar.
![Page 24: MGrid -PLSI](https://reader036.vdocuments.us/reader036/viewer/2022062520/56816600550346895dd93228/html5/thumbnails/24.jpg)
24Parallel Processing Labs.
Step 4. Automatic setup wizard
◎ Just click ‘Next’ and ‘Finish’
![Page 25: MGrid -PLSI](https://reader036.vdocuments.us/reader036/viewer/2022062520/56816600550346895dd93228/html5/thumbnails/25.jpg)
25Parallel Processing Labs.
Step 5. Quick launching Menu
◎ Click software on the menu.●VASP●GAUSSIAN (soon)●CHARMM (soon)●NAMD (soon)●AMBER (soon)
◎ Or click ‘General’●General Job Builder.
![Page 26: MGrid -PLSI](https://reader036.vdocuments.us/reader036/viewer/2022062520/56816600550346895dd93228/html5/thumbnails/26.jpg)
26Parallel Processing Labs.
Step 6. Show ‘RUN’ wizard
◎ These fields already filled out.
◎ Required fields●Trial Section
○ Trial Name○ Description○ Files
●Execution Section
Scrolldown
Just click and than search.
Exploringremote
filesystem
![Page 27: MGrid -PLSI](https://reader036.vdocuments.us/reader036/viewer/2022062520/56816600550346895dd93228/html5/thumbnails/27.jpg)
27Parallel Processing Labs.
MGRIDDATA MANAGEMENT
![Page 28: MGrid -PLSI](https://reader036.vdocuments.us/reader036/viewer/2022062520/56816600550346895dd93228/html5/thumbnails/28.jpg)
28Parallel Processing Labs.
Label(Tagging) or Project
◎ Organize and Categorize jobs with label● All jobs belong to label “All” ● Assign multiple labels to each jobs.
![Page 29: MGrid -PLSI](https://reader036.vdocuments.us/reader036/viewer/2022062520/56816600550346895dd93228/html5/thumbnails/29.jpg)
29Parallel Processing Labs.
Job and Trial
◎It contains your input and result files◎Two ways of organize your data
◎ First way◎ Using only job.◎ Job is like ‘Folder’
.
◎ Second way◎ Combination of job
and trials.◎ Job can contains
multiple trials
![Page 30: MGrid -PLSI](https://reader036.vdocuments.us/reader036/viewer/2022062520/56816600550346895dd93228/html5/thumbnails/30.jpg)
30Parallel Processing Labs.
First way of organize data
◎ Always create new job (“New>MGrid Builder”)
![Page 31: MGrid -PLSI](https://reader036.vdocuments.us/reader036/viewer/2022062520/56816600550346895dd93228/html5/thumbnails/31.jpg)
31Parallel Processing Labs.
Second way of organize data
◎ Using ‘Run Wizard’ with different param-eters
Run Wizard