hands-on introduction to hpc for life scientists prace ......promote best practices and train end...

41
bioexcel.eu Partners Funding Hands-on introduction to HPC for life scientists - PRACE & BioExcel 1 Vera Matser EMBL-EBI Center of Excellence for Computational Biomolecular Research Training and Dissemination

Upload: others

Post on 27-Jun-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Hands-on introduction to HPC for life scientists PRACE ......Promote best practices and train end users to make best use of both software and computational infrastructure • academic

bioexcel.eu

Partners Funding

Hands-on introduction to HPC for life scientists

-PRACE & BioExcel

1

Vera MatserEMBL-EBI

Center of Excellence for Computational Biomolecular Research

Training and Dissemination

Page 2: Hands-on introduction to HPC for life scientists PRACE ......Promote best practices and train end users to make best use of both software and computational infrastructure • academic

bioexcel.eu

Life Science and HPC

2

Atom

Small Molecule

Macromolecules

Cell

Tissue

OrganPopulation

Page 3: Hands-on introduction to HPC for life scientists PRACE ......Promote best practices and train end users to make best use of both software and computational infrastructure • academic

bioexcel.eu3

Electronic structure

Personalized medicine

Physiology

Neuroinformatics

Biomarkers design

Biomaterials science and nanotechnology

BiomolecularModeling and Simulations

Page 4: Hands-on introduction to HPC for life scientists PRACE ......Promote best practices and train end users to make best use of both software and computational infrastructure • academic

bioexcel.eu

BioExcel Center of Excellence

4

Page 5: Hands-on introduction to HPC for life scientists PRACE ......Promote best practices and train end users to make best use of both software and computational infrastructure • academic

bioexcel.eu

Objectives of BioExcelExcellence in Biomolecular ScienceImprove the performance, efficiency and scalability of key codes

• GROMACS (Molecular Dynamics Simulations)

• HADDOCK (Integrative modeling of macro-assemblies)

• CPMD (hybrid QM/MM code for enzymatic reactions, photochemistry and electron transfer processes)

5

Page 6: Hands-on introduction to HPC for life scientists PRACE ......Promote best practices and train end users to make best use of both software and computational infrastructure • academic

bioexcel.eu

Objectives of BioExcelExcellence in Usability

• Make ICT technologieseasier to use bybiomolecular researchers,both in academia andindustry

• Devise efficient workflowenvironments withassociated data integration

6

DMI Monitor

DMI Enactor

DMI Executor

DMI Enactor

Data Delivery Point

Data Source

Monitoring flow

Data flow

Service Invocation

DMI Optimiser

DMI Planner

DMIValidator

DMI Gateway

DMI Gateway

DMI Gateway

DMI Enactor

Portal / Workbench

DMI Request

DADC Engineer

DMI Expert

Repository

Registry

DMI Expert

Domain Expert

Page 7: Hands-on introduction to HPC for life scientists PRACE ......Promote best practices and train end users to make best use of both software and computational infrastructure • academic

bioexcel.eu

Objectives of BioExcel

Competence-building among academia and industryPromote best practices and train end users to make best use of both software and computational infrastructure• academic and non-profit users• industrial users• independent software

vendors (ISVs) andacademic code providersof related software

• academic and commercialresource providers

7

Page 8: Hands-on introduction to HPC for life scientists PRACE ......Promote best practices and train end users to make best use of both software and computational infrastructure • academic

bioexcel.eu

TrainingMethodology

8

Created Competency profile

Mapped competencies to 

training

Gap analysis

Training Programme

Knowledge Resource Center

Page 9: Hands-on introduction to HPC for life scientists PRACE ......Promote best practices and train end users to make best use of both software and computational infrastructure • academic

bioexcel.eu

"Write his/her own scripts to perform tasks in context of biomolecular research"

9

Knowledge Skills Behaviour

Knowledge of existing commands/librariesto re‐use

Is able to automate the process of executing processes remotely

Uses appropriate scripting languages

Judges when a task should be automated

Write & debug scripts

A Competency is an observable ability of any professional, integrating multiple components such as knowledge, skills and

behaviours

Page 10: Hands-on introduction to HPC for life scientists PRACE ......Promote best practices and train end users to make best use of both software and computational infrastructure • academic

bioexcel.eu

BioExcel Competency Profile

Group related competencies together into areas

10

Page 11: Hands-on introduction to HPC for life scientists PRACE ......Promote best practices and train end users to make best use of both software and computational infrastructure • academic

bioexcel.eu

BioExcel Competency ProfileDifferent types of users

11

Page 12: Hands-on introduction to HPC for life scientists PRACE ......Promote best practices and train end users to make best use of both software and computational infrastructure • academic

bioexcel.eu

Mapping & Gap analysis

12

Generic Competencies (1.1 – 1.5)Scientific Competencies (2.1 – 2.13)Generic Computing Competencies (3.1 – 3.8)Parallel Computing Competencies (4.1 – 4.5) 

5 (total training resources) picked as a minimum viable number for coverage

Page 13: Hands-on introduction to HPC for life scientists PRACE ......Promote best practices and train end users to make best use of both software and computational infrastructure • academic

bioexcel.eu

HPC training for life scientists

13

Page 14: Hands-on introduction to HPC for life scientists PRACE ......Promote best practices and train end users to make best use of both software and computational infrastructure • academic

bioexcel.eu14

HPC training for life scientists

Page 15: Hands-on introduction to HPC for life scientists PRACE ......Promote best practices and train end users to make best use of both software and computational infrastructure • academic

bioexcel.eu15

HPC training for life scientists

Page 16: Hands-on introduction to HPC for life scientists PRACE ......Promote best practices and train end users to make best use of both software and computational infrastructure • academic

bioexcel.eu16

HPC training for life scientists

Page 17: Hands-on introduction to HPC for life scientists PRACE ......Promote best practices and train end users to make best use of both software and computational infrastructure • academic

bioexcel.eu

Parallel Computing Competencies

• Assess computational workflow systems and their potential benefits

• Apply knowledge of batch system• Write computer programs that can run on a parallel

computer• Assess advantages and limitations for deploying,

executing and optimising computations in a cloud/grid/HPC environment

• Apply knowledge of performance profiling to measure suitability of computing platforms

17

Page 18: Hands-on introduction to HPC for life scientists PRACE ......Promote best practices and train end users to make best use of both software and computational infrastructure • academic

bioexcel.eu

Activity - Benchmarking

18

How are your skills developing over time?

• Pre‐course• Post‐course• 6 – 12 months

Note: • Survey in email also rates generic computingCompetencies• Link to full profile

Page 19: Hands-on introduction to HPC for life scientists PRACE ......Promote best practices and train end users to make best use of both software and computational infrastructure • academic

bioexcel.eu

Long-term Feedback & Impact

Competency development over time

Post-course impact survey (6-12 months)

Impact interviews- Will send invite later today and explain in one of the coffee

breaks- Short skype conversation with individuals

19

Page 20: Hands-on introduction to HPC for life scientists PRACE ......Promote best practices and train end users to make best use of both software and computational infrastructure • academic

bioexcel.eu

Why is this important?

• For us to improve our courses

• Report to funding agencies• Anonymous data as part of future funding proposals

• For you – benchmark of where you started from

20

Page 21: Hands-on introduction to HPC for life scientists PRACE ......Promote best practices and train end users to make best use of both software and computational infrastructure • academic

bioexcel.eu

Activity: Human barometer

21

Have you ever been to Edinburgh before?

1 – No first time ever, London is the furthest North I generally go2345 – I grew up here* – Wildcard ‐ Where is Edinburgh, aren’t we in London?

Sticky dots

Page 22: Hands-on introduction to HPC for life scientists PRACE ......Promote best practices and train end users to make best use of both software and computational infrastructure • academic

bioexcel.eu

How familiar are you with linux?

1 - Linux.. what?

5 - Linux commands are my primary way of communicating

22

Page 23: Hands-on introduction to HPC for life scientists PRACE ......Promote best practices and train end users to make best use of both software and computational infrastructure • academic

bioexcel.eu

What is you programming expertise?

1 – I only used existing code/software that is ready to run

5 – I would never use someone else's code, only my own!

23

Page 24: Hands-on introduction to HPC for life scientists PRACE ......Promote best practices and train end users to make best use of both software and computational infrastructure • academic

bioexcel.eu

Have you attended any previous courses dedicated to HPC (or with a

large HPC component)?1 – No, just starting out with HPC

5 – I’ve lost count, so much to learn..

24

Page 25: Hands-on introduction to HPC for life scientists PRACE ......Promote best practices and train end users to make best use of both software and computational infrastructure • academic

bioexcel.eu

How freaked out are you about the prospect of working in an HPC

environment

1 – Very! Help

5 – I'm cool, just here to dot the i’s and cross the t’s

25

Page 26: Hands-on introduction to HPC for life scientists PRACE ......Promote best practices and train end users to make best use of both software and computational infrastructure • academic

bioexcel.eu

How much support do you have in your home institute?

1 – None, I have to do this by myself or find outside support

5 – My group is heavily into HPC and I’ll be supported every step of the way

26

Page 27: Hands-on introduction to HPC for life scientists PRACE ......Promote best practices and train end users to make best use of both software and computational infrastructure • academic

bioexcel.eu

Have you used an HPC machine before?

1 – Never, I wouldn't even know where to start

5 – Every day, I live in the HPC environment

27

Page 28: Hands-on introduction to HPC for life scientists PRACE ......Promote best practices and train end users to make best use of both software and computational infrastructure • academic

bioexcel.eu

Do you know how to gain access to time on an HPC machine?

1 – No!

5 – I have allocated time on multiple HPC machine

28

Page 29: Hands-on introduction to HPC for life scientists PRACE ......Promote best practices and train end users to make best use of both software and computational infrastructure • academic

bioexcel.eu

Online resources

BioExcel webinar series• Wednesday 14:00 GMT / 15:00 CET• Video on the website afterwards

http://bioexcel.eu/category/webinar/

Knowledge Resource Center• Relevant F2F courses (internal & external)• Relevant tutorials, courses, best practice docs• Beta version• Content review

29

Page 30: Hands-on introduction to HPC for life scientists PRACE ......Promote best practices and train end users to make best use of both software and computational infrastructure • academic

bioexcel.eu

BioExcel Knowledge Resource Center

30

http://krc.bioexcel.eu/

Page 31: Hands-on introduction to HPC for life scientists PRACE ......Promote best practices and train end users to make best use of both software and computational infrastructure • academic

bioexcel.eu

Summer school 2018

31

18-22nd June 2018Cagliari, Sardinia

Use case based summer school- Showcasing BioExcel resources- Potentially expanded use case developed for

community forum

Keep an eye on the website for details

Page 32: Hands-on introduction to HPC for life scientists PRACE ......Promote best practices and train end users to make best use of both software and computational infrastructure • academic

bioexcel.eu

How to get in touch with us

32

@BioExcelCoE

ask.bioexcel.eu

www.bioexcel.eu

Announce updates, training courses, webinars & papers

Subscribe to mailing listCompany Page

About < People  

User support forum

Page 33: Hands-on introduction to HPC for life scientists PRACE ......Promote best practices and train end users to make best use of both software and computational infrastructure • academic

bioexcel.eu

Interest Groups

• BioExcel aims to foster a community around computational biomolecular research and support existing communities

• An important link with wider communities is through Interest Groups: Smaller groups of named individuals who have chosen to be members of the group

Interest Groups are open to all:Sign up at bioexcel.eu/interest-groups.

Funding available to support face-to-face meetings

17/12/2015

Page 34: Hands-on introduction to HPC for life scientists PRACE ......Promote best practices and train end users to make best use of both software and computational infrastructure • academic

bioexcel.eu

Interest Groups

Interest Groups will:

• Allow BioExcel to learn about its users

• Allow members to learn from BioExcel

• Aid communication between members

• Lead to user-driven governance

Page 35: Hands-on introduction to HPC for life scientists PRACE ......Promote best practices and train end users to make best use of both software and computational infrastructure • academic

bioexcel.eu

Interest Groups

• Entry Level Users • Integrative Modeling• Free Energy Calculations• Hybrid methods • Workflows• Industry• Training

Support platforms

Forums Code Repositories Chat channel Video Channel

35

www.bioexcel.eu/interest‐groups

Page 36: Hands-on introduction to HPC for life scientists PRACE ......Promote best practices and train end users to make best use of both software and computational infrastructure • academic

bioexcel.eu

Appendix

36

Page 37: Hands-on introduction to HPC for life scientists PRACE ......Promote best practices and train end users to make best use of both software and computational infrastructure • academic

bioexcel.eu37

Page 38: Hands-on introduction to HPC for life scientists PRACE ......Promote best practices and train end users to make best use of both software and computational infrastructure • academic

bioexcel.eu38

Page 39: Hands-on introduction to HPC for life scientists PRACE ......Promote best practices and train end users to make best use of both software and computational infrastructure • academic

bioexcel.eu39

Page 40: Hands-on introduction to HPC for life scientists PRACE ......Promote best practices and train end users to make best use of both software and computational infrastructure • academic

bioexcel.eu40

Page 41: Hands-on introduction to HPC for life scientists PRACE ......Promote best practices and train end users to make best use of both software and computational infrastructure • academic

bioexcel.eu41