uk national e-infrastructure survey 2014 - update for hpc-sig may 2014

2014 UK NationalE-Infrastructure Survey

Jeremy Yates, DiRAC: j.a.yates@ucl.ac.ukMartin Hamilton, Jisc: m.hamilton@jisc.ac.uk

Diagram courtesy EPSRC

2014 UK NationalAcademic E-Infrastructure Survey

Jeremy Yates, DiRAC: j.a.yates@ucl.ac.ukMartin Hamilton, Jisc: m.hamilton@jisc.ac.uk

Diagram courtesy EPSRC

—Revised and updated version of survey conducted in 2013

—Led by Jeremy Yates, Martin Hamilton, Neil Chue Hong, with input from Alan Real and Oz Parchment

—Probing several additional areas not covered in 2013:—Staffing and workload, budget arrangements—Sharing services / pooling effort

—Responses received from 17 large and specialist facilities, and 35 of the 38 HPC-SIG member institutions

National E-Infrastructure Survey

National E-Infrastructure SurveyFTE allocation breakdown

0 - 250

251 - 500

501- 750

751 - 1000

1001 - 1250

1251 - 1500

1501 - 1750

1751 - 2000

2001- 2250

2251 - 2500

2501 - 2750

2751 - 3000

3001 - 3250

3251 - 3500

3501 - 3750

3751 - 4000

4001 - 5000

5001 - 6000

6001- 7000

7001 - 8000

8001 -15999

17000 - 20000

70000+0

1

2

3

4

5

6

7

8

HEIs Large/Specialist

Total no. of processor cores

0 - 250

251 - 500

501- 750

751 - 1000

1001 - 1250

1251 - 1500

1501 - 1750

1751 - 2000

2001- 2250

2251 - 2500

2501 - 2750

2751 - 3000

3001 - 3250

3251 - 3500

3501 - 3750

3751 - 4000

4001 - 5000

5001 - 6000

6001- 7000

7001 - 8000

8001 -15999

17000 - 20000

70000+0

1

2

3

4

5

6

7

8

HEIs Large/Specialist

Total no. of processor cores

National E-Infrastructure SurveyFTE allocation breakdown

549,190 cores

National E-Infrastructure SurveyFTE allocation breakdown

0 - 10 11 - 20 21 -30 31 - 40 41 - 50 51- 60 61 - 70 71 - 80 81 - 90 91 - 100 101 - 110 101 -1000 1000+0

1

2

3

4

5

6

7

8

9

HEIs Large/Specialist

Theoretical peak performance (Tflops)

National E-Infrastructure SurveyFTE allocation breakdown

0 - 10 11 - 20 21 -30 31 - 40 41 - 50 51- 60 61 - 70 71 - 80 81 - 90 91 - 100 101 - 110 101 -1000 1000+0

1

2

3

4

5

6

7

8

9

HEIs Large/Specialist

Theoretical peak performance (Tflops)

36 Petaflops

National E-Infrastructure SurveyFTE allocation breakdown

0 - 10 11 - 50 51 - 100 101 - 200 201 - 300 301 - 400 401 - 500 501 - 600 601 - 1000

1001 - 2000

2001 - 2048

20000+0

2

4

6

8

10

12

HEIs Large/Specialist

Amount of storage available to users (TB)

National E-Infrastructure SurveyFTE allocation breakdown

0 - 10 11 - 50 51 - 100 101 - 200 201 - 300 301 - 400 401 - 500 501 - 600 601 - 1000

1001 - 2000

2001 - 2048

20000+0

2

4

6

8

10

12

HEIs Large/Specialist

Amount of storage available to users

63PB

National E-Infrastructure SurveyFTE allocation breakdown

0-100 100-500 500-1000 1000+0

2

4

6

8

10

12

14

16

18

20

HEIs Large/Specialist

No. of users

National E-Infrastructure SurveyFTE allocation breakdown

0-100 100-500 500-1000 1000+0

2

4

6

8

10

12

14

16

18

20

HEIs Large/Specialist

No. of users

25,000 users** = some double counting

National E-Infrastructure SurveyFTE allocation breakdown

-30 -20 -10 0 10 20 30 40 50 60 700

1

2

3

4

5

6

HEIs Large/Specialist

No. of months until end of maintenance period

No.

of f

acili

ties

National E-Infrastructure SurveyFTE allocation breakdown

-30 -20 -10 0 10 20 30 40 50 60 700

1

2

3

4

5

6

HEIs Large/Specialist

No. of months until end of maintenance period

No.

of f

acili

ties

National E-Infrastructure SurveyFTE allocation breakdown

-30 -20 -10 0 10 20 30 40 50 60 700

1

2

3

4

5

6

HEIs Large/Specialist

No. of months until end of maintenance period

No.

of f

acili

ties

National E-Infrastructure SurveyFTE allocation breakdown

0

10

20

30

40

50

60

Large/Specialist

National E-Infrastructure SurveyFTE allocation breakdown

0

10

20

30

40

50

60

Large/Specialist

0

2

4

6

8

10

12

14

HEIs

National E-Infrastructure Survey

System Support30%

Software Engineering10%Application Support

19%

User Training9%

Strategic Engagement14%

Project Management10%

Other User Support7%

FTE allocation breakdown

External Centrally Distributed Dept/research centre

0

2

4

6

8

10

12

14

16

18

20

Where are staff based?

HEIsLarge/Specialist

National E-Infrastructure SurveyFTE allocation breakdown

0 0.5 1 1.5 2 2.5 3 3.50

1

2

3

4

5

6

System Support

FTE count

No

of re

spon

dent

s

0 0.5 1 1.5 2 2.5 3 3.502468

101214

Software Engineering

FTE count

No

of re

spon

dent

s

0 0.5 1 1.5 2 2.5 3 3.5 4 4.5012345678

Application Support

FTE count

No

of re

spon

dent

s

0 0.2 0.4 0.6 0.8 1 1.20

2

4

6

8

10

User Training

FTE count

No

of re

spon

dent

s

National E-Infrastructure SurveyFTE allocation breakdown

0 0.5 1 1.5 2 2.5 3 3.50

1

2

3

4

5

6

System Support

FTE count

No

of re

spon

dent

s

0 0.5 1 1.5 2 2.5 3 3.502468

101214

Software Engineering

FTE count

No

of re

spon

dent

s

0 0.5 1 1.5 2 2.5 3 3.5 4 4.5012345678

Application Support

FTE count

No

of re

spon

dent

s

0 0.2 0.4 0.6 0.8 1 1.20

2

4

6

8

10

User Training

FTE count

No

of re

spon

dent

s0 0.5 1 1.5 2 2.5 30123456789

10

Strategic Engagement

FTE count

No

of re

spon

dent

s

National E-Infrastructure SurveyFTE allocation breakdown

System Support

Yes No Under development0

5

10

15

20

25

30

35

40

Do you offer your own training courses?

Yes No Under Development0

5

10

15

20

25

30

35

40

Do you develop your own training materials?

National E-Infrastructure SurveyFTE allocation breakdown

System Support

Yes No Under development0

5

10

15

20

25

30

35

40

Do you offer your own training courses?

Yes No Under Development0

5

10

15

20

25

30

35

40

Do you develop your own training materials?

Already engaged No Yes0

5

10

15

20

25

30

35

Interest in shared pool of training and/or training resources?

FTE allocation breakdownSystem Support

http://etraining.esc.rl.ac.uk

<=25% 25% to 50% 50% to 75% >75%0

2

4

6

8

10

12

What proportion of your users are in self-supporting groups?

AllLargeHEI

National E-Infrastructure Survey

<=25% 25% to 50% 50% to 75% >75%0

2

4

6

8

10

12

What proportion of your users are in self-supporting groups?

AllLargeHEI

Documen

tation

Intro to

progra

mming

Linux o

rientati

on

On-boarding t

raining

Sample

scripts

etc

Sched

uler basi

cs

Targe

tted ad

vice

0

5

10

15

20

25

Help required by new users

National E-Infrastructure Survey

—Initial results received by RCUK National E-Infrastructure group— Informing roadmap for E-Infrastructure investments

—Further analysis and recommendations under development, e.g.—Critical role of HEIs in the national E-Infrastructure—Institutional funding uncertainties, staffing issues—How might we make better use of resources?—What does a well founded Research Computing team look like?—Common technical and procedural approaches, e.g. AAAI—Bring Your Own Workflow and lowering the barrier of entry

—Comments and queries?

National E-Infrastructure Survey

2014 UK NationalE-Infrastructure Survey

Jeremy Yates, DiRAC: j.a.yates@ucl.ac.ukMartin Hamilton, Jisc: m.hamilton@jisc.ac.uk

Diagram courtesy EPSRC