results of the c3s user satisfaction survey 2018 user... · target audience the purpose of the c3s...

44
Results of the C3S User Satisfaction Survey 2018 July 2018 Issued by: Copernicus User Support, ECMWF Date: 22/09/2017 REF.: C3S User Satisfaction Survey 2018 v1.docx

Upload: others

Post on 08-Aug-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Results of the C3S User Satisfaction Survey 2018 User... · Target audience The purpose of the C3S User Satisfaction Survey 2018 was to understand how satisfied C3S users are with

Results of the C3S User

Satisfaction Survey 2018

July 2018

Issued by: Copernicus User Support, ECMWF

Date: 22/09/2017

REF.: C3S User Satisfaction Survey 2018 v1.docx

Page 2: Results of the C3S User Satisfaction Survey 2018 User... · Target audience The purpose of the C3S User Satisfaction Survey 2018 was to understand how satisfied C3S users are with

Copernicus Climate Change Service

Contents

Executive Summary ............................................................................................ 2

About the survey ................................................................................................ 2

Target audience ............................................................................................... 2

The questionnaire ............................................................................................ 2

Q1: Where are you based? .................................................................................. 4

Results ........................................................................................................... 4

Recommendations ........................................................................................... 5

Q2: Which sector does your organisation belong to? ............................................... 6

Results ........................................................................................................... 6

Recommendations ........................................................................................... 6

Q3: Overall, how satisfied are you with the Copernicus Climate Change Service? ........ 7

Results ........................................................................................................... 7

Recommendations ........................................................................................... 7

Q4: How useful are the C3S products and services for you, and how satisfied are you with them? ........................................................................................................ 8

Results ........................................................................................................... 8

Recommendations ......................................................................................... 10

Q5: How useful is, and how satisfied are you with ... ............................................ 10

Results ......................................................................................................... 10

Recommendations ......................................................................................... 12

Q6: If you downloaded C3S data products using the WebAPI, how satisfied are you with the WebAPI? ............................................................................................. 13

Results ......................................................................................................... 13

Recommendations ......................................................................................... 13

Q7: How do you use C3S data? .......................................................................... 13

Results ......................................................................................................... 13

Recommendations ......................................................................................... 14

Q8: What would you like to see in the future from C3S? ........................................ 15

Results ......................................................................................................... 15

Recommendations ......................................................................................... 16

Q9: Since June 14 the C3S Climate Data Store (CDS) is available. The CDS allows everyone to access and process climate data. What are your expectations of such a tool? ............................................................................................................... 16

Annex: Summary tables and open ended comments ............................................. 17

Page 3: Results of the C3S User Satisfaction Survey 2018 User... · Target audience The purpose of the C3S User Satisfaction Survey 2018 was to understand how satisfied C3S users are with

Copernicus Climate Change Service

Executive Summary

Users of the Copernicus Climate Change Service (C3S) are overall satisfied with the service provided by C3S and rate the service with an overall 3.45 out of 4, up 0.05

from the previous year.

C3S serves a global user community: three quarters (74%) of survey participants are

based outside the European Union, and 26% in the EU. Within the EU, about 60% of participants are from only five countries (Germany, Italy, UK, Span, France). Three quarters of participants are academics and researchers, and within the EU two thirds

work in this sector, other users are equally based in the private and public sector. From 2017 to 2018 the country and sector demographics remain largely unchanged.

The utility of C3S data products and services varies significantly: climate reanalysis data, comprising the ERA5 and ERA-Interim datasets, are by far the most popular and receive the highest satisfaction ratings. Many other C3S products and services are not

well known, partly because products are still under development (seasonal forecast), or are new (European State of the Climate Report), or are of rather specialist interest

(monthly sea ice maps). Users of these products are also mostly satisfied though. The survey participants raised many ideas and suggestions for C3S, in particular related to the Climate Data Store. Many of these suggestions are already in the CDS roadmap,

indicating that C3S is well aligned with user requirements.

Users also find supporting services useful and satisfying, especially the available data

formats, data access mechanism (the ECMWF API), and the available documentation. However, the results suggest further improvements in these areas: data access should be easier for non-technical users (an issue that is already addressed with the CDS), the

C3S body of knowledge should be consolidated, and the C3S newsletter and reanalysis mailing list should be reviewed to strengthen the impact of user communications.

The demographics, usage patterns and satisfaction ratings still reflect the heritage of C3S as a science driven service. Uptake in the private and public sectors is happening, but progressing slowly.

The previous year’s survey had identified three areas for improvement: (a) the footprint of C3S in Eastern Europe (b) the value and impact of C3S in the private

sector and public administration, and (c) access to information products tailored to users’ needs. While the third item is addressed by the CDS, the other two remain.

Page 4: Results of the C3S User Satisfaction Survey 2018 User... · Target audience The purpose of the C3S User Satisfaction Survey 2018 was to understand how satisfied C3S users are with

Copernicus Climate Change Service

Report Name | 2

About the survey

Target audience

The purpose of the C3S User Satisfaction Survey 2018 was to understand how satisfied C3S users are with the services provided, to collect feedback, analyse them and help

improve C3S services.

The survey targeted all users who, in the 12 months preceding the survey, accessed

C3S data products or who interacted with Copernicus User Support, and for whom email addresses were available. This demographic comprised 19387 distinct users:

• 18418 registered users of the ERA-Interim reanalysis dataset • 2402 registered users of the ERA5 reanalysis dataset • 163 registered users of the Seasonal Forecast dataset

• 950 registered users of C3S User Support

(Many users are registered for multiple services, so the figures do not sum up.)

Most users come from the ERA-Interim user group. The ERA-Interim dataset is an ECMWF data product predating C3S, and C3S provides a technical support service for this data, hence this product is included in the survey, but the analysis focuses on

users of other datasets (ERA5 and Seasonal Forecasts).

The survey was deployed via an online questionnaire, in English, which was open

between 26th June and 17th July 2018. C3S invited all 19387 identified users by email to participate in the survey.

In total 1323 users participated (6.8% of addressed users).

For further information please contact [email protected].

The questionnaire

The following questionnaire was used:

Q1: Where are you based? (List of countries and territories)

Q2: Which sector does your organisation belong to? (Public authorities / University and Research / Commercial or private sector / International organisation or NGO /

Other)

Q3: Overall, how satisfied are you with the Copernicus Climate Change Service? (1 =

not satisfied, 4 = very satisfied)

Q4: How useful are the following C3S products and services for you, and how satisfied are you with them?

• Reanalysis data (ERA5, ERA-Interim) • Monthly temperature maps

• Monthly sea ice maps • Hydrological climate variables • Seasonal forecast data and charts

• European State of the Climate report

Q5: How useful is, and how satisfied are you with ...

Page 5: Results of the C3S User Satisfaction Survey 2018 User... · Target audience The purpose of the C3S User Satisfaction Survey 2018 was to understand how satisfied C3S users are with

Copernicus Climate Change Service

Report Name | 3

• C3S website

• Automated data download (WebAPI) • Data download portal (apps.ecmwf.int)

• Available data formats • Documentation • Knowledge base

• Helpdesk / Support • Mailing list

• Newsletter

Q6: If you downloaded C3S data products using the WebAPI, how satisfied are you with the WebAPI?

• In terms of speed: not satisfied / somewhat satisfied / mostly satisfied / very satisfied

• In terms of availability (24/7): not satisfied / somewhat satisfied / mostly satisfied / very satisfied

Q7: How do you use C3S data? I usually use…

• Variables (temperature, precipitation, wind, etc.): A single parameter or species / A few at a time / Many

• Dates: A single date / Multiple dates / Long time series • Height levels: Surface only, or a single specific model or pressure level /

Multiple model or pressure levels / All model or pressure levels

Q8: What would you like to see in the future from C3S?

• Interactive web maps

• Subset data to a specific geographical area • Time series at custom locations

• Vertical profiles at custom locations • Additional variables • More OGC services (WMS, WCS)

• More documentation • Additional data formats

• Additional Additional aggregations, e.g. daily or monthly means • Other

Q9: Since June 14 the C3S Climate Data Store (CDS) is available. The CDS allows

everyone to access and process climate data. What are your expectation of such a tool? (free text)

Q10: Do you have any other suggestions how we can improve the Copernicus Climate Change Service for you?

Page 6: Results of the C3S User Satisfaction Survey 2018 User... · Target audience The purpose of the C3S User Satisfaction Survey 2018 was to understand how satisfied C3S users are with

Copernicus Climate Change Service

Report Name | 4

Q1: Where are you based?

Results

The survey participants are

distributed across the globe, with the largest numbers in

South and East Asia (Figure 1).

26% of participants are based

in the European Union and 74% outside the EU.

From 2017 to 2018 the share

of EU-based responses decreased slightly from 30% to

28% (Table 1).

Table 1: Regional distribution of

survey participants

Figure 1: Geographical distribution of

all survey participants, where >= 1%

of total (total 1312 responses)

2017 2018

EU 384 (30%) 373 (28%)

Non-EU 914 (70%) 939 (72%)

Total 1298 (100%) 1312 (100%)

Page 7: Results of the C3S User Satisfaction Survey 2018 User... · Target audience The purpose of the C3S User Satisfaction Survey 2018 was to understand how satisfied C3S users are with

Copernicus Climate Change Service

Report Name | 5

Among EU users, most are based in Germany, Italy and the UK. The Eastern European

counties stand out as having very few users (Figure 2).

Figure 2: Geographical

distribution of EU-based survey

participants (373 responses)

Recommendations

C3S uptake is relatively high in Western Europe and still much lower in Eastern Europe. Future C3S user uptake activities should consider targeting specifically users in Eastern Europe.

Page 8: Results of the C3S User Satisfaction Survey 2018 User... · Target audience The purpose of the C3S User Satisfaction Survey 2018 was to understand how satisfied C3S users are with

Copernicus Climate Change Service

Report Name | 6

Q2: Which sector does your organisation belong to?

Results

A vast majority of survey participants (75%) work in academia and research, followed by 12% in the public sector (Figure 3). Looking only at EU-based responses we see a

slightly more even distribution, i.e. more public sector and commercial entities (Figure 4). The sectoral distributions show that the C3S products find significant uptake

among commercial and public-sector users.

The global results are very similar to the previous year’s results (Figure 5). In the EU

the user base remains to be mostly academic (Figure 6), albeit with an increase in commercial users from 13% to 15%. At the same time, public sector use decreased proportionally; potentially because the 2017 survey also included users of policy and

communications products, which were largely based in the public sector, while the 2018 survey does not include these users anymore.

Figure 3: Responses by sector, 2018, all

responses (1307 responses)

Figure 4: Responses by sector, 2018, EU

responses (373 responses)

Figure 5: Responses by sector, 2017, all

responses (1295 responses)

Figure 6: Responses by sector, 2017, EU

responses (383 responses)

Recommendations

The strong and increasing interest from the EU private sector in the C3S products is

encouraging and suggests that C3S is on track to further diversify its user base.

Page 9: Results of the C3S User Satisfaction Survey 2018 User... · Target audience The purpose of the C3S User Satisfaction Survey 2018 was to understand how satisfied C3S users are with

Copernicus Climate Change Service

Report Name | 7

Q3: Overall, how satisfied are you with the Copernicus Climate Change Service?

Results

Over 90% of survey participants give the service 3 or four stars out of four (Figure 7), indicating high utility and quality of C3S products and services. At the time of the

survey C3S primarily offered data (ERA-Interim, ERA5, some Seasonal Forecasts), so this result reflects mostly satisfaction with these datasets, and not with later developments like the Climate Data Store (CDS).

Figure 7: Overall satisfaction, all responses (697 responses)

Compared to the previous year the percentage of very satisfied users (4 stars) increased slightly (52% to 54.5%). For all answer options the percentages changed

only slightly by less than 3%.

EU-based survey participants are less satisfied than the non-EU ones (Figure 8). See

the following sections for details.

Figure 8: Overall satisfaction, EU-based users (208 responses)

Recommendations

The results indicate that current and C3S products and services are considered useful by the targeted user communities. The current service strategy appears to meet users’

needs and should be continued.

Selected comments (see annex for all

comments):

“great data sets & great service”

“There are aspects to be improved, in

terms of description of datasets and

variables available.”

Page 10: Results of the C3S User Satisfaction Survey 2018 User... · Target audience The purpose of the C3S User Satisfaction Survey 2018 was to understand how satisfied C3S users are with

Copernicus Climate Change Service

Report Name | 8

Q4: How useful are the C3S products and services for you, and how satisfied are you with them?

Results

C3S is most know for the numerical data it provides, primarily reanalysis data. Users of this data are highly satisfied with the products provided (Figure 9).

Figure 9: Utility and satisfaction with

products and services, all responses (678

responses)

At the time of the survey the C3S flagship product was the newly released ERA5 dataset.

48% of participants rate reanalysis data as essential, up from 40% from

the previous year; this shows that ERA5 meets significant demand.

In terms of satisfaction, about 90%

of users are very satisfied with reanalysis data, however, the

satisfaction rating remains identical to the 2017 survey (when only ERA-

Interim was available), indicating that users perceive the improvements of ERA5 over ERA-

Interim as marginal.

For Seasonal Forecasts in 2017 only

charts were available, and in 2018 data became available. This increased the utility rating significantly (from 39% as very useful or essential to 47%), and satisfaction improved (from 66% to 69% as very satisfied or extremely satisfied)

Notably, the European State of the Climate report is not well known, despite being launched close to the time of the survey with significant publicity.

“Overall a great service.”

“Waiting for the rest of ERA5 data to

become available, but 2008 - 2017 has

been useful do far.”

“Data download is too clunky”

Page 11: Results of the C3S User Satisfaction Survey 2018 User... · Target audience The purpose of the C3S User Satisfaction Survey 2018 was to understand how satisfied C3S users are with

Copernicus Climate Change Service

Report Name | 9

Looking only at responses from EU-based survey participants, the results and the

distributions are almost identical to the global user base (

Figure 10).

Figure 10: Utility and satisfaction with

products and services, EU-based users

(203 responses)

Page 12: Results of the C3S User Satisfaction Survey 2018 User... · Target audience The purpose of the C3S User Satisfaction Survey 2018 was to understand how satisfied C3S users are with

Copernicus Climate Change Service

Report Name | 10

Recommendations

Most survey participants require reanalysis data and are highly satisfied with the

available data. Other data products are not well known yet, however, work is ongoing to present these data on the Climate Data Store alongside ERA5, which will give these

data products more visibility. For non-data products like maps and reports, emphasis should be put on communicating these products.

User satisfaction is high for all products, and where users express dissatisfaction it is

mostly about data access mechanisms rather than the data itself. These concerns are addressed already by the Climate Data Store.

Q5: How useful is, and how satisfied are you with ...

Results

This question relates not to C3S data, but to supporting services like documentation

and communications.

Page 13: Results of the C3S User Satisfaction Survey 2018 User... · Target audience The purpose of the C3S User Satisfaction Survey 2018 was to understand how satisfied C3S users are with

Copernicus Climate Change Service

Report Name | 11

The survey participants rate

technical criteria like data formats and download mechanisms most

important. (Figure 11). This is not surprising, since the population of the survey deliberately included

only actual data users.

Satisfaction with the services is

high throughout. However, for some very important services (data download portal,

documentation, knowledge base and helpdesk) satisfaction is

relatively low.

Compared to the previous year, awareness of all supporting

services increased; for most services in the range of 5 to 10

percentage points. Satisfaction remained large unchanged.

Many of the free text comments

submitted on this question highlight performance and

availability issues with data access through the ECMWF archive. C3S expects that the C3S Climate Data

Store (CDS), a new data access platform implemented in 2018,

will resolve these issues.

Figure 11: Utility and satisfaction with supporting services, all survey participants (633 responses)

Looking only at EU-based users (Figure 12), EU users are much less aware of support services than global users. For example, 46% of EU users are unaware of the C3S

newsletter, versus only 30% of global users.

This is an unexpected result, since the support services target specifically EU users, but seem to be taken up more by global users.

“The [ERA5] product is excellent but

getting the data is kind of tough”

“Clearer documentation and its

location would be helpful. Resources

seem a bit difficult to locate at times”

Page 14: Results of the C3S User Satisfaction Survey 2018 User... · Target audience The purpose of the C3S User Satisfaction Survey 2018 was to understand how satisfied C3S users are with

Copernicus Climate Change Service

Report Name | 12

in terms of satisfaction, EU-based users are as satisfied as the global user

demographic, but only with the services they consider important. Less known services like the C3S website, newsletter

and helpdesk, receive lower satisfaction ratings.

Figure 12: Utility and satisfaction with

supporting services, EU-based survey

participants (200 responses)

Recommendations

Many C3S data users struggled to access data. C3S addressed

this issue with the launch of the Climate Data Store (CDS), and feedback on the CDS should be

evaluated with respect to ease of access.

For communications and user support services, there is scope for making the services more

relevant for users.

Page 15: Results of the C3S User Satisfaction Survey 2018 User... · Target audience The purpose of the C3S User Satisfaction Survey 2018 was to understand how satisfied C3S users are with

Copernicus Climate Change Service

Report Name | 13

Q6: If you downloaded C3S data products using the WebAPI, how satisfied are you with the WebAPI?

Results

This question relates more to user requirements than to current user satisfaction and was included to inform the evolution of the technical service infrastructure.

The WebAPI is the main method to extract and download C3S data hosted at ECMWF’s data archive MARS. In 2018/2019 the WebAPI will be replaced by a new platform, the Climate Data Store (CDS).

This question investigates users’ requirements when accessing data, to inform the move to the CDS platform.

Figure 13: Reanalysis data access patterns, all survey participants (533 responses)

While survey participants are mostly satisfied with the WebAPI, users would like data

retrieval through the WebAPI to be faster, in particular for the very large data volumes of ERA5 and Seasonal Forecasts. Additional comments highlight that data retrieval through the WebAPI is quite technical, making the use of the platform difficult for non-

technical users.

Recommendations

The new CDS data platform will offer more GUI-driven data access, resolving many usability issues. The CDS will also near-instant access to frequently used data.

However, many datasets will remain hosted in external repositories, e.g. ERA5 model level data on MARS. Emphasis should be put on speedy access to these external repositories.

Q7: How do you use C3S data?

continue here

Results

This question relates more to user requirements than to current user satisfaction and was included to inform the evolution of the technical service infrastructure.

Page 16: Results of the C3S User Satisfaction Survey 2018 User... · Target audience The purpose of the C3S User Satisfaction Survey 2018 was to understand how satisfied C3S users are with

Copernicus Climate Change Service

Report Name | 14

Among all survey participants an overwhelming majority (68%) works with time series

data (Figure 14), again reflecting the dominance of reanalysis users in the survey population.

The survey highlights that the typical C3S data user is interested in time series of multiple variables as 2-diemsional surfaces. This pattern was already present in 2017 and is even clearer in 2018.

Figure 14: Reanalysis data access patterns, all survey participants (612 responses)

The same pattern shows for EU-based survey participants, with an even clearer

emphasis on time series and 2-d surfaces.

Recommendations

The share of model level data is decreasing and the share of 2-d surface data is increasing; this indicates user uptake up in non-meteorological domains. The new CDS

platform already prioritises ease of access to 2-d surface data. Efforts to support non-meteorological users further should continue.

Page 17: Results of the C3S User Satisfaction Survey 2018 User... · Target audience The purpose of the C3S User Satisfaction Survey 2018 was to understand how satisfied C3S users are with

Copernicus Climate Change Service

Report Name | 15

Q8: What would you like to see in the future from C3S?

Results

Among the survey population there is a strong demand for tools beyond the raw data retrieval, i.e. for

tools to extract data for custom time series, specific locations, and for vertical profiles (

Figure 15). Still, most users want to access actual data, rather than visualisations only.

The answer option “additional aggregations” caters for the fact that on the ECMWF

WebAPI platform monthly aggregations were available, while the new CDS platform does not offer such aggregations yet. The survey result shows that a majority of users consider such aggregations very important.

Comments highlight further demand specifically for non-specialist data formats like ASCII/CSV/Excel.

Figure 15: Feature wish list, all survey participants (750 responses)

The 2017 survey had highlighted demand for additional documentation. Subsequently

additions were made, primarily to the Knowledge Base. This seems to have satisfied this demand, however, the available documentation is now perceived as dispersed and

lacking structure.

For all other answer options the results remain largely unchanged from the 2017 survey.

“It's already nice to have NetCDF

format!!!.”

“Annual aggregations.”

“Data in a commonly used formats

(e.g. in Excel, .txt) would be more

useful.”

“simple x-y-z data for temperature,

pressure etc. with a typical surface

mesh or simple to use conversion

tool”

“The documentation is complete but

quite hard to navigate”

“Not necessarily more

documentation, but better

documentation.”

Page 18: Results of the C3S User Satisfaction Survey 2018 User... · Target audience The purpose of the C3S User Satisfaction Survey 2018 was to understand how satisfied C3S users are with

Copernicus Climate Change Service

Report Name | 16

The wish list of EU-based survey participants (Figure 16) is similar to the global

demographics’ list, but the global user base is more demanding, rating currently unavailable services as more important. EU-based users by comparison are more

content with the current service offerings.

Figure 16: Feature wish list, EU-based survey participants (180 responses)

Recommendations

The CDS should consider offering ready-made aggregations by month, year and

decade.

Documentation from the C3S website, C3S knowledge base, CDS pages should be consolidated and quality controlled.

The CDS tools for online processing and visualisation already exist, and emphasis should be put on good documentation.

C3S products and services should provide data in GRIB, NetCDF and ASCII formats.

Q9: Since June 14 the C3S Climate Data Store (CDS) is available. The CDS allows everyone to access and process climate data. What are your expectations of such a tool?

This is an open question. Survey participants’ answers cover a wide range of use cases, ranging from simple pre-made visualisations to Platform-as-a-Service offerings with

integrated online development environments and seamless access to a variety of data products. Prospective users range from policy-makers to climate scientists and software developers. No clear picture of user requirements emerges. See the annex for

full responses.

“Please, provide the long-term

projections (CMIP5, CORDEX, etc.)

soon.”

“More detailed explanations of

variables an, procedures in different

languages for layman, policy

makers”

“It would be fantastic if it would be

possible to make calculations

directly on your computational

infrastructure and then only

download results.”

“Please provide simpler

documentation”

“Enhance user interaction! Too

many potential users do simply not

know about available

services/data!”

Page 19: Results of the C3S User Satisfaction Survey 2018 User... · Target audience The purpose of the C3S User Satisfaction Survey 2018 was to understand how satisfied C3S users are with

Copernicus Climate Change Service

Report Name | 17

Annex: Summary tables and open ended comments

Q1. Where are you based?

Territories with <3 responses are excluded for anonymity

Answer Choices % of total Responses

India 11.66% 153

China 9.07% 119

Indonesia 7.16% 94

United States of America 6.40% 84

Germany 5.03% 66

Brazil 3.81% 50

Italy 3.73% 49

United Kingdom 3.66% 48

Spain 3.05% 40

France 2.82% 37

Republic of Korea 2.36% 31

Russian Federation 1.91% 25

Iran (Islamic Republic of) 1.83% 24

Netherlands 1.83% 24

Taiwan 1.75% 23

Canada 1.68% 22

Colombia 1.68% 22

Japan 1.37% 18

Portugal 1.30% 17

Greece 1.22% 16

Nigeria 1.22% 16

Vietnam 1.07% 14

Ghana 0.99% 13

Peru 0.91% 12

Australia 0.84% 11

Chile 0.84% 11

Norway 0.84% 11

Pakistan 0.84% 11

Turkey 0.84% 11

Argentina 0.76% 10

Egypt 0.69% 9

Sweden 0.69% 9

Austria 0.61% 8

Mexico 0.61% 8

Algeria 0.53% 7

Belgium 0.53% 7

Czech Republic 0.53% 7

Page 20: Results of the C3S User Satisfaction Survey 2018 User... · Target audience The purpose of the C3S User Satisfaction Survey 2018 was to understand how satisfied C3S users are with

Copernicus Climate Change Service

Report Name | 18

Hungary 0.53% 7

Malaysia 0.53% 7

Switzerland 0.53% 7

Bangladesh 0.46% 6

Finland 0.46% 6

Côte d'Ivoire 0.38% 5

Denmark 0.38% 5

Kenya 0.38% 5

Morocco 0.38% 5

New Zealand 0.38% 5

Poland 0.38% 5

Romania 0.38% 5

Thailand 0.38% 5

Cameroon 0.30% 4

Serbia 0.30% 4

South Africa 0.30% 4

Tunisia 0.30% 4

Belarus 0.23% 3

Bulgaria 0.23% 3

Ethiopia 0.23% 3

Iceland 0.23% 3

Ireland 0.23% 3

Latvia 0.23% 3

Madagascar 0.23% 3

Nepal 0.23% 3

Philippines 0.23% 3

Singapore 0.23% 3

Ukraine 0.23% 3

United Arab Emirates 0.23% 3

United Republic of Tanzania 0.23% 3

Other 3.67% 47

Answered: 1312, Skipped: 11

Q2. Which sector does your organisation belong to?

Answer Choices % of total Responses

Public authorities (European, National or local) 12.09% 158

University and Research 74.75% 977

Commercial or private sector 7.96% 104

International organisation, NGO 1.68% 22

Other (please specify) 3.52% 46

Answered: 1307, Skipped: 16

Page 21: Results of the C3S User Satisfaction Survey 2018 User... · Target audience The purpose of the C3S User Satisfaction Survey 2018 was to understand how satisfied C3S users are with

Copernicus Climate Change Service

Report Name | 19

Q3. Overall, how satisfied are you with the Copernicus Climate Change Service?

Rating,

1 to 4,

higher is

better

1

(not satisfied)

2

(somewhat

satisfied)

3

(mostly satisfied)

4

(very satisfied)

Total

Responses % of

total

Responses % of

total

Responses % of

total

Responses % of

total

Responses Responses Weighted

Average

1.43% 10 6.17% 43 37.88% 264 54.52% 380 697 3.45

Answered: 697, Skipped: 626

Comments:

1. OK

2. I am finding it difficult to find climate reanalysis data. Seems things are split between Copernicus and ECMWF

site.

3. Problems downloading data manually, the key is only valid for one year and I do not know what to do after this

time if I need to download data after this time.

4. I think I had to make an account for this for my studies once but I honestly do not remember using it.

5. I have heard of this service but never used it.

6. I do not undertake climate studies. My research work involves field measurements requiring use of ERA-

Interim products not C3S. So it is difficult for me to give a meaningful assessment of the climate products

7. I haven't use the services yet. Just creating an account.

8. the data is so good for practice in mapping class

9. Never used it until now

10. the network connection from China is limited

11. its is very useful for me but the download speed is very slow

12. I don’t know

13. Sad, we cant select different months of ERRA INTERIM datasets as we used to do earlier for download.

14. I have had trouble getting data using the new format. I often find myself in what seems to be an endless loop.

I may not have read the readme well enough but I have found it difficult to the point I dropped it because I

was too busy with other things. In the past getting the ECMWF reanalysis was pretty easy. So I may just need

to learn the new intuition. Do you have short videos as tutorials? That with a screen capture using software like

Camtasia is an efficient way to train users.

15. Great service

16. It was unable to provide any assistance in the area I was interested in - the ET from crops and pastures.

17. Request and download is easier with the python scripts provided. It is the best technique I have ever seen

from data providers. Good job!

18. Needs faster download speeds to be more useful

19. "We would prefer at least can access to the original resolution of the seasonal forecast models. It would be

very useful for us to implement another funtions as downscalling methods. Nevertheless, I personaly think that

Copernicus will be very usefull to service sector."

20. I

21. I think the database should be refreshed in time.

22. great data sets & great service, but would appreciate the option to download larger data sets (multiple years)

in one batch job

23. Responses are quicker but the quality of the response is worse. The request seems to be not read thoroughly.

Links to the documentation are sent quickly and more than once, but do not answer the question.

24. There are aspects to be improved, in terms of description of datasets and variables available.

Page 22: Results of the C3S User Satisfaction Survey 2018 User... · Target audience The purpose of the C3S User Satisfaction Survey 2018 was to understand how satisfied C3S users are with

Copernicus Climate Change Service

Report Name | 20

Q4. How useful are the following C3S products and services for you, and how satisfied are you

with them?

How useful

Am not aware of

it

Irrelevant Somewhat

useful

Very useful Essential Total

% of

total

Respon

ses

% of

total

Respon

ses

% of

total

Respon

ses

% of

total

Respon

ses

% of

total

Respon

ses

Respon

ses

Reanalysis

data (ERA5,

ERA-Interim)

1.79

%

12 0.00

%

0 3.88

%

26 48.66

%

326 45.67

%

306 670

Monthly

temperature

maps

21.89

%

125 7.88

%

45 22.07

%

126 37.83

%

216 10.33

%

59 571

Monthly sea

ice maps

33.64

%

181 18.77

%

101 19.33

%

104 21.56

%

116 6.69

%

36 538

Seasonal

forecast data

and charts

26.28

%

144 9.67

%

53 18.07

%

99 34.67

%

190 11.31

%

62 548

European

State of the

Climate report

22.10

%

122 11.78

%

65 19.57

%

108 33.51

%

185 13.04

%

72 552

Answered: 678, Skipped: 645

How satisfied

Not satisfied at all Somewhat satisfied Very satisfied Extremely satisfied Total

% of total Respo

nses

% of total Respo

nses

% of total Respo

nses

% of total Respo

nses

Responses

Reanalysis data

(Era-Interim)

1.57% 10 10.38% 66 62.58% 398 25.47% 162 636

Monthly

temperature maps

1.50% 6 23.69% 95 62.34% 250 12.47% 50 401

Monthly sea ice

maps

6.19% 20 37.15% 120 44.89% 145 11.76% 38 323

Seasonal forecast

charts

2.78% 10 29.44% 106 55.56% 200 12.22% 44 360

European State of

the Climate report

4.56% 17 25.20% 94 57.91% 216 12.33% 46 373

Answered: 678, Skipped: 645

Comments:

1. Backwards extension of ERA5 is needed

2. Recently it is not possible to download reanalysis data for more than one month. In some cases if you need

download for example U10 and V10 wind speed for 10 years, you should spend long time to define region, set

resolution, ... 120 times. It's really annoying!

3. I don't appreciate your initial premise that I somewhat believe in the fraudulent notion of climate change by

emissions. Your own data actually prove the opposite.

4. it is difficult to download ERA-Interim Daily data just for 1 mounts in each step.

Page 23: Results of the C3S User Satisfaction Survey 2018 User... · Target audience The purpose of the C3S User Satisfaction Survey 2018 was to understand how satisfied C3S users are with

Copernicus Climate Change Service

Report Name | 21

5. OK

6. ERA5 has quite a bootleneck/waiting time with respect to requests made through the API

7. "My main interest is in the climate reanalysis data. I am experimenting in my karmapi project fitting hidden

Markov models to this data. The goal is to create climate conditioned natural hazard event sets which give a

better model for the next 5, 10 or 25 years than the existing models used in the insurance industry"

8. Sea ice maps sound interesting! ERA-Interim is always a few months behind, which limits its use.

9. i just use ERA-interim

10. Now is difficult to extract data "Reanalysis data (ERA5, ERA-Interim)" from the webpage protocol. One can

only select one month each time, which makes this service pointless. It was OK before!

11. I use frequently reanalyzed data and it is quite useful in my work and research. But changes in the way to

access to the data are quite disturbing. Same comment to changes in the web. Quite often it is difficult to know

what data is accesible through the web if you do not know that it is there and what you have to look for.

12. Since the upload of ERA 5 is not completed, we used part of it from MARS

13. still just use that one

14. The climate change study for developing countries is very useful to privet drought and flood prediction

15. 10 day forecasts for ERA5 desirable

16. "The recent changes in downloading of ERA-interim Re-analysis is very laborious excerise and it was better in

past. "

17. I need water current (tide, circulation, everything) data!!!

18. the network connection from China is limited

19. na

20. I am trying to use grib2 data for a lecture. Havent been able to convert the data into something I can work

with (3d float array)

21. Please allow us to select multiple months , when we select one month say June, and we try to select July, June

gets deselected. Indeed sad.

22. Data download is too clunky and python scripts that worked a year ago stopped working.

23. It is very helpful to have a single accessible source for reanalysis data that will cover the entire globe.

24. Waiting for the rest of ERA5 data to become available, but 2008 - 2017 has been useful do far.

25. I mainly use ERA5 and ERA-interim data

26. Good

27. I understand that Era-5 offers a revised version of dataset than Era Interim, however we are not able to use

this facility due to technical difficulties.

28. My interest is water management based on the ET from crops and pastures. I could not find this data.

29. In general, all the maps and charts might be improved adding a sort of interaction (possibility to zoom for

example)

30. I got cryptic errors trying to read the ERA5 data, and I'm not really interested in hourly data. For precipitation,

I want 24-hr totals.

31. It would be really useful to have the ERA 5 updated on daily basis.

32. overall a great service.

Page 24: Results of the C3S User Satisfaction Survey 2018 User... · Target audience The purpose of the C3S User Satisfaction Survey 2018 was to understand how satisfied C3S users are with

Copernicus Climate Change Service

Report Name | 22

Q5. How useful is, and how satisfied are you with ...

How useful

Am not aware

of it

Irrelevant Somewhat useful Very useful Essential Total

% of

total

Respo

nses

% of

total

Respo

nses

% of

total

Respon

ses

% of

total

Respo

nses

% of

total

Respo

nses

C3S website 15.87

%

86 2.58

%

14 18.08

%

98 51.48

%

279 11.99

%

65 542

Automated data

download (WebAPI)

12.10

%

68 2.31

%

13 13.17

%

74 44.31

%

249 28.11

%

158 562

Data download portal

(apps.ecmwf.int)

4.80

%

28 1.03

%

6 14.92

%

87 49.74

%

290 29.50

%

172 583

Available data

formats

2.26

%

13 0.69

%

4 9.55% 55 58.51

%

337 28.99

%

167 576

Documentation 3.39

%

19 0.89

%

5 18.36

%

103 48.13

%

270 29.23

%

164 561

Knowledge base 15.06

%

78 2.32

%

12 21.04

%

109 44.40

%

230 17.18

%

89 518

Helpdesk / Support 19.22

%

98 6.08

%

31 20.98

%

107 35.49

%

181 18.24

%

93 510

Mailing list 25.75

%

128 7.85

%

39 23.94

%

119 33.00

%

164 9.46

%

47 497

Newsletter 29.82

%

147 9.13

%

45 26.17

%

129 26.98

%

133 7.91

%

39 493

Answered: 633, Skipped: 690

How satisfied

Not satisfied at all Somewhat satisfied Very satisfied Extremely satisfied Total

% of

total

Respon

ses

% of

total

Respon

ses

% of

total

Respo

nses

% of

total

Respons

es

Respons

es

C3S website 4.25% 18 29.95% 127 54.72% 232 11.08% 47 424

Automated data

download (WebAPI)

6.32% 29 24.40% 112 47.28% 217 22.00% 101 459

Data download portal

(apps.ecmwf.int)

5.15% 26 22.77% 115 52.87% 267 19.21% 97 505

Available data

formats

1.78% 9 15.58% 79 58.58% 297 24.06% 122 507

Documentation 4.32% 21 28.81% 140 54.53% 265 12.35% 60 486

Knowledge base 3.00% 12 29.25% 117 58.50% 234 9.25% 37 400

Helpdesk / Support 5.12% 19 29.38% 109 49.60% 184 15.90% 59 371

Mailing list 4.97% 16 34.16% 110 49.38% 159 11.49% 37 322

Newsletter 5.54% 17 37.79% 116 44.63% 137 12.05% 37 307

Answered: 633, Skipped: 690

Comments:

Page 25: Results of the C3S User Satisfaction Survey 2018 User... · Target audience The purpose of the C3S User Satisfaction Survey 2018 was to understand how satisfied C3S users are with

Copernicus Climate Change Service

Report Name | 23

1. Reanalysis model level data in model levels difficult to interpret since vertical coordinate information is not

included. Copying this information from a documentation website or from files in GRIB format is unnecessary

hassle.

2. WebAPI is nice. Personally I would love to download data in R instead of Python. Maybe there is a way I'm not

aware of, but in the web documentation I only read about the Python interface.

3. Focus on transparent data delivery, not irreproducible climate change agendas

4. Some time the is more that several days delay to receive or respond from Mailing list.

5. all ok

6. it is no longer possible to download more than one month of ERA-Interim data at a time and this makes it very

tedious to download, nor is it possible to download surface and pressure level data at the same time

7. More accesible documentation on the units of the variables and how to transform them in more common units

is needed.

8. "Search on the site is not working well. For instance, go to Copernicus and search for ""mailing list"": no

results. In short, there is lots of great data here, but finding your way around the site is difficult. Insisting on

registration and keys to download data dramatically reduces the number of people that look at the data. If

bandwidth costs are a concern, then lets talk about decentralised ways to share the costs of hosting and

distributing this data."

9. The data download portal changed somewhat recently and the change was not good. Prior to the change, users

were able to easily specify a range of dates and times over which to download data. To my knowledge, this is

no longer possible via the download portal, and users must instead select one month at a time. I now have

become used to the python code that is provided to download many years of data, but it was nice to have

another option. Researchers in my department, who seek to use ERA-interim data for the first time, find it

difficult and time consuming to learn/setup the python code. It would be better to have an option via the

download portal that is equally fast, especially for first-time, and possibly one-time users.

10. We only use the python WebAPI.

11. the download website (for ERA-Interim, etc.) is not very convenient if you wanna download some field for the

whole time series, say, 1979-present. I recall that you have to manually click each year, which is very tedious.

12. Recently the download portal changed so that we could only select one month of data at a time. It would be

useful to have the previous choice of multiple months but single level also available so that I can pick data

more directly from the download portal rather than always have to use the WebAPI

13. Data resolution not finer than 0.125 ' and i need a finer resolution of ~ 30 seconds

14. i cant download a historical information in only one data base anymore!

15. Now is difficult to extract data "Reanalysis data (ERA5, ERA-Interim)" from the webpage protocol. One can

only select one month each time, which makes this service pointless. It was OK before!

16. Very often it is difficult to download the data one needs.

17. "The motu Client Download is often clunky and does not work. The website is very slow, cluttered, hard to

navigate and also does not work on safari (Mac). The ECWMF retrieval service is a great example how how it

should be done, where it’s easy to access the data, choose to download just one time step or an entire dataset,

choose output grid, and file format. At the moment, I only use the Copernicus download service if I can’t find

the data anywhere else."

18. ECMWF data download is very essential

19. "Teh reanalysis data download seems to be cubersome process and can be made easier to facalitate multiple

time simultaneous downloads. The automated data download facality seems to be performing above task, but

may be a video describing step-by step procedure can be more helpul."

20. the network connection from China is limited

21. na

22. Lately, I have a difficulty to download the ERA data as I should click one-by-one without user-friendly interface

23. Recently I have faced an error while downloading big data (below the upper limit). Is there any server problem

, or anything to do with internet connection of the user? I would be happy if you kindly share some details or

can give some insight about how to download large data.

Page 26: Results of the C3S User Satisfaction Survey 2018 User... · Target audience The purpose of the C3S User Satisfaction Survey 2018 was to understand how satisfied C3S users are with

Copernicus Climate Change Service

Report Name | 24

24. I think there is a bit confusing in selecting grid while downloading in netcdf format also quite confusing in

selecting the parameter for python script as we have to put number to specify parameter however the

automatic script development system is very useful i really want to appreciate that system.

25. Data download is too clunky and python scripts that worked a year ago stopped working.

26. I find the website challenging to navigate, but I have always been able to find what I am looking for. The

webAPI has been fairly reliable, just a few hiccups now and then. The docuementation is good, I find it difficult

to determine what data period is currently available for download though.

27. There is some problems with dates within the grb files.

28. "clearer documentation and its location would be helpfull. Resources seem a bit difficult to locate at times"

29. Good

30. The new climate shop interface is extremely confusing.

31. The documentation of specific variables of reanalyses and the observation feedback files is sometimes quite

opaque. For example, choosing "step" or "number" from CERA-20C in the WebAPI interface has no

explanation; time step and ensemble member number? Some atmospheric variables are similarly not well

explained.

32. It was clear when I tested the tiny amount of data that was available (the areas irrigated) against local maps it

was obvious that it was so inaccurate that it was totally useless.

33. "The documentation is difficult to find. The errors and uncertainties are not documented."

34. The old way of downloading the data from the ERAINT web page (click and select with option of choosing many

years) was much better than the present solution. The python scripts sometimes work and sometimes don't -

the error messsages are cryptic. The units for precipitation is always ambiguous from the ECMWF, since they

have been "m" or "mm" but don't specify the period over which they have been accumulated.

35. The download speed through the API is abysmally slow. For instance, the download speed was approximately 8

Mbs. I contacted the dev team last year and they are aware of this, but am not aware if this has improved.

36. My dissatisfaction with the CS3 website and WebAPI stems from the fairly recent implementation of only being

able to download reanalysis data via Python scripts; I was greatly satisfied when I could simply pick variables

off of your CS3 website, select times, etc., and then get a downloadable netCDF file. I am primarily a Matlab

user, and to have to construct the Python scripts now required makes this very difficult for me.

37. In case of ERA5, the volume problem is not really solved. The product is excellent but getting the data is kind

of tough. For the WebAPI: The error handling and a continuation option after connection interrupts would be

helpful.

38. I have not used this

39. Previously, you could select all the data at different times, i.e. months and just download. Now you have to

download month by which wastes time. Unless, I am missing something, it is time wasting now.

40. Information when new ERA5 periods are available would be usefull to take it into account in project activities

41. "Sometimes difficult to find information needed on the website. Overall, tips on troubleshooting were useful,

once directed to these by the help desk. "

42. "Having trouble getting the CDS api to work, not sure if this is a problem with our internal proxy settings. I find

mailing list / newsletter a bit too reactive."

Q6: If you downloaded C3S data products using the WebAPI, how satisfied are you with the

WebAPI?

not satisfied somewhat satisfied mostly satisfied very satisfied Total

Responses % of

total

Responses % of total Respon

ses

% of

total

Respon

ses

% of

total

Respon

ses

Responses

In terms of speed 7.52

%

40 25.19% 134 43.42

%

231 23.87

%

127 532

In terms of

availability (24/7)

3.41

%

18 15.34% 81 44.32

%

234 36.93

%

195 528

Page 27: Results of the C3S User Satisfaction Survey 2018 User... · Target audience The purpose of the C3S User Satisfaction Survey 2018 was to understand how satisfied C3S users are with

Copernicus Climate Change Service

Report Name | 25

Answered: 772, Skipped: 526

Comments:

1. ERA-Interim usually fast, but tedious for ERA5, CERA20C

2. Are you hoping to use this data source to propagandize about climate change? Your credibility is shot and I

can hardly trust any of your products as a result.

3. When to download the longterm data, it takes more than several months.

4. haven't

5. Obtaining theta on 2PVU surface (ERA-interim) is much much slower than Z500. Users should be notified about

this.

6. Sometimes very slow to get the response to the requests

7. python web-api essential. download times were sometimes slow

8. Much prefer the python API to download data: that allows download of data to be automated, which is

essential if time is not going to be wasted working with clunky web interfaces.

9. Once the download starts, it is fast enough but sometimes the wait can be a bit long. Not a big concern

though.

10. not use webAPI

11. Now is difficult to extract data "Reanalysis data (ERA5, ERA-Interim)" from the webpage protocol. One can

only select one month each time, which makes this service pointless. It was OK before!

12. I have not used it

13. With respect to ERA-Interim

14. "at some days, even downloading one GCM in terms of 5 variables casted over 2 days."

15. the network connection from China is limited

16. Having trouble to use python for downloading

17. never done it before

18. I have not used the WebAPI yet。

19. Good

20. in terms of speed : our internet connexion is very bad

21. API calls are slow to process seasonal climate forecast model output data.

22. Large variance in retrieval time make it hard to estimate total download time and project planning.

23. Knowing how to change scripts for Web API is hard. Maybe a tutorial and a better description of variables

would be useful

24. I don't think I have used WebAPI

25. Again too slow.

26. See comments in question #5

27. Many different and difficult to meet restrictions on number of parallel downloads, per user, via WebAPI...

28. Can be slow sometimes (in terms of how long a job is queued)

29. The downlodad is not stable, sometimes the queue time is too long.

30. Tend to use access to mars via ecaccess

31. Have had difficulty extracting on occasion (sometimes due to python updates required), but overall normally

find there are good speeds and availability.

32. More python support would be useful. Seems not to work sometimes, when same script has worked before

with CERA and can use the APi with ERA-I

Page 28: Results of the C3S User Satisfaction Survey 2018 User... · Target audience The purpose of the C3S User Satisfaction Survey 2018 was to understand how satisfied C3S users are with

Copernicus Climate Change Service

Report Name | 26

Q7. How do you use C3S data??

Parameters:

I usually

download ...

A single parameter A few at a time Many Total

% of total Responses % of total Responses % of total Responses Responses

13.58% 83 39.61% 242 46.81% 286 611

Dates:

I usually

download ...

A single date Multiple dates Long time series Total

% of total Responses % of total Responses % of total Responses Responses

3.74% 22 28.74% 169 67.52% 397 588

Height

levels:

I usually

download ...

Surface only, or a single

specific model or pressure

level

Multiple model or pressure

levels

All model or pressure

levels

Total

% of total Responses % of total Responses % of total Responses Responses

37.48% 208 38.56% 214 23.96% 133 555

Answered: 612, Skipped: 711

Q8. What would you like to see in the future from C3S?

Not important Nice-to-have Important Very important Total Weighted

Average

% of

total

Respo

nses

% of

total

Respo

nses

% of

total

Respo

nses

% of

total

Respo

nses

Respon

ses

Interactive web maps 7.68% 44 39.62% 227 32.64% 187 20.07% 115 573 2.65

Subset data to a

specific geographical

area

4.70% 27 20.87% 120 36.87% 212 37.57% 216 575 3.07

Time series at custom

locations

3.97% 23 23.32% 135 35.75% 207 36.96% 214 579 3.06

Vertical profiles at

custom locations

7.96% 45 29.73% 168 32.92% 186 29.38% 166 565 2.84

Additional variables 26.52% 131 30.36% 150 26.72% 132 16.40% 81 494 2.33

More OGC services

(WMS, WCS)

19.92% 98 39.84% 196 27.03% 133 13.21% 65 492 2.34

More documentation 14.95% 77 31.26% 161 34.17% 176 19.61% 101 515 2.58

Additional data formats 33.27% 169 28.15% 143 25.20% 128 13.39% 68 508 2.19

Additional

aggregations, e.g.

daily or monthly

means

21.24% 110 26.25% 136 29.73% 154 22.78% 118 518 2.54

Answered: 596, Skipped: 727

Comments:

1. it would be good to have the equivalents of diffuse and direct radiation. As far as I know only ssrd, which is

similar to global solar radiation is available/ There are plenty of concepts that are not very clear for scientist

that are not meteorologists. Further explanation of common concepts (think for example of basic stuff such

as what exactly is an analysis and what is a forecast explained with easy words) may help to spread the

use of the CS3 data.

2. It's already nice to have NetCDF format!!!

Page 29: Results of the C3S User Satisfaction Survey 2018 User... · Target audience The purpose of the C3S User Satisfaction Survey 2018 was to understand how satisfied C3S users are with

Copernicus Climate Change Service

Report Name | 27

3. Monthly means are certainly useful for most parameters and levels.

4. Seasonal daily means over 10/20/30 years for different pressure levels.

5. Additional variables: fog fraction, lightning, relative humidity

6. Aggregated or averaged values would allow faster download process, while at the same time directly

providing post-processed values

7. I can't find the information about the produce process of data.

8. Data in a Commonly used formats (e.g. in Excel, .txt) would be more useful

9. additional data formats: CSV

10. If ew can use data in NetCDF, it will be useful.

11. Additional variables: 2-meter Relative Humidity (It does not exit at reanalysis parameter set).

12. you should provide a FULL ATMOSPHERE INTEGRATION of all variables possible. See UCAR for

examples.https://climatedataguide.ucar.edu/

13. It is better to include txt or bin format for users in other fields.

14. windhsear would be nice to have into analysis at the ensemble mean

15. "Sea Surface Temperature, Sea Surface Salinity are important data for oceanography.hourly data is very

useful."

16. grib

17. "Variable: instantaneous rain rate, in addition to accumulated rainfall?? Also, for other similar accumulated

variable. Documentation: still a bit confused with different new words - ""mars request"", ""ecmwfapi"".

Description of different model seems to be put in different places? Would be good to have a chart summary

and link to every page."

18. Daily mean and month mean would be nice. Additional variables can be asked individually. Current

documentation are enough.

19. Everything is very important

20. "Monthly and yearly means derived from daily parameters. Daily parameters for ERA-Interim instead of 6

hourly"

21. Other parameters that are useful, and exist to a certain extent, are stability (CAPE or PBL) and icing rates.

However, I have had a hard time correlating these variables to on-site measurements and will need to

invest more time into a reliable process.

22. "At this point I do not know which variables are most useful for the ideas I have in mind. My initial

experiments will use precipitation and temperature data. If the software and techniques prove useful then

adding more variables would be a natural thing to do."

23. "With regard to additional variables, I think it would be good to provide the contribution that horizontal

diffusion has on the budget equations in the reanalysis products. It would also be good to provide the

vertical temperature advection term in eta-coordinates. For that matter, it may be good to have eta-dot

available for long timeseries (1979 - present) on model levels. It is not as useful to have omega available

on model levels as it is to have eta-dot since, in eta-coordinates, eta-dot is relevant for vertical advection of

any particular quantity. Omega is not relevant for vertical advection in eta-coordinates. The only use of

omega in eta-coordinates that I can think of is when considering adiabatic warming, which is important, but

only for the thermodynamic equation. I think it should be possible to close any budget diagnostically using

reanalysis data. This includes (at least) the momentum, water, mass and thermodynamic equations.

Regarding the documentation. I think that the documentation is very good as it is, but it is hard to imagine

that adding more documentation would be a bad thing. Also, it is a bit difficult to find some of these

documents for ERA-interim. Had it not been for the help desk, I would not have found the documents that I

needed. It may be good to have the documentation appear more prominently on the websites."

24. Visibility at sea in ERA-Interim would be useful.

25. Convective inhibition

26. Annual aggregations.

27. Some specific variables eg max and min temperature and the bioclimatic variables at finer resolution.

Besides, the precipitation and soil moisture data in era-interim dataset always give me zeros at my study

locations.

Page 30: Results of the C3S User Satisfaction Survey 2018 User... · Target audience The purpose of the C3S User Satisfaction Survey 2018 was to understand how satisfied C3S users are with

Copernicus Climate Change Service

Report Name | 28

28. multiple historical download

29. The documentation is complete but quite hard to navigate

30. Means over user-defined periods (day, 5 days, 10 days, month, ...) would be nice.

31. Now is difficult to extract data "Reanalysis data (ERA5, ERA-Interim)" from the webpage protocol. One can

only select one month each time, which makes this service pointless. It was OK before!

32. much more gis formats.

33. Data formats: grib2 is extremmely slow to work with in python if you deal with large datasets. Other format

would be preferred (I transform grib2 into plain txt tables)

34. Monthly mean hourly files would be good to have to look into the diurnal cycle; available variables and data

formats are good enough for my purposes.

35. Hdf5

36. I do not use the service

37. documentation on the eccodes installation

38. more detailed documentation for some variables and their respective code (e.g. for batch downloading via

python) could be useful. I am not a professional, and sometimes I find the names of variables quite similar

and confusing.

39. "introduction material, c3s for beginners; daily and monthly means"

40. I am not sure if possible, but e.g. I would like to see radiation data for ERA-Interim forecast time = 0...

41. Sometimes extra info was difficult to find

42. Documentation: where can I find a documentation of studies on verification of ERA5 data.

43. Documentation is growing soon, but it is complex to find the timestep, resolution, etc. for each variable,

44. "In terms of documentation, it would be nice to have a more comprehensive description of ERA5, including

a summary of IFS changes compared to the version of IFS used for ERA-Interim. Data formats: Zarr"

45. Additional variables: wind speed forecast

46. For era intrim data allow us to download multiple months data in a single file

47. "short videos to facalitate subsetting and automated downloads would be nice featur."

48. csv

49. Data in NetCDF Format would be nice

50. "More surface variables. Daily or monthly means. More documentation (especially regarding new variables

...)"

51. "-more documentation on retrival tools with examples. additional aggregations: daily, weekly, monthly"

52. "I am facing speed issue with ERA5 retrieval. If daily averages are made available that will be very helpful."

53. would like to see in detail which QC-ed databases were used in data assimilation to provide the output of

the reanalysis project

54. hourly to monthly means

55. Kml, shape

56. Total daily precipitation analysis

57. VPD,

58. Please add txt, csv, formats to your dataseries

59. wind direction, more documentation how to download correctly data and process it (I had to rely on

collegues who know how to do it).

60. it will be extremely helpful if we can get sea and swell characteristics of surface waves separately

61. Additional variable - surface wind-stress.

62. Sufficient data is provided and there is no problem in my use.

63. simple x-y-z data for temperature, pressure etc. with a typical surface mesh or simple to use conversion

tool

64. I think the parameter available in era5 is not sufficient in case of pressure levels as there is not potential

temperature, equivalnet potential temperature, moisture flux integrated moisture flux convergence and

divergence and other parameters should be added which we can find in other datasets.

Page 31: Results of the C3S User Satisfaction Survey 2018 User... · Target audience The purpose of the C3S User Satisfaction Survey 2018 was to understand how satisfied C3S users are with

Copernicus Climate Change Service

Report Name | 29

65. Yearly will be nice

66. Moist static energy and cape

67. Additional variables could include spectra wave data.

68. "I have been working with ERA5 data and, at least 1 year ago, it was the case that at 2m level you could

only have either relative humidity or dewpoint temperature (I do not remember which), but not both. I

think this was also the case for daily maximum and minimum temperature. It would be nice for all variables

to be available at all standard and model levels (of course, knowing that some of them are offline

estimates, and not direct model outputs). Documentation of this would be important. Generally, the more

documentation the users have on both technical aspects related to the products (e.g., for maps/graphs,

exact definitions of the variables provided, especially in terms of probabilities in probabilistic seasonal

forecasts) AND expert knowledge on the products themselves (e.g., if certain systematic biases/large

uncertainties are already known about certain products in certain regions and/or certain times of the

year/day, it would be fantastic to have a summary of this, as it is critical information for users). Results of

intercomparison studies (including C3S and outside-C3S climate products) would be extremely useful as

well, so that users can make informed decisions/commentary on the products they use. Daily aggregations

are essential and, at least as of last year, were missing. "

69. daily or monthly very useful

70. More wave parameters such as directional spreading, peak wave direction, swell components

71. More documentation on eccodes (python interface)

72. It is better to provide another data format such as tif, grid or asci

73. "Additional variables - wind direction/speed. daily means of variables"

74. Good

75. In think the verticle profile, time series at perticuler geographical area or location has to be given.

76. Turubulence in some form

77. The more, the better !

78. the interactive maps is most important, I hope we can meet it in the near future.

79. sea level data

80. Among the additional dataset I would prefer to have gridded precipitation isotope data at multiple level.

81. wind speed

82. NAO, AO and other indices based forecasts + other ideas from C3S employees. Monthly means would be

useful for long range forecast charts. Encourage many more meteo centres to contribute with their own

long range climate models. Sort out UKMO's model's height anomaly forecast issues - it has high pressure

everywhere.

83. Sometimes I need to download dew-point temperature, 2m temperature, 2m dew-point temperature,

surface temperature, surface pressure, boundary layer height, geostrophic potential and others all in one

file, and I can't because of the difference between "surface" and "pressure level" type of data

84. Please provide all data formats in netCDF4, which is becoming the standard.

85. See previous comment regarding documentation of variables in Web API.

86. I need surface (2m) specific humidity in ERA5 or better to have some document to recommend how to

convert existing variable(s) to some useful ones but are not yet directly available.

87. "Additional variable: relative humidity, specific humidity at surface. How to choose forecast to construct

hourly times series"

88. I would like to see data at a detailed level on crop and pasture ET. This is already being used as the basis of

water management from aquifers in China where they use US and Chinese satellites - no I don't know

which ones. ET is the only means of truly measuring water consumption during irrigation in hot climates

such as southern Europe.

89. Better organized documentation

90. It helps to have information in other time scales like daily and monthly so you don't have to download the

whole dataset

91. Detailed tutorials on downloading model products, and strategies for reading them from grib (or other)

formats into usable data would greatly assist new users.

Page 32: Results of the C3S User Satisfaction Survey 2018 User... · Target audience The purpose of the C3S User Satisfaction Survey 2018 was to understand how satisfied C3S users are with

Copernicus Climate Change Service

Report Name | 30

92. "Please, the documentation of ERA5 should be improved making more clear the unit measures and the

method used for the aggregation (if any). Furthermore, it would be nice to have a direct link to tech.

reports or papers describing the model (IFS, etc.). Aggregations: PLEASE give the possibility to have daily

and monthly means to reduce the time and the storage needed, at least for the most used variables"

93. Precomputed 30 year mean (1981-2010) would save us from having to download the entire data set to only

take a bunch of averages and throw the original data away.

94. "Csv, tsv data formats. Water vapor pressure "

95. Knowing how to change scripts for Web API is hard. Maybe a tutorial and a better description of variables

would be useful. Also useful to have evapotranspiration and daily aggregation of variables

96. The additional Data Format like CSV

97. Not necessarily more documentation, but better documentation.

98. an improvment regarding the documentation of the accumulated forecasts parameters ; it is not so easy to

understand what we get from MARS and from the CDS. Also it could ne nice to have some documentation

on how to get or compute cumulative parameters over one day for example;

99. In general we prefer to use 'more' raw data so we can extract what we need. Data formats are more or less

ok but it would be useful for at least a subset of parameters to have columnar data like compressed

parquet files.

100. More reliable precipitation product over mountain

101. please improve the data download speed

102. Writing Python data access scripts for non-Python users

103. Lightening would be very useful to ahve.

104. "- add more data on biosphere. - higher resolution?"

105. PDFs and excel

106. I mainly use .nc and .mat

107. Suggested Variables: Lifted Index, Bulk wind shear sfc-6km, (equivalent) potential temperature / dew point

at selected levels (500, 850hPa)

108. FTP of china seems to be locked,I can't download data such as energy budget datain china.

109. "User specific variable such as Evapotranspiration would be welcome (as more ""index"" on convection such

as the K-Index). "

110. "Comment for 7.: I download data for my institution but do not use it myself. Documentation: Best

practices e.g. in error handling for the WebAPI usage."

111. The handbook supply more information to descibe the diagnosed variable, also the calculate process.

112. radiative data to improve satellite visible and thermal corrections

113. Mathematical wave model (action balance equation or wave transport equation) used for these wave

products.

114. Netcdf4 file format!

115. Please provide the variable Diabatic Heating (global) at all pressure levels

116. Some of the C3S service are hard to find. Clear documentation/overview of available services including data

would be very helpful! Especially, C3S has much too much focus on ECMWFs products. Services of other

providers are not treated with the same care.

117. Re: data formats, everything in netcdf ;)

118. "For documentation, increased clarity on which stream/ time is most appropriate to use would be useful

e.g. when is model initialised in relation to data available? Daily means would be useful. "

119. "Technical specifics about models, file format and variables. Daily aggregation would be very useful.

NETCDF!!"

120. High frequency data on full model and pressure levels is essential, 6 hourly at least but 1-3 hourly better.

121. Documentation should be improved. Sometimes it is difficult to find the precise definition of available

variables. It would be useful to link key publications (not only from the side of data providers but from the

point of view of scientific relevance).

Page 33: Results of the C3S User Satisfaction Survey 2018 User... · Target audience The purpose of the C3S User Satisfaction Survey 2018 was to understand how satisfied C3S users are with

Copernicus Climate Change Service

Report Name | 31

122. "Additional variables - satellite data used in assimilation. More documentation - more details on the

modelling implementation and variables. Additional data formats - some data could be exported in CSV or

text formats (e.g. time series for a data point). Additional aggregations - daily, monthly, seasonal and

annual means."

123. More theta levels would be nice but not essential

Q9: Since June 14 the C3S Climate Data Store (CDS) is available. The CDS allows everyone to

access and process climate data. What are your expectation of such a tool?

Answered: 236, Skipped: 1087

Comments:

1. Yes

2. that it is easy to use and provides a fast delivery of data

3. A lot of processing can be outsourced from local servers to the Copernicus computer facilities, reducing

network load and hopefully processing time.

4. very expecting

5. Its awesome specially for automatic retrieves

6. provide long term data in specific or custom area

7. is useful

8. Easier API integration with Python.

9. Access a wider range of datasets from a single source, with common formats and tools

10. I do not know the tool yet

11. I do not know the tool yet.

12. if it can be availiable for multiple formats, it will be nice.

13. I was not aware of it

14. I hope the data can cover the coastal areas

15. Not aware of it

16. have used it yet

17. To be able to download data for our own education and research tasks.

18. Clarify the analysis part of climate scenarios

19. Fast and easy access to get an first view on data.

20. easy download of large data without using python script

21. To be able to quickly and interactively plot as maps, statistical metrics (e.g., means, standard deviation,

percentiles) of variables (at daily, weekly, monthly, seasonal, yearly timescales) for both global and

geographical sub-regions; and to be able to download the post-processed data files used in plotting the

above-mentioned metrics.

22. It is very useful. Security (both data and user information) should be strong. However Should be

convenient for registered users.

23. "we can access more data, especially in spesific location, in indonesia. we can access data with free

download"

24. interactive with the analysis tool like grads software

25. I haven't used that tool

26. open,easy,fast and useful

27. It is good enough. however, sometimes web pages are slow down.

28. user-friendly tool

29. I can get the data more easily than before

30. I hope that it will be a useful tool for climate studies.

31. Access for aerosol data

32. advancement towards open data?

33. Very useful

Page 34: Results of the C3S User Satisfaction Survey 2018 User... · Target audience The purpose of the C3S User Satisfaction Survey 2018 was to understand how satisfied C3S users are with

Copernicus Climate Change Service

Report Name | 32

34. It's better to be free for all.

35. Hope that the process of download could be more convenient.

36. I do not know

37. you should provide a FULL ATMOSPHERE INTEGRATION of all variables possible. See UCAR for

examples.https://climatedataguide.ucar.edu/

38. I have a lot of expectations

39. nothing

40. I think it will support & help me out more in my research & analysis

41. More convenient access to data and active research.

42. to be working at least as good as the ECMWF python retrieval

43. so good

44. some times it is difficult to find our desired database in search text-box. for example: Era-Interim

45. sea temperature

46. Data in GRIB2 will reduce size. Atmospheric all stability parameters (indices) may be added. Model BTs may

be added.

47. I am waiting for realising of EAR5 before 2010.

48. Access to all data (model, all kind of observations) from a single point. If possible to process, validate and

download results (not only maps)

49. I was not aware of it, this might solve some of the issues we had with speed from the webAPI

50. I hope it facilitates the exploration of variables

51. I am not aware of it but I expect to have derived climate indices such as extreme events, consecutive dry

days, summer days ...etc.

52. I would expect the fast and quick look on the climate anomalies during the last 2-3 decades

53. That is continually improves over-time. This has been the case in the past and I hope it continues.

54. Good

55. Easy to use

56. I haven't used it yet.

57. Hoping it is easy to use the python API to automate monthly updates of data.

58. I am not sure.

59. Useful.

60. Not familiar with this.

61. haven't used it yet

62. I will use online tools to subset and average.

63. Easy to download and subset by dates/areas.

64. My expectation is the best

65. Not sure

66. To be easy to use

67. better service improvement

68. download more easy

69. Generally, education. Personally, less workload.

70. Regional data

71. not very much.its o.k.

72. I don't use it for my work

73. I was not aware about It.

74. I expect such a tool to not require the user to have any knowledge of a programming language in order to

access and process the data for a range of simple tasks.

75. Many

76. I expect it very useful

Page 35: Results of the C3S User Satisfaction Survey 2018 User... · Target audience The purpose of the C3S User Satisfaction Survey 2018 was to understand how satisfied C3S users are with

Copernicus Climate Change Service

Report Name | 33

77. I hope it will make easier data ccess

78. To be robust and efficient in terms of subsetting, timeseries data download and flexibility in data formats

79. user friendly

80. Very high expectations, currently very satisfied with the tool

81. Every thing is ok for my work

82. I didn't know about it. I should try.

83. Access to all information available in one single place

84. Improve research

85. To show in a simple way the climate trend of atmospheric variability.

86. Like NSIDC, to be a great source of current maps of recent climate change, current sea ice state, well

visualised climate model outputs.

87. simple and easy to use.

88. Easy access.

89. Convenience of download

90. Speed and ease of use

91. Very good

92. none

93. easy to use, interactive

94. fast access to custom sub sets

95. The CDS is fine for me. I download data using the API and it works fine. I don´t use the toolbox at the

moment, but I think that is completely different way, with computation capacity but without download

capabilities.

96. Easy access an overview of what's a ailable and easy access to data

97. This kind of Tool could serve as best practic

98. Can be available recently

99. The access to CDS should continue

100. not yet

101. I have good expectation

102. High expectations. I excerpt high t availability and extended usage.

103. Very much

104. i think it would be better, that your data store cover a smaller time step

105. I have no expectation of this tool.

106. Flexible and usefull

107. easy to use and high speed download

108. I think it will be better if the user can download the public data more than one month. Because it will be

more easy for user download some parameters based on what they need

109. a clear User Interface to parse and get data (explaining parameters and differences between daatsets)

110. "-easy to use. -various example tools to process climate data"

111. I am very looking forward for this data coming

112. Very big expectation. For instance, the access to ERA5 and the Toolbox

113. I like the variable overview with units for Era5, and the possibility to show API requests.

114. very helpful in research work

115. no

116. Not checked yet

117. I have not used yet.

118. I didn't even know about this.

119. easy to use

120. Useful enough

Page 36: Results of the C3S User Satisfaction Survey 2018 User... · Target audience The purpose of the C3S User Satisfaction Survey 2018 was to understand how satisfied C3S users are with

Copernicus Climate Change Service

Report Name | 34

121. a good expectation for this date

122. It looks like just an additional web site put on top of already existing serives. I don't see any additional

benefit in it.

123. very cool if for the public

124. "The tool is complicated if we compare it with other tools providing data (for example Giovanni database -

https://giovanni.gsfc.nasa.gov/giovanni/)"

125. It's very convenient for research scholars and I am happy. I would like to have glacialogical satellite and

reanalysis data like SWE, snow melt depth and melt rate for Northern hemisphere.

126. I hope it will make use of data easier.

127. i havent access the store yet

128. To be able to download data, with readily accessible documentation. All these need to be done with ease

129. None at the moment

130. No

131. Search the desired variable

132. "- To easily find the data I need. - To have a quick overview of the content. - To have a link to a toolbox

that easily allows simple data manipulation, visualisation, print and export the result."

133. Identifying region, temporal window, variables, enable batch download.

134. more accestable

135. Yet to access it

136. simple usage, comparison of weather at same region at different times (years)

137. "Support the charge with a lot of users. Good and nice helpdesk."

138. eassy exess

139. High

140. I didn't test it yet

141. more friendly tools.

142. I expect it to be a very useful tool for scientific research.

143. Easy access to data.

144. "- simple and interactive data exploration - possibility to pre-process data without having to download

them"

145. It is not clear to me how it would work. But it would be extremely important if we can program our own

scripts up there (python or R), run them there and receive the results. Is it the way it works?

146. Have not used it

147. I am currently using temperature at different altitudes as an indication of airmass transport. There are

many atmospheric dynamics models that require reanalysis data for the prior and CDS proved to be the

most convenient source of up to date global reanalysis data.

148. "very organized, intuitive structure. very well documented products. tools to allow reasonable processing

times of the large volumes of data + tips on optimizing processing/download times. clear rules about data

use for all possible categories of users and uses"

149. ease of use

150. So far so good. Perhaps in the future, to be able to access it and develop applications from outside the

toolbox would be useful.

151. Excited about it!

152. I do not know

153. I have not had a thorough look yet

154. I can download data in time series with single parameter and single date

155. So easy to use that an overworked, sleep deprived grad student can use it.

156. Good

157. Interactive exploration of data

158. Acces easy data

Page 37: Results of the C3S User Satisfaction Survey 2018 User... · Target audience The purpose of the C3S User Satisfaction Survey 2018 was to understand how satisfied C3S users are with

Copernicus Climate Change Service

Report Name | 35

159. NO advice.

160. Windows based statistical data analysis and visualization tools

161. The ease of obtaining for applying these data to several problems

162. Location specific data

163. Useful for many people, personally not for me.

164. Even easier and more straightforward obtaining of data as compared to webAPI used so far.

165. I haven't used it because I wasn't completely aware of it. But, I took a quick look and it seems very useful.

166. To provide more information and ways to download data for researchs

167. The theory behind the store is great, but it does not work well. The interface is extremely confusing, and I

will not be able to use it. I will instead Python program in my own manner.

168. Very useful for data access, data mining and wonderful that it is shared with the public!

169. The ability to make basic maps and time series of many common variables and compare different products.

170. nothing

171. I don't know. I have not used it anymore.

172. It is very useful given that people from different organisations can access the data easily and information is

key to progress forward.

173. Shared code and user forum would prove extremely useful.

174. I believe it will be a very useful tool that will facilitate the interaction between the users and the plataform.

175. Fast and Easy tool

176. I have not used it so far

177. I haven't used it

178. Well documented and simple data download methods, with more technical options available for more

advanced users.

179. We would like to work with an original data resolution and be able to downscale data on-line

180. It will definitely improves the R&D.

181. promissing

182. I don(t use it

183. It would be very useful, and its going to make everything faster

184. It looks like a nice tool, but I am waiting for the release of cdsapi

185. Quick, easy to use, multi-functional (e.g. can download by time, by parameter, by level, by lat/lon)

186. Not yet explored

187. nice to have

188. very good

189. More data

190. very useful to utilize the data and download for research work

191. The climate data is only downloaded one-by-one.It's such low efficiency.Do hope a way to download such

as package of many data files.

192. Easy search and download of data (as netCDF). Good metadata base for searching.

193. it is just for limited dataset; the limitation (volume) is not clearly specified; you have to explain exactly how

to download a large amount of data (with webapi, MARS access); I understand that the CDS is not adapted

to download a large amount of data

194. Very good tool.

195. Very helpful

196. please provide easy way

197. None at this time.

198. Have not used it.

199. High

200. "provide more data formats for downloading (grid,csv,shp and so on)"

Page 38: Results of the C3S User Satisfaction Survey 2018 User... · Target audience The purpose of the C3S User Satisfaction Survey 2018 was to understand how satisfied C3S users are with

Copernicus Climate Change Service

Report Name | 36

201. "1. subsetting, 2. time series plots"

202. Well that is a very good initiative, however I have not access it before. It should be interactive and easy to

access data.

203. no idea

204. "Efficient visualization. Interpolation to specific location (altitude correction?)"

205. Very essential.

206. Help my research

207. To be able to download a lot of data in order to make my R&D

208. To deal with the high volume problem of future data products or today's ERA5 data.

209. simple and fast

210. I hope the new update is better than before

211. Easy to see the data information, and can plot figures and have funtion to do statistics.

212. none

213. To yield research advancement and contribute more to knowledge

214. Can be improve and have an easy interface to download the data

215. fast access of data

216. easy to operater

217. I haven’t used it.

218. High expectations

219. Helpful

220. Making data analysis using large datasets quicker and easier

221. I need daily data not one month combined data.

222. It should be user friendly.

223. Only the best! It will be a huge change and improvement.

224. I prefer to use the ECMWF-API as I am familiar with it.

225. Possible post-processing before downloading huge amounts of data.

226. Easy search and automated download. The API and toolboxes were unexpected and pleasant surprises.

227. it's better if the download speed can be improved

228. Easier access to archived forecasts and reanalysis products.

229. None

230. I expect that the CDS will hugely improve my job.

231. "High expectations, but so far only tried a few basic functionalities; would really like more worked real-live

examples from different sectors & come to some training. Annoyingly, I cannot get the CDS API to work

from my location, prob because of proxy settings, I hope this will be fixed from our side soon."

232. Easy use, free, and available every time series, domain, format date, parameter

233. Better access to key information.

234. This tool will be fundamental for data exploration and reduce the need to download the datasets to perform

simple operations that clarify some aspects of the data.

235. yes

236. I haven't used it yet. But I am sure It will help a lot.

Q8. Do you have any other suggestions how we can improve the Copernicus Climate Change

Service for you?

Answered: 163, Skipped: 1160

Comments:

1. It would be fantastic if it would be possible to make calculations directly on your computational

infrastructure and then only download results.

Page 39: Results of the C3S User Satisfaction Survey 2018 User... · Target audience The purpose of the C3S User Satisfaction Survey 2018 was to understand how satisfied C3S users are with

Copernicus Climate Change Service

Report Name | 37

2. Easy access and easy to understand presentation of input data (also insitu) and comprehensive

documentation is desirable. Processing speed in CDS applications will be essential for its success.

3. it will be very useful to download the data using a provided application rather than making script at a local

machine, which required to install python and other dependence applications.

4. "No at this moment"

5. Interactive weather map for weather predictions.

6. No

7. Not at this moment.

8. directly add the document of information of dataset into the data files.

9. no

10. Not, actually is very usefull

11. no

12. Information on particular selected Coordinate, should be available rather than gridded data. (Gridded data

is useful for overall study. But Information would be required on a particular location for projects and

researches)

13. i hope the data more be complicated especially about climate

14. We can access data more detail for higher resolution

15. Complete C3S by some valuation of climate change impact on agriculture and food security

16. No, for the time being.

17. No

18. In case, if a researcher interested to have new (added or updated) reanalysis data for some small regions, I

think that it's good idea to provide registration and send automatically requested(limited) data to user's

email.

19. Hope that the process of download could be more convenient.

20. NO

21. Stop the patronizing and most false lead-in that any user somehow believes in the emissions as a climate

driver. Stick to delivering data and leave it to individuals to develop their own interpretations. The

practice of putting words in the mouths of others on this important issue is contemptible. Stick to

transparent data delivery and I'll be the first to sing your praises.

22. No

23. no

24. Kindly provide information about each variable: i.e., how they are calculated. If it s a cumulative of variable

for certain hours specify that in the file that it is downloaded.

25. You r doing a good job but some more data formats must be introduce which r easy to use

26. monthly added parameters or weblinks to them. maybe some scientific papers attached where this data

was used (not only those who are presenting the datsets)

27. no i don't

28. No. thanks

29. all ok

30. Already very good.

31. We love it! Improving WebAPI response/queing waiting times would be highly appreciated

32. no

33. Can you develop a web based tool to evaluate regional models such as the ones used in CORDEX project?

And a web tool to extract and produce useful statistics from CORDEX multi-model ensemble outputs

34. Not now

35. Branding such a service "climate change" is a dangerous political game. I find the service is very useful

where I use it to better design wind farms, a process that is beneficial in the mitigation of climate change.

However, the service I use is climate modelling (reanalysis), which is a very important tool for industry,

research and public safety in a wide range of fields. Branding such an essential service as a "climate

change" initiative risks politicizing a very useful tool that also happen to be useful for climate change

Page 40: Results of the C3S User Satisfaction Survey 2018 User... · Target audience The purpose of the C3S User Satisfaction Survey 2018 was to understand how satisfied C3S users are with

Copernicus Climate Change Service

Report Name | 38

analysis, among many other things. This presents a target for the next populist leaders, who are growing in

ranks.

36. Not really

37. "Allow anonymous access to the data. Turn Copernicus into a decentralised system where users can share

the cost of hosting and distributing the data, as well as share the products of their research."

38. No.

39. Less wait time for WebAPI requests might allow us to implement the system in more processes.

40. Keep improving very high resolution data needed in near-shore areas and as imput in regional models

41. I am very satisfied with products and data.

42. Again, more flexible interface for choice of data at the download portal will be useful

43. Just again the resolution, please use the 30 arc seconds resolution.

44. nothing

45. some variable are missing

46. Improve the API with clear feedback messages about the availability of the selected parameters and error

messages in general.

47. High resolution data

48. no thanks

49. Sometimes i can't download data from my home machine, only at work. I don't know why it happens.

50. At this moment, using just a fell datasets I am extremely satisfied with Copernicus services

51. nah está bien,mis dieses,echaos un lolaso a mi salud.

52. greater collaboration with other countries' institutions, so everyone can share and use different basemaps.

53. No

54. No

55. No comments or suggestions. A big thank you for the services you provide and apologies for the late reply

to this survey.

56. No

57. no

58. it would be nice to have higher resolution data, but I'm not sure you're responsible for that

59. Before I used to download multiple dates at once, but now it seems change this option. I wish you

re_establish it.

60. More detailed explanations of variables an, procedures in different languages for layman, policy makers

61. I am satisfied with these updates

62. No.

63. no

64. No.

65. none

66. no, i'm satisfied

67. increased speed, I sometimes need large volumes of data

68. Please, provide the long-term projections (CMIP5, CORDEX, etc.) soon. Thank you.

69. I would like the reanalysis data to be released in less than one week to help in onset prediction.

70. no, thanks.

71. to increase the spatial resolution of the data

72. unfortunately no

73. Please do not disappear.

74. NO

75. no, you are doing a very good job

76. I think it will be better if the user can download the public data more than one month. Because it will be

more easy for user download some parameters based on what they need

Page 41: Results of the C3S User Satisfaction Survey 2018 User... · Target audience The purpose of the C3S User Satisfaction Survey 2018 was to understand how satisfied C3S users are with

Copernicus Climate Change Service

Report Name | 39

77. Please provide simpler documentation

78. NO

79. I would prefer not to have to login to get to the toolbox. The main menu (drop down) expands beyond my

mobile phone’s screen. The Toolbox documentation does not work on my mobile screen. Would like some

examples of sub-setting in lat lon and an introduction before the examples when arriving to the Toolbox-

page, saying what it can do. Make plots you can download or process data which can be downloaded, etc.

80. I think these satisfaction surveys could be very useful, perhaps, 2 per year.

81. no

82. no

83. no

84. I noticed that the network connection from China is limited and thus it is very inconvinient to download

data. I am not sure whether this is due to the CMEMS or the Chinese side. Hopefully this problem could be

improved somehow. Thanks.

85. Mainly the API could be faster, but I understand how the large databases on your server works so it's very

understandable why it isn't much faster. Maybe some tool to work with your data from pure coding

statepoint? I used PyGrib for working with Grib files from your site, but it didn't look like an official tool and

Python is todays most dominant language in terms of data processing, analyzing and for example neural

networks to work with your data, what I did. You can do all these things in Python but some aggregate of

informations on your site could prove useful for newcomers.

86. No. It help me a lot

87. lately I do not have any suggestions

88. Make download of comprehensive data sets fast and easy. We need complete records of ERA5 data on our

site to serve multiple users working on it.

89. Please DO NOT makes your site/portal/tools so complicated. Make it as free and easy to access as

Americans do

90. Add parametres related to glaciology and snow water hydrology.

91. Well, previously I used web download of ERA Interim data, now I have to play with python. I would

appreciate if either web download is available as before or R code in a form of Jupyter note book for

example (maybe python). Your data is great, very usefull, great quality! I would also like to easier

download data (higher resolution, longer time series).

92. Please make it more user friendly. It is very difficult to extract data for a long time series. The data has to

be clicked for each and every time when they are needed for more than a month. For exam when we need

a data, let say for 10 year then we had to click from 1st month to the last month of the year by manually.

93. It would be useful to download directly annual data including monthly or hourly data to avoid to download

step by step

94. Easy access, especially those in Africa

95. Regarding data formts, a detailed step-by-step to decoding datasets to other format needs to be improved.

96. None at the moment

97. Easier to download data

98. No

99. I'm perfectly satisfied with the current system.

100. Tools to visualise the range of projection results for GCMs and RCMs over selected spatial domains.

101. more user friendly site

102. I would love to have a simple usuable python tool to download data files, conversion in simple numerical

formats and further processing by standard libs numpy, scipy matplotlib

103. No, thank you.

104. downloding is verry difficult

105. None at the moment

106. add some information especially to the beginner on how to access dataset for specific programming

language such as Python, Grads or even Fortran

Page 42: Results of the C3S User Satisfaction Survey 2018 User... · Target audience The purpose of the C3S User Satisfaction Survey 2018 was to understand how satisfied C3S users are with

Copernicus Climate Change Service

Report Name | 40

107. Work more with the users to make the usability easier. I know it is not an easy thing to achieve but I really

had trouble getting S2S data and gave up.

108. seems very advance and want to appreciate.

109. We need a more detail documentation of the variables you have calculate. For instance I have used variable

'fg10' defined as "10 metre wind gust since previous post-processing". This information is not sufficient to

understand what this variable is and I have not been able to find a better information about this variable. In

particular I want to know: a) Is this synoptic wind? b) Is this a spatial or temporal average? c)if it is an

average how was it calculated? d) native grid size. e) possible interpolation of available CDS variable.

110. I think there is enormous value to C3S and I am extremely grateful for its development. I very much look

forward to what is to come from C3S! Thank you!

111. consistent documentation

112. no

113. rainfall projection

114. Nothing

115. Make data available faster. Every January ERA-Interim only has a 7-14 delay, but rest of the year it is 2-3

months

116. No

117. Not sure, experiencing its use

118. no

119. No

120. No

121. Not at the moment - the more forecasting tools though, the better!

122. Provide a clearer GUI for the CDS.

123. nothing

124. user friendly website

125. see above. Catch up with the Chinese. Water management is becoming more and more critical in Italy,

Spain Greece etc. We need the tools to measure consumption.

126. I am completely satisfied with the services provided. So, I would like to thank people and organisations that

have been involved to make such useful information available for research and development.

127. More documentation on the seasonal climate forecast data terminology e.g. monthly means of ensembles

and forecast means.

128. Im very satisfied, thanks for your service.

129. no

130. Faster download speeds. Think about hosting or just providing a common interface to more datasets (eg

the cmip5/6 archive) so all relevant climate model data are accessible through a single interface (even if

the CCCS interface ends up pointing to files hosted on the ESG)

131. Can work with original data resolution and downscaling functions

132. Not yet

133. You might improve the website, that looks like a bit outdated in terms of design. Moreover, the text is

usually hard to read with a very small font. Not attractive indeed.

134. There's not enough public outreach, there's not a great awareness of products available

135. sub-daily time scale

136. More tutorials for data retrieve

137. I find the present CDS difficult - even the provided script example crashes. To use the scripts, I need to

find the codes for the different variables, which is a pain: Too high nerd-factor. Better to have a "smart"

algorithm that gives me a limited set of choices when I want e.g. temperature or precipitation. Also good to

be able to see what products others have downloaded.

138. see above

139. In general I'm not interested in WMS or WCS so a good API to retrieve data from ERA5 would be great.

140. one should download data in bunch

Page 43: Results of the C3S User Satisfaction Survey 2018 User... · Target audience The purpose of the C3S User Satisfaction Survey 2018 was to understand how satisfied C3S users are with

Copernicus Climate Change Service

Report Name | 41

141. good

142. No.

143. Speed. Please invest in the infrastructure to provide your data at a competitive global level. If you are

unable to do this individually, it would probably be worth pursuing a collective investment from industry

(particularly insurance) to help realise this. I don't know how this might work, but perhaps a funded data

delivery service that could be subscribed to by industry partners?

144. there may be no

145. For my personal experience compared with other services, Copernicus Climate Change Service is one of the

best if not the best.

146. It takes a while to learn the new way to download, so more python examples will be good

147. Thank you for your service. Please try to make the data available for download in more formats like the GIS

raster and vector formats. Best of luck !!!

148. I am satisfied with the current system

149. It is enough

150. Be better in searching the data information and handbook.

151. No suggestion for now

152. no, for now

153. Is it possible to have other formats as an ouput file? such as text or csv file?

154. I am already satisfied.

155. I am happy

156. Nothing major

157. not for the time being.

158. Enhance user interaction! Too many potential users do simply not know about available services/data!

159. if the users are more able to get high-resolution data, that will be great

160. I really suggest to move to NetCDF data format as standard.

161. "I think still enough people across Europe (and beyond) know about the C3S / CDS - ramp up campaigns

which engage users across all sectors & locations. I also think to have some essential pages (eg an

introduction) in (European) languages other than English / auto-translation functionality would be useful."

162. Upgrade all aspect (point 9) to indonesia.

163. Overall the CCCS is a great service and providing fundamental access to climate variables. The natural

evolution of the service needs to be carefully controlled to avoid the risk of being to many reasonable things

instead of on single great thing.

Page 44: Results of the C3S User Satisfaction Survey 2018 User... · Target audience The purpose of the C3S User Satisfaction Survey 2018 was to understand how satisfied C3S users are with

Copernicus Climate Change Service

climate.copernicus.eu copernicus.eu ecmwf.int

ECMWF Shinfield Park Reading RG2 9AX UK

Contact: [email protected]