information systems alumni profile -...

41
Institute of Statistics and Computerized Information Systems Institute College of Business Administration University of Puerto Rico Río Piedras Campus Information Systems Alumni Profile [The purpose of this working paper is to present the results of a quantitative study that assessed the professional skills of alumni.] [Learning Pedagogical Contribution (LPC)] Dr. Rosarito Sánchez Morcilio, Associate Professor, Prof. Arnaldo Ramos-Torres, Professor, and Dr. Pedro J. Rodríguez Esquerdo, Professor June 22, 2011

Upload: trankhuong

Post on 03-Apr-2018

216 views

Category:

Documents


0 download

TRANSCRIPT

Institute of Statistics and Computerized Information Systems Institute

College of Business Administration

University of Puerto Rico

Río Piedras Campus

Information Systems Alumni Profile

[The purpose of this working paper is to present the results of a quantitative study that assessed

the professional skills of alumni.] [Learning Pedagogical Contribution (LPC)]

Dr. Rosarito Sánchez Morcilio, Associate Professor, Prof. Arnaldo Ramos-Torres, Professor,

and Dr. Pedro J. Rodríguez Esquerdo, Professor

June 22, 2011

Information Systems Alumni Report

i

ACKNOWLEDGEMENTS

To

Prof. Maria Teresa Jiménez Plá

Prof. Edgardo Rodríguez

Prof. Arnaldo Ramos

Those professors were who provided the University of Puerto Rico, Río Piedras Campus

alumni’s contact information for this study to be successful.

To

Dr. Katherine Franceschi

For the edition of this document.

Information Systems Alumni Report

ii

TABLE OF CONTENTS

PURPOSE OF THE STUDY ....................................................................3

METHODOLOGY .................................................................................3

SELECTION OF PARTICIPANTS ............................................................................................................................................ 3

LIMITATIONS OF THE STUDY .............................................................................................................................................. 3

INSTRUMENT ................................................................................................................................................................. 3

DATA ANALYSIS .............................................................................................................................................................. 3

VALIDITY....................................................................................................................................................................... 3

FINDINGS ...........................................................................................4

RESULTS ....................................................................................................................................................................... 4

Description of the demographic variables ............................................................................................................ 4

Frequency distributions ......................................................................................................................................... 8

Program’s achievement of the objectives ........................................................................................................... 15

Program’s contribution to the outcomes ............................................................................................................ 15

CONCLUSIONS .................................................................................. 17

CONCLUSIONS FOR THE OBJECTIVES .................................................................................................................................. 17

Recommendation for the objectives .................................................................................................................... 20

Continuous Improvement of the objectives ........................................................................................................ 20

CONCLUSIONS FOR THE OUTCOMES .................................................................................................................................. 21

Recommendation for the outcomes ..................................................................................................................... 23

Continuous Improvement of the outcomes ......................................................................................................... 23

APPENDICES ................................................................................ 25

APPENDIX 1 .................................................................................. 26

IS SURVEY ............................................................................................................................................................... 26

APPENDIX 2 .................................................................................. 34

LIST OF INDEPENDENT AND DEPENDENT VARIABLES ................................................................................................ 34

List of independent variables .............................................................................................................................. 35

List of dependent variables ................................................................................................................................. 40

Information Systems Alumni Report

3

Purpose of the Study This study attempts to gather the University of Puerto Rico Río, Piedras Campus Computer

Information Systems (UPR-RP CIS) program alumni assessment of the career and professional

accomplishments of Information System professionals (alumni) and the extent to which the

UPR-RP CIS program has contributed to those accomplishments. The deliverable of this study

is classified as a technical report and will be used to support the continuous improvement

activities of the UPR-RP CIS program.

Methodology

Selection of Participants Participants are selected from all alumni from the UPR-RP CIS program that graduated from

2005 until 2011. A total of 131 survey forms were sent and a total of 31 completed

questionnaires were received within two weeks of sending them. The questionnaires were

completely answered by all participants.

Limitations of the Study One of the limitations of the study is that of the 131 sent surveys, 6 email addresses had

delivery errors. Another limitation of the study is that the exact total of forms sent is unknown,

since some recipients may have forwarded the survey form to other colleagues.

Instrument

The survey was administered online using a subscription of Formstack.com. Appendix 1

shows the survey questionnaire used. The instrument had a total of 31 questions. Seven

questions were designed to address and assess the career and professional accomplishments of

the UPR-RP CIS program’s objectives; ten questions addressed program’s outcomes, and the

rest were for classification purposes.

Data analysis The study was a cross-sectional design with statistical analysis consisting of descriptive

statistics. The statistical package SPSS was used as to analyze the data for each of the research

questions (SPSS version 19, 2011). Appendix 2 shows the list of the variables used to conduct

the survey.

Validity The survey instrument used for this study was assessed by a panel of computer information

systems experts at a meeting celebrated the 30th

of March, 2011. After a meaningful discussion,

they determined that the instrument measures what the study plans to measure.

Information Systems Alumni Report

4

16%

6%

16%

26%

36%

Distribution of Job Positions

A managerial position inother area of the company

A managerial position inthe IS area of the company

A technical position in theIS area of the company

IS Consulting

Other type of position

Findings

Results

Description of the demographic variables

Of the alumni who answered the survey, 37.8% indicated they had graduated 3 to 5 years ago

(2011), while 25.8% indicated they had graduated no more than 2 years ago. Figure 1 shows

the years from graduation since 2011.

Figure 1: Number of years since graduation

More than half (62%) of the participants hold an IS related position or are IS consultants.

Figure 2 shows the distribution of job positions.

26%

39%

16%

19%

Number of years since graduation

2 years or less

3 to 5 years

6 to 10 years

More than 10 years

Figure 2: Distribution of Job Positions

Information Systems Alumni Report

5

A 25.8% of the alumni who answered the survey indicated that they are IS consultants. This

answer is consistent with the previous one, which is job position. A 19.4% indicated that they

work for the banking industry and a 16.1% indicated that they work in accounting services.

Figure 3 shows the main area of service of the alumni who answered the survey.

Figure 3: Main Area of Service

Most of the alumni who answered the survey (61.3%) work for a company of more than 100

employees. Figure 4 shows the size of the company.

Figure 4: Size of the Company

16%

19%

7%

7% 3%

26%

6%

10% 6%

Main Area of Service

Accounting services

Banking

Education

Government

Healthcare

Information Systemsconsulting

13%

10%

16%

61%

Size of the Company

From 1 to 10 employees

From 11 to 50 employees

From 51 to 100employees

More than 100 employees

Information Systems Alumni Report

6

Most of the alumni who answered the survey (74.2%) work for a company that is located in

Puerto Rico. Figure 5 shows the company location.

Figure 5: Company Location

The vast majority of the alumni who answered the survey (90.3%) indicated that the location

where they work is in Puerto Rico. Figure 6 shows the distribution.

Figure 6: Job Location

7%

19%

74%

Company Location

A foreign country

Continental USA

Puerto Rico

10%

90%

Job Location

Continental USA

Puerto Rico

Information Systems Alumni Report

7

Most of the alumni who answered the survey (77%) are male. Figure 7 shows the distribution.

Figure 7: Gender

23%

77%

Gender

Female

Male

Information Systems Alumni Report

8

Frequency distributions

In this research, two main areas were analyzed. The first area addressed the career and

professional accomplishments of the UPR-RP CIS alumni, which purpose is to measure the

achievement of the program’s objectives. The second area addressed the abilities gained from

the Information Systems education, which purpose is to measure the achievement of the

program’s outcomes.

Frequency distribution of the objectives of the program

Eight career and professional accomplishments statements in the survey have the intention to

measure the five objectives of the URP-RP CIS program. Objectives one, two, and five are

determined using two different career and professional accomplishment statements. Objectives

three and four are evaluated with only one career and professional accomplishment statement.

There is one independent variable for each career and professional accomplishment statement.

A four-point Likert scale was used to measure each career and professional accomplishment.

The scale consists of “Very frequently”, “Frequently”, “Sometimes”, and “Never”.

From the program’s objective perspective, the results show that in a sample of 31 alumni, most

who participated in the study felt that they:

Sometimes implement and manage information systems in an organization.

Very frequently apply technological, analytical, and critical thinking skills in the

solution of problems related to information systems in organizations.

Very frequently take into consideration the context in which information systems

operate, when implementing and managing these systems.

Very frequently maintain his professional expertise by updating his knowledge in

technology and information systems.

Very frequently perform his functions showing respect and appreciation for ethical

values, interpersonal relationships, communication, and team work.

Table 1 shows the frequency distribution of the objectives of the UPR-RP CIS program where

the sample is 31. Figure 8 shows a column chart of the frequency distribution of the objectives

from Table 1.

Frequency distribution of the outcomes of the program

There are ten outcomes for the UPR-RP CIS program. Each outcome is understood to be the

ability that the alumni developed or gained while studying for their Bachelor’s degree. There

Information Systems Alumni Report

9

are ten questions or survey items regarding to those abilities to measure the program’s

outcomes. Each survey items from this section helps assess the effectiveness of the UPR-RP

CIS program’s achievement of an outcome of the program.

There is one independent variable for each statement that measures the abilities developed from

the Information Systems education. A four-point Likert scale was used to evaluate each of the

ten statements addressing the abilities gained from the Information Systems education. The

scale consists of “Highly effective”, “Very effective”, “Moderately effective”, and “Not

effective”.

From the program’s outcomes perspective, the results show that in a sample of 31 alumni, most

who participate in the study felt that they are:

Highly effective in the ability to analyze an operation within an organization, identify

problems and make recommendations to solve these problems.

Very effective in the ability to select or design a system to solve the problems identified

in an operation.

Very effective in the ability to plan and supervise the implementation of a system that

solves the problems identified in an operation.

Very effective in the ability to use current techniques, skills, tools and best practices to

design, implement and manage information systems.

Very effective in the ability to understand the impact that organizational, local and

global environments have in the implementation and management of information

systems.

Both highly effective and very effective in the ability to value the protection of

information system resources in an organization, and to identify ways in which this

protection can be achieved.

Highly effective in the ability to be aware of the high level of change in the Information

Systems field, and the need to use different mechanisms to update your knowledge.

Highly effective in the ability to recognize the importance of ethical values and

interpersonal relationships in an information systems professional.

Highly effective in the ability to communicate effectively with a range of audiences.

Highly effective in the ability to function effectively in teams seeking to accomplish a

common goal.

Table 2 shows the frequency distribution of the outcomes of the UPR-RP CIS program where

the sample is 31. Figure 9 shows a column chart of the frequency distribution of the outcomes

from Table 2.

Information Systems Alumni Report

10

Table 1: Frequency distribution of the objectives of the program (n=31)

UPR-RP CIS

Objectives’ Description

Career and Professional

Accomplishment

Very

Frequently

Frequently Sometimes Never

Objective 1 To implement and manage

information systems in an

organization.

I have implemented information systems in an

organization.

16.1% 25.8% 35.5% 22.6%

I have managed the development of information systems in an organization.

12.9% 22.6% 32.3% 32.2%

Objective 2

To apply technological, analytical,

and critical thinking skills in the

solution of problems related to

information systems in

organizations.

I have applied technological skills in the solution of

problems related to information systems in organizations.

51.6% 25.8% 22.6% 0

I have applied analytical and critical thinking skills in the solution of problems related to information

systems in organizations.

54.8% 29% 16.1% 0.1%

Objective 3

To take into consideration the

context in which information

systems operate, when

implementing and managing these

systems.

I take into consideration the context in which

information systems operate (organizational

culture, functional areas, industry regulations,

etc.), when implementing and managing these

systems.

58.1% 25.8% 12.9% 3.2%

Objective 4

To maintain his professional expertise

by updating his knowledge in

technology and information systems.

I maintain my professional expertise by updating

my knowledge in technology and information

systems.

61.3% 22.6% 16.1% 0

Objective 5 To perform his functions showing

respect and appreciation for ethical

values, interpersonal relationships,

communication, and team work.

I perform my functions showing respect and

appreciation for ethical values and interpersonal relationships

90.3% 9.7% 0 0

I perform my functions emphasizing

communication and team work.

83.9% 16.1% 0 0

Information Systems Alumni Report

11

Table 2: Frequency distribution of the outcomes of the program (n=31)

UPR-RP CIS

Outcomes

Highly

Effective

Very

Effective

Moderately

Effective

Not

Effective

1 An ability to analyze an operation within an organization, identify

problems and make recommendations to solve these problems.

45.2% 38.7% 16.1% 0

2 An ability to select or design a system to solve the problems identified in

an operation.

38.7% 41.9% 16.1% 3.3%

3 An ability to plan and supervise the implementation of a system that

solves the problems identified in an operation.

19.4% 51.6% 19.4% 9.6%

4 An ability to use current techniques, skills, tools and best practices to

design, implement and manage information systems.

38.7% 32.3% 22.6% 6.4%

5 An ability to understand the impact that organizational, local and global

environments have in the implementation and management of

information systems.

29.0% 61.3% 9.7% 0

6 An ability to value the protection of information system resources in an

organization, and to identify ways in which this protection can be

achieved.

41.9% 41.9% 12.9% 3.3%

7 An ability to be aware of the high level of change in the Information

Systems field, and the need to use different mechanisms to update your

knowledge.

51.6% 35.5% 9.7% 3.2%

8 An ability to recognize the importance of ethical values and interpersonal

relationships in an information system professional.

71.0% 9.6% 19.4% 0

9 An ability to communicate effectively with a range of audiences. 48.4% 35.5% 12.9% 3.2%

10 An ability to function effectively in teams seeking to accomplish a

common goal.

58.1% 38.7% 3.2% 0

Information Systems Alumni Report

12

Information Systems Alumni Report

13

Figure 8: Frequency distribution of the objectives of the program (n=31)

16.10%

12.90%

51.60%

54.80%

58.10%

61.30%

90.30%

83.90%

25.80%

22.60%

25.80%

29%

25.80%

22.60%

9.70%

16.10%

35.50%

32.30%

22.60%

16.10%

12.90%

16.10%

0

0

22.60%

32.20%

0

0.10%

3.20%

0

0

0

0.00% 10.00%20.00%30.00%40.00%50.00%60.00%70.00%80.00%90.00%100.00%

ObjImplementIS

ObjManageDevelopIS

ObjTechIS

ObjAnalytCritThinkIS

ObjContextIS

ObjLifeLongIS

ObjRespectEthical

ObjCommTeamWork

Ob

ject

ive

1O

bje

ctiv

e 2

Ob

ject

ive

3O

bje

ctiv

e4

Ob

ject

ive

5Program's achievement of the Objectives

Never Sometimes Frequently Very Frequently

Information Systems Alumni Report

14

Figure 9: Frequency distribution of the outcomes of the program (n=31)

45.20%

38.70%

19.40%

38.70%

29.00%

41.90%

51.60%

71.00%

48.40%

58.10%

38.70%

41.90%

51.60%

32.30%

61.30%

41.90%

35.50%

9.60%

35.50%

38.70%

16.10%

16.10%

19.40%

22.60%

9.70%

12.90%

9.70%

19.40%

12.90%

3.20%

0

3.30%

9.60%

6.40%

0

3.30%

3.20%

0

3.20%

0

0.00% 10.00% 20.00% 30.00% 40.00% 50.00% 60.00% 70.00% 80.00%

Analyze

Design

PlanSuperImplem

CurrentTech

Impact

ProctecInfo

LongLearning

Ethical

ComEffectively

TeamWork

Program's Contribution to the Alumni Outcomes

Not Effective Moderately Effective Very Effective Highly Effective

Information Systems Alumni Report

15

Program’s achievement of the objectives

Most of the alumni who answered the survey either strongly agree (48.4%) or agree (48.4%)

that the objectives of the UPR-RP CIS program were achieved. Only 3.2% disagree that the

program’s objectives were not achieved. Figure 10 shows the distribution of the alumni’s

assessment of the program’s objectives achievement.

Figure 10: Program’s Achievement of the Objectives

Program’s contribution to the outcomes

Most of the alumni who answered the survey either strongly agree (45.2%) or agree (45.2%)

that the UPR-RP CIS program helped them achieve the program’s outcomes. Only 9.7%

disagree that the program helped them achieve the outcomes. Figure 11 shows the program’s

contribution to the outcomes.

48.4

3.2

48.4

.0 10.0 20.0 30.0 40.0 50.0 60.0

Agree

Disagree

Strongly Agree

Information Systems Alumni Report

16

Figure 11: Program’s Contribution to the Outcomes

45.2

9.7

45.2

.0 5.0 10.0 15.0 20.0 25.0 30.0 35.0 40.0 45.0 50.0

Agree

Disagree

Strongly Agree

Information Systems Alumni Report

17

Conclusions

Conclusions for the objectives

A study was conducted to consult the objectives with the University of Puerto Rico, Río

Piedras Campus Computer and Information Systems program alumni during April 2011.

According to the sample (n=31), the alumni agree that they met the program’s objectives.

Generally, the objectives are advised to be measured at least three years from the graduation.

This study complies with the requirement since most of the respondents are alumni that

graduated three to five years ago.

A four-point Likert scale was used to measure each objective (career and professional

accomplishment). The scale consisted of “Very frequently”, “Frequently”, “Sometimes”, and

“Never”.

In order to determine if the objective was met by the alumni, the minimum expected score was

decided to be 75% or more after adding the percentages of “Very frequently” and “Frequently”

scores.

There were two survey statements to assess objectives one, two, and five. The rest of the

objectives had only one survey statement for its evaluation.

Table 3 shows the summary of the objective accomplishment by alumni. According to the

alumni who participated in the survey (n=31), currently no action needs to be taken since all the

objectives comply with the minimum score, except for objective one.

Table 3: Summary of Objective Accomplishment by Alumni

UPR-RP CIS

Objectives

Career and

Professional

Accomplishment

(Survey Item)

Very

Frequently Frequently

Total

Score (minimum

is 75 or

more)

Action

Objective 1: To

implement and manage

information systems in

an organization.

I have implemented information systems in an organization. 16.1% 25.8% 41.9%

Yes I have managed the development

of information systems in an

organization.

12.9% 22.6% 35.5%

Objective 2: To apply

technological,

analytical, and critical

thinking skills in the

solution of problems

related to information

systems in

organizations.

I have applied technological skills

in the solution of problems related to information systems in

organizations.

51.6% 25.8% 77.4%

None I have applied analytical and critical thinking skills in the

solution of problems related to

information systems in organizations.

54.8% 29% 83.8%

Information Systems Alumni Report

18

UPR-RP CIS

Objectives

Career and

Professional

Accomplishment

(Survey Item)

Very

Frequently Frequently

Total

Score (minimum

is 75 or

more)

Action

Objective 3: To take

into consideration the

context in which

information systems

operate, when

implementing and

managing these

systems.

I take into consideration the

context in which information

systems operate (organizational culture, functional areas,

industry regulations, etc.), when

implementing and managing these systems.

58.1% 25.8% 83.9% None

Objective 4: To maintain

his professional expertise

by updating his

knowledge in technology

and information systems.

I maintain my professional

expertise by updating my

knowledge in technology and

information systems. 61.3% 22.6% 83.9% None

Objective 5: To

perform his functions

showing respect and

appreciation for ethical

values, interpersonal

relationships,

communication, and

team work.

I perform my functions

showing respect and

appreciation for ethical values

and interpersonal relationships

90.3% 9.7% 100%

None I perform my functions

emphasizing communication

and team work.

83.9% 16.1% 100%

Analysis

Objective 1: To implement and manage the development of information systems in an

organization.

This objective was measured using two statements: “I have implemented information systems in

an organization.” and “I have managed the development of information systems in an

organization.”. The level of attainment for this objective after adding the scores of “Very

frequently” and “Frequently” is lower than the score expected for both statements.

Analysis

Upon examination of the results and the objective it is noted that as phrased, this objective is

usually attained later in the IS professional career. It is recommended that the objective be

revised as to include tasks performed earlier in the career (3-5 years) rephrasing it as: “To

implement and manage the development and/or maintain the information systems in an

organization”. As a result, CIS faculty and the Advisory Board will have to further analyze this

objective in the August 2011 meeting.

Information Systems Alumni Report

19

Objective 2: To apply technological, analytical, and critical thinking skills in the solution of

problems related to information systems in organizations.

Two statements were used to measure this objective: “I have applied technological skills in the

solution of problems related to information systems in organizations” and “I have applied

analytical and critical thinking skills in the solution of problems related to information systems in

organizations”.

Analysis

Results demonstrate attainment of the objective, therefore no actions are recommended.

Nevertheless, CIS faculty may review this objective in the August 2011 meeting.

Objective 3: To take into consideration the context in which information systems operate, when

implementing and managing these systems.

Analysis

The results of this objective demonstrate a high level of attainment of the objective; no actions

are currently. However, CIS faculty and the Advisory Board may further analyze this objective

in the August 2011 meeting.

Objective 4: To maintain his professional expertise by updating his knowledge in technology

and information systems.

The statement “I maintain my professional expertise by updating my knowledge in technology

and information systems” was used to measure this objective.

Analysis

Results demonstrate a high level of attainment of this objective; no actions are needed at the

present moment. The objective should be rephrased to remove gender reference. As a

consequence, CIS faculty and the Advisory Board may have to further analyze this objective in

the August 2011 meeting.

Objective 5: To perform his functions showing respect and appreciation for ethical values,

interpersonal relationships, communication, and team work.

The statements used to measure this objective were: “I perform my functions showing respect

and appreciation for ethical values and interpersonal relationships” and “I perform my functions

emphasizing communication and team work”. Both statements had a high percentage of

respondents indicating they had attained this skill.

Analysis

Information Systems Alumni Report

20

Attainment of this objective was reflected on the study results; as a result no actions are currently

needed. CIS faculty may recommend changes to the objective at the August 2011 meeting, for

example, to rephrase the objective to remove gender reference.

Recommendation for the objectives

The objectives of the University of Puerto Rico, Río Piedras Campus Computer and Information

Systems program do not need major changes at the moment according to the results obtained

from the sample in the alumni survey for the program’s objective assessment conducted in April

2011. There is no need to take action for the remediation of any of the objectives, except for

objective one, which has a score lower than expected. It is highly recommended further

discussion of the results of this study at the August 2011 CIS faculty and Advisory Board

meeting.

Continuous Improvement of the objectives

In order to continuously improve the UPR-RP CIS program, even when most of the objectives

of the program met the minimum score, all the objectives should be revised by the CIs faculty

and the Advisory Board in the August 2011. The meeting discussion should be focus on

objectives one, three and four since its score was the lowest. This will help to maintain the

achievement of the program’s objectives. An alumni survey or an alumni focus group to assess

the objectives should be conducted regularly. Table 4 shows the timeline for the objective’s

continuous improvement.

Table 4: Timeline for the continuous improvement of the objectives

Date Title of the activity Description of the activity

1 May 2008 UPR-RP CIS

revision approved by

its Academic Senate.

The University of Puerto Rico, Rio Piedras Campus

Academic Senate approved the CIS revision. The revision

started on January 2006 as part of a Campus effort to revise

its bachelors programs. The CIS program was subsequently

evaluated, a proposal including Program Educational

Objectives and Student Outcomes, was written and approved

by the program’s faculty, by the Department, the College,

and finally, by the Academic Senate.

2 December

2009 and

January

2010

Objectives

consultation to the

CIS program

constituents

The objectives of the CIS program were discuss

and validated by its constituents (industry, alumni,

and students).

3 November

2010

CIS Advisory Board

meeting to review

This was the first CIS Advisory Board meeting to

discuss and validate the program’s educational

objectives. The CIS program’s objectives were

Information Systems Alumni Report

21

the objectives endorsed by the CIS Advisory Board.

4 March

2011

CIS Advisory Board

meeting

This was the second CIS Advisory Board meeting

to discuss the survey instrument for the study of

the alumni assessment of the program’s

objectives..

5 April

2011

Pilot Alumni Survey

to assess the CIS

program objectives

A pilot alumni survey was conducted to assess the

program’s objectives. Its results show that all the

objectives were met according to the sample.

6 August

2011

CIS Faculty meeting This meeting is to discuss the results of this study,

particularly the CIS program objectives.

7 August

2011

CIS Advisory Board

meeting to review

the objectives

This will be the third CIS Advisory Board meeting

to discuss the results of the pilot alumni survey.

Their recommendations will be considered for the

program’s continuous improvement.

8 To be

decided

CIS Alumni

assessment of the

objectives

A CIS Alumni assessment of the objectives will be

conducted either by focus group or by a survey.

Since the objectives are the career and professional accomplishment of alumni, three years

from graduation, a continuous improvement process to assess the objectives is in place since

the approval of the UPR-RP CIS program revision.

Conclusions for the outcomes

According to the sample, the University of Puerto Rico, Río Piedras Campus Computer and

Information Systems program’s alumni agree that they have met the outcomes. The outcomes

are supposed to be measured at the time of the graduation. But, since they were already

answering the survey asking the alumni about the outcomes can be useful for program’s

continuous improvement. The results of this study regarding the outcomes can be compared

with other studies that have been done regarding the program’s outcomes.

A four-point Likert scale was used to evaluate each of the abilities from the Information

Systems education. The scale consists of “Highly effective”, “Very effective”, “Moderately

effective”, and “Not effective”.

In order to determine if the outcome was an ability that the alumni indicated to have, the

minimum expected score was decided to be 75% or more after adding the percentages of

“Highly effective” and “Very effective” scores.

Information Systems Alumni Report

22

As a strategy to measure the abilities, there was only one statement per outcome in the survey.

Table 5 shows the summary of the outcome (ability) as indicated by alumni. According to the

alumni who participate in the survey (n=31), no action have to be taken since all the outcomes

comply with the minimum score, except for outcomes three and four.

Table 5: Summary of the outcome (ability) as indicated by alumni

UPR-RP CIS

Outcomes

Highly

Effective

Very

Effectiv

e

Total

Score (minimum

is 75 or

more)

Actio

n

1

An ability to analyze an operation

within an organization, identify

problems and make

recommendations to solve these

problems.

45.2% 38.7% 83.9% None

2 An ability to select or design a

system to solve the problems

identified in an operation.

38.7% 41.9% 80.6% None

3

An ability to plan and supervise the

implementation of a system that

solves the problems identified in an

operation.

19.4% 51.6% 71% Yes

4

An ability to use current

techniques, skills, tools and best

practices to design, implement and

manage information systems.

38.7% 32.3% 71% Yes

5

An ability to understand the impact

that organizational, local and

global environments have in the

implementation and management

of information systems.

29.0% 61.3% 90.3% None

6

An ability to value the protection

of information system resources in

an organization, and to identify

ways in which this protection can

be achieved.

41.9% 41.9% 83.8% None

Information Systems Alumni Report

23

UPR-RP CIS

Outcomes

Highly

Effective

Very

Effectiv

e

Total

Score (minimum

is 75 or

more)

Actio

n

7

An ability to be aware of the high

level of change in the Information

Systems field, and the need to use

different mechanisms to update

your knowledge.

51.6% 35.5% 87.1% None

8

An ability to recognize the

importance of ethical values and

interpersonal relationships in an

information system professional.

71.0% 9.6% 80.6% None

9 An ability to communicate

effectively with a range of

audiences.

48.4% 35.5% 83.9% None

10 An ability to function effectively in

teams seeking to accomplish a

common goal.

58.1% 38.7% 96.8% None

Recommendation for the outcomes

The outcomes of the University of Puerto Rico, Río Piedras Campus Computer and Information

Systems program do not need changes at the moment according to the results obtained from the

sample in the alumni survey for the program’s objectives and outcomes assessment conducted in

April 2011. There is no need to take action for the remediation of any of the outcomes, except

for outcomes three and four, which has a score lower than expected. Further discussion of the

study results regarding the program’s outcomes in the beginning of the next semester by the

Faculty.

Continuous Improvement of the outcomes

In order to continuously improve the UPR-RP CIS program, even when most of the outcomes

of the program met the minimum score; all outcomes should be revised by the Faculty at the

beginning of the next semester. The meeting discussion should be focused on outcomes three

and four since its score was the lowest. This will help the attainment of the program’s

outcomes in the future. The CIS program has different ways to measure the outcomes. Those

Information Systems Alumni Report

24

measurements are rubrics for assigned projects and exit interviews. Even though the outcomes

should only be measured at the time of the graduation of the student, the fact that those are also

measured in this study can contribute to watch for patterns.

This study only presents the alumni perspective. Its results can only be useful if compared with

other studies that are being conducted that measure the program’s outcomes by the students at

the time of their graduation.

Information Systems Alumni Report

25

Appendices

Information Systems Alumni Report

26

Appendix 1

IS Survey

IS Survey

27

IS Survey

28

IS Survey

29

IS Survey

30

IS Survey

31

IS Survey

32

IS Survey

33

Information Systems Alumni Report

34

Appendix 2

List of independent and dependent variables

List of independent and dependent variables

35

List of independent variables

For the objectives

Objective 1: To implement and manage information systems in an organization.

Name of the independent

variable

Survey item

ObjImplementIS I I have implemented information systems in an organization.

ObjManageDevelopIS I have managed the development of information systems in an

organization.

Objective 2: To apply technological, analytical, and critical thinking skills in the solution of

problems related to information systems in organizations.

Name of the independent

variable

Survey item

ObjTechIS I have applied technological skills in the solution of

problems related to information systems in organizations.

ObjAnalyticCriticThinkIS I have applied analytical and critical thinking skills in the

solution of problems related to information systems in

organizations.

Objective 3: To take into consideration the context in which information systems operate, when

implementing and managing these systems.

Name of the independent

variable

Survey item

ObjContextIS I take into consideration the context in which information

systems operate (organizational culture, functional areas,

industry regulations, etc.), when implementing and managing

these systems.

Objective 4: To maintain his professional expertise by updating his knowledge in technology and

information systems.

Name of the independent

variable

Survey item

List of independent and dependent variables

36

ObjLifeLongLearnIS

I maintain my professional expertise by updating my

knowledge in technology and information systems.

Objective 5: To perform his functions showing respect and appreciation for ethical values,

interpersonal relationships, communication, and team work.

Name of the independent

variable

Survey item

ObjRespectEthical

I perform my functions showing respect and appreciation for

ethical values and interpersonal relationships

ObjCommTeamWork

I perform my functions emphasizing communication and

team work.

For the outcomes

Outcome 1: An ability to analyze an operation within an organization, identify problems

and make recommendations to solve these problems.

Name of the independent

variable

Survey item

OutAnalyze

An ability to analyze an operation within an organization,

identify problems and make recommendations to solve these

problems.

Outcome 2: An ability to select or design a system to solve the problems identified in

an operation.

Name of the independent

variable

Survey item

OutDesign

An ability to select or design a system to solve the problems

identified in an operation.

List of independent and dependent variables

37

Outcome 3: An ability to plan and supervise the implementation of a system that

solves the problems identified in an operation.

Name of the independent

variable

Survey item

OutPlanSuperImplem

An ability to plan and supervise the implementation of a

system that solves the problems identified in an operation.

Outcome 4: An ability to use current techniques, skills, tools and best practices to

design, implement and manage information systems.

Name of the independent

variable

Survey item

OutCurrentTech

An ability to use current techniques, skills, tools and best

practices to design, implement and manage information

systems.

Outcome 5: An ability to understand the impact that organizational, local and global

environments have in the implementation and management of information systems.

Name of the independent

variable

Survey item

OutImpact

An ability to understand the impact that organizational, local

and global environments have in the implementation and

management of information systems.

Outcome 6: An ability to value the protection of information system resources in an

organization, and to identify ways in which this protection can be achieved.

Name of the independent

variable

Survey item

OutProtectionInfo

An ability to value the protection of information system

resources in an organization, and to identify ways in which

List of independent and dependent variables

38

this protection can be achieved.

Outcome 7: An ability to be aware of the high level of change in the Information

Systems field, and the need to use different mechanisms to update his knowledge.

Name of the independent

variable

Survey item

OutLongLearning

An ability to be aware of the high level of change in the

Information Systems field, and the need to use different

mechanisms to update your knowledge.

Outcome 8: An ability to recognize the importance of ethical values and interpersonal

relationships in an information systems professional.

Name of the independent

variable

Survey item

OutEthical

An ability to recognize the importance of ethical values and

interpersonal relationships in an information systems

professional.

Outcome 9: An ability to communicate effectively with a range of audiences.

Name of the independent

variable

Survey item

OutComEffectively

An ability to communicate effectively with a range of

audiences.

Outcome 10: An ability to function effectively in teams seeking to accomplish a

common goal.

List of independent and dependent variables

39

Name of the independent

variable

Survey item

OutTeamWork

An ability to function effectively in teams seeking to

accomplish a common goal.

List of independent and dependent variables

40

List of dependent variables

For the objectives

Name of the dependent variable

ObjDepVar

Survey item

“I believe that my career and professional accomplishments were achieved in part due to the

Bachelor's degree I hold.”

For the outcomes

Name of the dependent variable

OutDepVar

Survey item

“I believe that my bachelor’s degree major helped me developed the IS abilities in an effective

way.”