outcomes assessment results - hputx.edu · general program islos assessed by this measure: 1,2,4 2....

IACBE Annual Report: 2013-14 1

Outcomes Assessment Results For Academic Year: 2013-14

Section I: Student Learning Assessment

School of Business

Student Learning Assessment for the Accounting (BBA) Program

Program Intended Student Learning Outcomes (Program Core ISLOs)

1. Students will be able to explain the concepts and techniques associated with the areas finance, management and marketing.

2. Students will be able to apply the principles, techniques and functions involved in accounting.

3. Students will be able to present clear and concise oral and written forms of communication as required in the accounting profession.

4. Students will be able to apply analytical and critical thinking skills in solving complex problems, including creativity and ethical analysis.

Assessment Instruments for Intended Student Learning Outcomes— Direct Measures of Student Learning:

Performance Objectives (Targets/Criteria) for Direct Measures:

1. Comprehensive Business Exam (CBE) At least 75% of students will score above the national average in the areas of finance, management and marketing. The same target is set for the area of accounting.

General Program ISLOs Assessed by this Measure: 1,2

2. Capstone Glo-Bus Simulation 65% of students will score above the 50th percentile on financial management and marketing management. 75% will score above the 50th percentile in Strategic Analysis and Planning.


3. Accounting Research Paper 100% of students will achieve an “acceptable” or higher rating on the writing component of the paper based on a writing assessment rubric. General Program ISLOs Assessed by this Measure: 3


Assessment Instruments for Intended Student Learning Outcomes— Indirect Measures of Student Learning:

Performance Objectives (Targets/Criteria) for Indirect Measures:

1. Senior Exit Survey 90% of the students will rate their understanding of finance, management, and marketing at or above the 4.0 level on a 5 pt. scale. The same target was set for writing and oral communication skills. Also, the same target was set for their confidence related to analytical and critical thinking skills.

General Program ISLOs Assessed by this Measure: 1,3,4

2. Senior Exit Interview 90% of the students will report that they have a functional understanding of the language, techniques and functions involved in accounting. General Program ISLOs Assessed by this Measure: 2

Assessment Results: Accounting (BBA) Program

Summary of Results from Implementing Direct Measures of Student Learning:

1. Comprehensive Business Exam (CBE)

100% of the students scored above the national average in finance, management and marketing. The avg score was 84%. (ISLO 1)

100% of the student scored above the national average in accounting. The corresponding score in accounting was 95%. (ISLO 2)

2. Capstone Glo-Bus Simulation

100% of the students scored above the 50th percentile and their avg scores follow:

Financial Management 73rd percentile (ISLO 1)

Marketing Management 97th percentile (ISLO 1)

Strategic Analysis and Planning 80th percentile (ISLO 4)

3. Accounting Research Paper

100% of the students achieved an”acceptable” or higher rating on the writing component on the final research paper in the required research course. (ISLO 3)


Summary of Results from Implementing Indirect Measures of Student Learning:

1. Senior Exit Survey

100% of the students rated their confidence level above 4.0 each of the following areas:

Finance (ISLO 1)

Marketing (ISLO 1)

Management (ISLO 1)

Writing skill (ISLO 3)

Oral communication skill (ISLO 3)

Analytical skill (ISLO 4)

Critical thinking skill (ISLO 4)

2. Senior Exit Interview

100% of the students reported that they were adequately prepared to be successful in the accounting profession based on their understanding of the concepts, techniques and functions of accounting discipline.

Summary of Achievement of Intended Student Learning Outcomes:

Intended Student Learning Outcomes

Learning Assessment Measures

General Program ISLOs

Comprehensive

Business

Exam (CBE)

Capstone

Glo-Bus

Simulation

Accounting

Research

Paper

Direct Measure 4

Senior

Exit

Survey

Senior

Exit

Interview

Indirect Measure 3

Indirect Measure 4

Performance Target Was…

Performane Target Was…







1. Students will be able to explain the concepts and techniques associated with the areas finance, management and marketing.

Met Met N/A Met Met

2. Students will be able to apply the principles, techniques and functions involved in accounting.

Met N/A N/A Met Met


3. Students will be able to present clear and concise oral and written forms of communication as required in the accounting profession.

N/A N/A Met Met N/A

4. Students will be able to apply analytical and critical thinking skills in solving complex problems, including creativity and ethical analysis.

N/A Met Met Met N/A

Proposed Courses of Action for Improvement in Learning Outcomes for which Performance Targets Were Not Met:

1. All performance targets were met.





School of Business

Student Learning Assessment for Business Administration Program (BS and BAAS)

General Program Intended Student Learning Outcomes (General Program ISLOs)

1. Students will be able to explain the concepts and principles in the functional areas of accounting, finance, management and marketing.

2. Students will be able to apply their knowledge to business situations from an economic, financial, legal and ethical basis.

3. Students will be able to present information in written, oral and digital forms in a professional manner.

4. Students will be able to apply analytical and critical thinking skills in solving problems.



1. Comprehensive Business Exam (CBE) 55% of students will score at or above the benchmark range (mean from Beta testing) in the areas of accounting, finance, management, and marketing.

65% os students will score above the benchmark range in the areas of economics and business law.

70% of the students will attain a 67% or better score on the criterion,”demonstrates an understanding of the synergistic effects of the marketing mix relevant to market opportunities and applying this understanding to the development of a marketing plan.”

80% of the students will attain a 67% or better score on the criterion, “demonstrates an understanding of the risk-return relationship and its effect on decision-making.”


2. Departmental Exam – Business Administration Benchmark (BAB) 60% of students will score at or above the benchmark range in the areas of accounting, finance, management and marketing.

65% of students will score at or above the benchmark range in the areas of economics and business law.


3. Final Presentation in Capstone Course 65% of students will perform at the exemplary level with regard to their oral communication skills in the final presentation as evaluated by a panel of business faculty using the “Competent Speaker” rubric assessment.

General Program ISLOs Assessed by this Measure: 3




1. Senior Exit Survey 90% of the students will rate their understanding of management and marketing at or above the 4.0 level on a 5 pt. scale.

50% of the students will rate their understanding of accounting and finance at or above a 4.0 level.

90% of students will report that they have developed higly competent skills in written, oral and digital forms of communication.

90% of students will report that they have become highly competent in their analytical and critical thinking skills.


2. Senior Focus Group 100% of students will indicate that they felt adequately prepared to be successful in the business world based on their knowledge of accounting, finance, management and marketing.

90% of students will be able to describe specific instructional activities that specifically applied concepts from economics, business law and ethics in a manner that prepared them for the business world.

100% of students will be able to describe specific instructional activities that enhanced their communication skills and prepared them for the business world.

100% of students will be able to describe a specific instructional activity that required a structured approach to analyzing data and then applying critical thinking skills to solve the problem.

General Program ISLOs Assessed by this Measure: 1,2,3,4


Assessment Results: Business Administration Program (BS and BAAS)



Subscores on the CBE are reported in the following areas:

Accounting (ISLO 1)

Finance (ISLO 1)

Management (ISLO 1)

Marketing (ISLO 1)

Economics (ISLO 2)

Business Law (ISLO 2)

Criterion measuring analysis and critical thinking related to marketing strategy (ISLO 4)

Criterion measuring analysis and critical thinking related to decision-making based on the risk-return relationship (ISLO 4)

The results for this outcome will be reported in three categories: BS Degree with Bus Adm Major in Brownwood, BAAS Degree with Bus Adm major in El

Paso, and BAAS degree with a Bus Adm major in Brownwood.

Percentage Achieving the Target Criteria

BS with major in Business Administration Brownwood: ACC -50% FIN – 50% MGT – 17% MKT – 68%

BAAS with major in Business Administration El Paso: ACC – 75% FIN – 100% MGT – 50% MKT- 50%

BAAS with major in Business Administration Brownwood: ACC – 100% FIN – 100% MGT – 100% MKT – 100%

The CBE exam results for students majoring in Business Administration follow:


BS degree in Brownwood: Economics 83% Business Law 17%

BAAS degree in Brownwood: Economics 100% Business Law 100%

BAAS degree in El Paso: Economics 100% Business Law 75%

Overall, 82% of the students attained a 67% or higher score on the marketing strategy criterion that assessed analytical and critical thinking skills.

100% of the Brownwood students scored 67% or higher while only 50% of the El Paso students met this criteria. ISLO 4

Overall 64% of the students attained a 67% or higher score on this criterion related to analyzing the effect of the risk-return relationship as it

impacts decision-making. 68% of the Brownwood students met the target while 50% of the El Paso students scored at 67% or higher. ISLO 4


2. Departmental Exam – Business Administration Benchmark (BAB)

The BAB exam results will provide subscores in the following areas:

Accounting (ISLO 1)

Finance (ISLO 1)

Management (ISLO 1)

Marketing (ISLO 1)

Economics (ISLO 2)

Business Ethics (ISLO 2)

The departmental Business Administration Benchmark exam was developed this past year with the 2013 fall semester students being used to create a benchmark

score.


BS with a Business Administration major in Brownwood: ACC-68% FIN-68% MGT-50% MKT- 50%

BAAS with Business Administration major in El Paso: ACC-0% FIN-75% MGT-100% MKT-25%

BAAS with Business Administration major in Brownwood: ACC-100% FIN-0% MGT-100% MKT-100

The results for students majoring in business administration according to the Business Administration Benchmark (BAB):


BS degree in Brownwood: Economics 40% Business Ethics 67%

BAAS degree in Brownwood: Economics 0% Business Ethics 100%

BAAS degree in El Paso: Economics 75% Business Ethics 25%

3. Final Presentation in Capstone Course

Only 44% of the students performed at the exemplary level on their capstone course final presentation. The greatest weakness was related to the

introduction in which the majority of students did not communicate the thesis or purpose of their presentation. The organizational pattern was

weak as well. ISLO 3




The Senior Exit Survey provided results in the following areas:

Management confidence level (ISLO 1)

Marketing confidence level (ISLO 1)

Accounting confidence level (ISLO 1)

Finance confidence level (ISLO 1)

Written communication skill (ISLO 3)

Oral communication skill (ISLO 3)

Digital communication skill (ISLO 3)

Analytical skill (ISLO 4)

Critical thinking skill (ISLO 4)

Confidence Level Per Business Discipline Percentage Achieving the Target Criteria

BS and BAAS with a major in Business Administration – Brownwood: MGT–86% MKT–57% ACC-14% FIN-29%

BAAS with a major Business Administration – El Paso: MGT–75% MKT–75% ACC-25% FIN-25%

Percentage Achieving the Target Criteria Related to Communication Skills

71 % of Brownwood students reported competency in written communications.

75% of El Paso students reported competency in written communications.

57% of Brownwood students reported competency in oral communications.

75% of El Paso students reported competency in oral communications.

86% of Brownwood students reported competency in digital communications.

75% of El Paso students reported competency in digital communications.

Confidence Level Related to Analytical and Critical Thinking Skills

Overall 73% of the students reported that they felt competent in their analytical and critical thinking skills. There was no significant difference in the results

between Brownwood and El Paso students.


2. Senior Focus Group

Data from the senior focus group yielded results in the following areas:

Preparedness based on knowledge of accounting, finance, management and marketing (ISLO 1)

Preparedness based on knowledge of economic, legal and ethical principles (ISLO 2)

Preparedness based on competent communication skills (ISLO 3)

Preparedness based on their analytical and critical thinking skills (ISLO 4)

The Brownwood BS and BAAS students with a major in business administration participated in this assessment as one group. The results follow:

1. 100% agreed that they felt adequately prepared to be successful based on their knowledge of accounting, finance, management and marketing fields.

2. Students commented on the helpfulness of repetition of exercises on key topics, especially finance.

3. Students described “scenario type learning” with stories about real life applications.

4. The Glo-Bus simulation was regarded as a helpful tool to see how all the parts of a business operate.

100% of the Brownwood students majoring in business administration felt prepared for the business world with regard to the economic, legal and ethical business

environments. 75% of the El Paso students indicated that they felt prepared. One student in El Paso stated in strong terms that there was a need for an internship

or work study program. ISLO 2

100% of the students in Browwnood and El Paso were able to describe specific activities that were meaningful as related to the areas of economics, business law

and ethics. Most frequently mentioned were case study presentations, term projects, online simulations, and field trips. ISLO 2

100% of Brownwood and El Paso students were able to describe class activities that enhanced their communication skills. Activities mentioned include: daily

reports on journal article critques, student-professor interactions during class, case study group work and presentations, research paper presentations, and role

playing activities. ISLO 3

100% of the students described a specific project or class activity that they felt was effective in developing analytical and critical thinking skills. The following

activities surfaced: online business strategy simulation, HR strategy case on global expansion, international business projects, projects in macroeconomics,

analyzing 10K financial reports from real companies, and case studies. ISLO 4



Intended Student Learning Outcomes Learning Assessment Measures


Comprehen-sive Business

Exam (CBE)

Bus Admin

Benchmark

(BAB)

Final Presentation In Capstone

Direct Measure 4

Senior

Exit

Survey

Senior

Focus

Group

Indirect Measure 3

Indirect Measure 4









1. Students will be able to explain the concepts and principles in the functional areas of accounting, finance, management and marketing.

Not Met Not Met N/A Not Met Met

2. Students will be able to apply their knowledge to business situations from an economic, financial, legal and ethical basis.

Not Met Not Met N/A Met Met

3. Students will be able to present information in written, oral and digital forms in a professional manner.

N/A N/A Not Met Not Met Met

4. Students will be able to apply analytical and critical thinking skills in solving problems.

Met N/A N/A Not Met Met


1. ISLO #1:

As a result of the recent IACBE site visit, it was recommended that the data be reported according to the degree type as well as by campus. In another year,

results for a BS degree with a Business Administration major will be reported for the New Braunfels campus.

The only significant target missed was in the area of management on the Brownwood campus. In the past two years, faculty course load assignments have

shifted to accommodate new graduate courses. The Principles of Management course has been handed to another professor who will make a recommendations

for the textbook and related materials. Other modifications to the syllabus will be considered by the new instructor and program director for the management

majors. Although the areas of accounting and finance missed the target slightly, the 55% target will be used again next year.

It is interesting to note that the one BAAS student at Brownwood scored above the benchmark in all four areas and if this data was included with the other

business administration majors in Brownwood, then 3 of the 4 areas would have met or exceed the target.


The El Paso students performed very well in accounting and finance. The management and marketing areas were slightly below our target of having 55% of our

students at or above the benchmark range. Another business instructor will be employed beginning this fall which will result in a shift in faculty course

assignments. This will provide the faculty in El Paso to be able to teach to their strengths.

The BAB benchmark targets need to be reviewed and recalculated after the first two years of administration. The test instrument needs to be refined and

reviewed by faculty at both campuses with consideration being given to the consistency of key learning outcomes that need to be stated in each course syllabus.

Since it is a new instrument and needs more review, the target of 60% will be kept for next year’s assessment cycle.

Regarding the Senior Exit Survey, the only areas that were close to the criteria for success were MGT at Brownwood, MGT and MKT at El Paso. Students

generally self-report a lower confidence in accounting and finance areas which was true in these results. A rating of a 4 or 5 means the students have an above

average confidence level in each of these areas. These results will be shared with faculty as a concern that needs to be addressed within the related courses.

2. ISLO #2:

The CBE results for student performance in economics was very favorable for all students. The one area that needs attention is the area of business law in

Brownwood. This past year a new professor began teaching the business law course. She is the director of the pre-law program for the university and should

make a difference in student learning. Since it is a junior-level course we will not see the results until we review the 2014-15 assessment data.

The BAB results for student performance are mixed. The Brownwood students exceeded the target in the area of business ethics. This course has been taught by

Dr. Lois Patton and she has taken much pride and ownership in the undergraduate ethics course. The El Paso students will see a mix of instructors as we begin

an MBA program and hire another business professor. The plan will be to have fewer preps per instructor in El Paso so more ownership can take place. The

economics courses need to be reviewed as far as curriculum alignment between micro and macro economics, as well as the overall curriculum for the survey of

economics course.

3. ISLO #3:

The business faculty needs to pay more attention to instructing students on the basics of giving a presentation and then holding them accountable

for doing it the right way. In particular, an emphasis on how to create a clear organizational pattern. The students need to be taught how to deliver

an effective introduction. Since not all business majors require business communications, instructors need to provide students with opportunities

to learn and practice these communication skills. This will be a topic for the fall inservice training with the business faculty.

Regarding the Senior Exit Survey, of the 3 areas of communications, digital communications received the highest rating overall and met the target. That provides

excellent feedback for the CIS 1379 and CIS 3319 courses required in the degree. The lowest rated area was related to oral communications, especially at the

Brownwood campus. Almost half of the students did not feel competent with their oral communication skills. The business faculty will be informed of this

result and encouraged to find ways to integrate activities that require students to speak in front of the class and in small groups.

4. ISLO #4:

The 90% standard on the Senior Exit Survey may be unrealistic, however, it will continue to be set at that level for next year. The business faculty has focused

on this learning outcome for the past four years and there has been progress made in the area of analytical and critical thinking skills. The faculty will be

presented this information along with the specific activities that students perceived as being effective as stated in the senior focus group.


School of Business

Student Learning Assessment for the Management Program (BBA)


1. The students will be able to explain and demonstrate knowledge in the functional area of management.

2. The students will be able to evaluate ethical and socially responsible situations and apply such principles in decision-making.

3. The students will be able to explain the role and operations of the human resource management function.

4. The students will be able to apply the decision-making model within an organizational context and their professional career.



1. Comprehensive Business Exam (CBE) 55% of students will score at or above the mean average in the management

portion of this exam as determined by the beta test results.

60% of the students will score above the national average in the area of

Social Responsibility (“Social Environment” on the CBE exam).


2. Capstone Course Simulation: Glo-Bus Business Simulation 60% of students will score above the 50th percentile ranking on the

operations management portion of the Glo-Bus business strategy simulation

in the capstone course.

50% of the students will perform at or above the 50th percentile on the

corporate social responsibility measure.

50% of the students will score above the 50th percentile ranking in the

learning assurance report pertaining to HR management.


3. HR Benchmark Exam 80% of the students will meet or exceed the benchmark standard on the HR

management departmental exam. General Program ISLOs Assessed by this Measure: 3


4. Paper and Presentation in Principles of Management Course 100% of the students will be able to articulate in writing how they applied

the decision-making model related to their choice of HPU.

100% of the students will be able to present to their classmates a problem

they have solved as a result of applying the decision-making model.




1. Senior Exit Survey 90% of the students will rate their understanding of management at or above

a 4.0 on a 5-pt. scale.

90% of the students will be able to articulate specific concepts within the

field of ethics when asked, “Tell me something specific that has prepared

you for the business world in making ethical decisions.”

General Program ISLOs Assessed by this Measure: 1, 3,4

2. Senior Focus Group 100% of the students will report that they feel adequately prepared to be

successful in the business world based on their knowledge of management

functions.

80% of the students will be able to articulate in writing and be able to

discuss their Biblical world view as it relates to ethical decisions.

80% of the students will be able to describe the selection and recruitment

processes as they relate to their own career goals.

80% of the students will be able to describe the business decision model as it

relates to a major purchase.

General Program ISLOs Assessed by this Measure: 1,2,3,4

General Program ISLOs Assessed by this Measure: Outcomes List

Major, Concentration, Specialization, Emphasis, Option, Track ISLOs Assessed by this Measure: Outcomes List


Assessment Results: Management Program (BBA)



50% of the graduates majoring in management scored at or above the national mean on the management portion of the CBE exam. Only two

management majors graduated this year. One student performed very well at the 87% percentile on a criterion referenced basis while the other

student was one correct answer away from meeting the national mean score. (ISLO 1)

100% of the students scored within the national mean on the Social Environment portion in the CBE exam. One student was one correct answer

away from a perfect score on this criterion while the other student was at the bottom of the mean range. (ISLO 2)

2. Capstone Course Simulation: Glo-Bus Simulation

In reviewing the learning assurance report for Glo-Bus simulation, both students (100%) exceeded the 50th percentile ranking for operations

management. (ISLO 1)

One student scored at the 48th percentile while the other scored at the 5th percentile on the Social Environment criterion. The student with the

lowest score reported in his presentation that he did not focus on a long-range strategic plan, but rather made decisions that were based on short-

term financial returns. Both students were below the class average in this category which means that the students as a whole did apply socially

responsible decision-making within the simulation. (ISLO 2)

Both of the graduating management majors did poorly on the HR management criterion as reported in the Learning Assurance Report by Glo-Bus.

Neither met the 50% percentile. This coincides with an earlier report where both students did not do well in the area of social responsibility. Both

scored very well in the areas of finance and marketing skill. (ISLO 3)

3. HR Benchmark Exam

100% of the management majors met or exceeded the benchmark target. The mean score for the management majors was 80% this year.

(ISLO 3)

4. Paper and Presentation in Principles of Management Course

100% of the students were able to articulate in writing how they selected HPU as it related to the business decision-making model. This

information was included in a report to the HPU Admissions Office. (ISLO 4)

100% of the students presented successfully in class a problem they solved by applying the business decision-making model. (ISLO 4)




100% of management students rated their understanding of management above a 4.0 on a 5-pt. scale. The average rating was a 4.5. Data was

derived from the School of Business Senior Exit Survey. (ISLO 1)

The Senior Exit Survey designed for management majors only was not administered this year due to a change of program directors during the

year. Therefore, data was not collected for ISLO #2,3,4.


Both of the management majors (100%) felt they were adequately prepared for the business world based on their knowledge of management.

(ISLO 1)

100% of the students were successful in writing their Biblical world view as it relates to ethical decision-making. (ISLO 2)

The Senior Focus Group for management majors did not focus attention to the matters described in ISLO 3 and 4.





Comp Bus

Exam

(CBE)

Capstone

Simulation

Glo-Bus

HR

Benchmark

Exam

Paper

And

Presentation

Senior

Exit

Survey

Senior

Focus

Group

Indirect Measure 3

Indirect Measure 4









1. The students will be able to explain and demonstrate knowledge in the functional area of management.

Not Met Met N/A N/A Met Met

2. The students will be able to evaluate ethical and socially responsible situations and apply such principles in decision-making.

Met Not Met N/A N/A Met Met

3. The students will be able to explain the role and operations of the human resource management function.

N/A Not Met Met N/A Met Met

4. The students will be able to apply the decision-making model within an organizational context and their professional career.

N/A N/A N/A Met Not Met Met


1. Although the target was slightly missed (50% rather than 55%), a review of the CBE instrument is needed. The CBE assessment provides

excellent data to examine five learning objectives for the fields of management. It is recommended that the individual objectives be reviewed to

determine strengths and weaknesses within the management curriculum.

2. The student with the lowest score reported in his presentation that he did not focus on a long-range strategic plan, but rather made decisions that

were based on short-term financial returns. Both students were below the class average in this category which means that the students as a whole

did apply socially responsible decision-making within the simulation. No corrective action is recommended at this time. If the same occurs next

year, then a further review of why the management majors are doing poorly will be recommended.


3. Although the two students included in this assessment did poorly, it is not time to make any major changes to the curriculum pertaining to the HR

function. Both students embraced strategies that focused on production and marketing efficiencies that would yield positive short-term financial

results. In the long run, neither student performed very well in the overall competition and were not rewarded accordingly for investing in their

employees or their external environments. The class as a whole did much better in these areas. This measure needs to be monitored over a few

years to see if a true trend has occurred.

4. It is recommended that the new program director for management review and redesign the Senior Exit Survey so that it yields accurate data pertaining to the students’ confidence in applying the decision-making model. The delivery of the survey may be accomplished through the online BlackBoard instructional format.

School of Business

Student Learning Assessment for Marketing Program (BBA)


1. Students will be able to explain the functional areas of marketing.

2. Students will be able to chart a career path in the field of marketing.

3. Students will be able to apply a Christian-service perspective to their future career.



1. Comprehensive Business Exam (CBE) 50% of students will score above the national average (Beta test data) in the

area of marketing on the CBE exam. General Program ISLOs Assessed by this Measure: 1

2. Capstone Course Simulation: Glo-Bus 50% of students will score above the 50th percentile ranking in the

marketing related areas in the Learning Assurance report of Glo-Bus. General Program ISLOs Assessed by this Measure: 1

3. Marketing Internship 100% of the marketing graduates will successfully complete an internship in

their chosen marketing field. General Program ISLOs Assessed by this Measure: 2


4. Marketing Capstone Course Project 100% of marketing majors will develop a personal marketing plan as part of

the course requirements in the capstone marketing research course.

80% of the students will achieve a “Basic” or higher rating on the public

service component of the marketing capstone class and in their written case

study report of their world-life-view and how that relates to a serving

profession.




1. Senior Exit Survey 90% of the students will rate their understanding of marketing at or above a

4.0 on a 5pt scale.

90% of the students will report that they have developed competent

Christian service-mentality skills as a result of the courses in their major.


2. Senior Focus Group 100% of the students will report that they feel adequately prepared to be

successful in the professional marketing world based on their knowledge of

marketing functions.

90% of the students will report that they understand the functions and

concepts of marketing (at 4 or better on a 5 point Likert scale) and feel

adequately prepared to find work in marketing or the field of their choice

including further graduate study.

100% of the students were motivated to reflect the university’s Christian

influence that was taught within their major that significantly enhanced their

understanding of the importance of a personal work ethic and putting others

(or clients) interest as a priority.

General Program ISLOs Assessed by this Measure: 1, 2


Assessment Results: Marketing Program (BBA)


1. Comprehensive Business Exam

57% of the marketing majors scored above the national mean in marketing on the CBE exam. 86% were within one standard deviation of the

mean. ISLO 1

2. Capstone Course Simulation

72% of the marketing majors in this year’s graduating class scored above the 50th percentile on marketing management skills on capstone

simulation, Glo-Bus ISLO 1

3. Marketing Internship

100% of the marketing majors graduating this year have successfully completed an internship related to the marketing field. ISLO 2

4. Marketing Capstone Course Project

100% of the marketing majors have developed a personal marketing plan as part of the course requirements in the capstone marketing research

course. Also, all marketing majors met with the marketing program director for purposes of career guidance and planning. ISLO 2



100% of the students reported that they were confident (4.0+) in their understanding of marketing. All but one student gave a rating of 5.0 on this criterion.

ISLO 1

Data pertaining to the Christian service component was not reported during the spring semester due to the absence of the marketing program

director. Dr. Mark Patton, director of the marketing program passed away in April. ISLO 2


100% of the students reported that they felt adequately prepared for the marketing profession. As mentioned in the senior exit survey, they were very

complimentary of Dr. Mark Patton and his courses in marketing. ISLO 2

Data pertaining to the Christian influence was not reported during the spring semester due to the absence of the marketing program director.

ISLO 3


Summary of Achievement of Intended Student Learning Outcomes: Marketing Program (BBA)



Comp Bus

Exam

(CBE)

Capstone

Simulation

Glo-Bus

Marketing

Internship

Marketing

Capstone

Project

Senior

Exit

Survey

Senior

Focus

Group

Indirect Measure 3

Indirect Measure 4









1. Students will be able to explain the

functional areas of marketing. Met Met N/A N/A Met Met

2. Students will be able to chart a career path in the field of marketing.

N/A N/A N/A Met Met N/A

3. Students will be able to apply a

Christian-service perspective to

their future career. N/A N/A N/A Met

N/A (lack data)

N/A (lack data)

School of Business

Student Learning Assessment for Management Information Systems (BBA)


1. Students will be able to explain the functional areas of accounting, finance, management and marketing.

2. Students will be able to explain the language and apply the techniques and functions involved in information systems.

3. Students will be able to communicate effectively within in a professional setting.

4. Students will be able to apply analytical and critical thinking skills in solving complex problems, including creative and analytical anlaysis.



1. There were no graduates in 2013-14 in the MIS program. Objective (Target/Criteria) N/A


School of Business

Student Learning Assessment for Master of Business Administration Program (MBA)


1. Students will be able to articulate a sound tactical-strategic plan for an organization in their chosen field.

2. Students will be able to develop an appropriate understanding of basic theory in marketing, management, and financial areas for organizational enhancement.

3. Students will be able to develop a working understanding of the ethical challenges in their given fields and be able to integrate their personal world-life view and accountability plan to manage these ever-present personal temptations in their careers and with their family lives.

4. Students will be able to have had successful experiences working with organizations in various settings by participating in project-internships.



1. Capstone Applied Project Each student in the capstone course will develop a tactical strategic plan for an organization in their chosen field for presentation to an MBA panel. 100% of the students will achieve an acceptable assessment by the MBA panel.

Each student will develop an appropriate understanding of basic theory in marketing, management and financial areas for their chosen professional field for presentation to an MBA panel in preparation for presentation for employer or proposed new venture team. 100% of graduates will display an acceptable rating for their understanding of basic theory in marketing, management and financial areas.

Each student will include significant areas of ethical challenges in their chosen field as well as their personal world-life view and accountability plan for presentation to an MBA panel in preparation for presentation for employer. It is desired that 100% of students will be able to articulate their world-life view and accountability plan in an acceptable or higher manner.

Each student will participate in a capstone research and applied project in their chosen and professional field. 100% of students will participate in this project and provide appropriate recommendations for enhancement of

General Program ISLOs Assessed by this Measure: 1, 2, 3, 4


various tactical areas as presented to the employer. 100% of the students will be judged as having a successful experience.

Each student will write a paper for presentation to an MBA panel in preparation for presentation for employer. It is desired that 100% of students will participate in this project and provide appropriate recommendations for enhancement of various tactical areas as judged by the MBA panel. 100% of the students will receive an acceptable or higher rating by the MBA panel.

2. ETS Major Field Test - MBA The Educational Testing Services (ETS) Major Field Test (MFT) will be given to each student in the capstone course and 75% of MBA students will score at or above 50% or the national average on the strategic planning criterion.

The Educational Testing Services (ETS) Major Field Test (MFT) will be given to each student and 50% of MBA students will score at or above 50% or the national average in the basic theory of marketing, management and finance.

General Program ISLOs Assessed by this Measure: 1, 2,

3. MBA Ethics Course: Application Paper The MBA graduate student will write an application paper in response to an ethical dilemma. The student will present solutions based on his/her world-life view. This paper will be reviewed by an MBA panel and 100% will be rated as acceptable or higher




1. MBA Graduate Exit Survey The MBA student exit survey will indicate that 80% of students will feel confident in their ability to articulate a sound tactical strategic plan in their chosen field.

An MBA student exit survey will indicate that 80% of students will feel confident in their understanding of basic theory in marketing, management and financial areas for their organizational use. It is desired that 75% will feel confident or very confident on a 5-point Likert-type scale.

An MBA student exit survey will indicate that 80% of students will feel will be able articulate their world-life view and an accountability plan to

General Program ISLOs Assessed by this Measure: 1, 2, 3, 4


manage their career. It is desired that 100% will feel confident or very confident on a 5-point Likert-type scale.

MBA student exit survey will indicate that 100% of students participated in a field project in their chosen field. It is desired that 100% will feel confident or very confident on a 5-point Likert-type scale that their applied project assisted in the furthering of their career.

2. MBA Graduate Personal Interview Graduating MBA students will be interviewed individually how confident they feel in preparing a tactical strategic plan in their chosen field. It is desired that 80% will feel confident or very confident on a 1-5 Likert-type scale.

A personal interview will be undertaken with MBA students as they finish the Research Project asking how confident they feel in their understanding of basic theory in marketing, management, and financial areas as applicable in their specific profession. It is desired that 90% will feel confident or very confident on a 1-5 Likert-type scale.

Students completing their research project will be personally interviewed asking how confident they feel in understanding the ethical challenges in their chosen field. They will feel confident in discussing their world-life view and their personal accountability plan. It is desired that 100% will feel confident or very confident on a 1-5 Likert-type scale.

Graduating MBA students will be interviewed individually to ask how confident they felt their applied field project was in their advancement in their chosen field. It is desired that 100% will feel confident or very confident on a 1-5 Likert-type scale.

General Program ISLOs Assessed by this Measure: 1, 2, 3 ,4






Assessment Results: Master of Business Administrtion (MBA) Program


1. Capstone Applied Project

89% of the total MBA graduates met the criteria for success in developing an acceptable tactical strategic plan. 100% of the New

Braunfels graduates met the criteria; whereas, 86% of the Brownwood students developed a tactical strategic plan for an organization.

ISLO 1

95% of the total MBA students demonstrated an understanding of the management, marketing, and financial concepts in their capstone

projects. 100% of the New Braunfels students were successful; whereas, 93% of the Brownwood students were successful.

ISLO 2

100% of the students clearly articulated their world-life view and accountability plan. The standard for success is vague and lacks a

more precise assessment measure.

ISLO 3

100% of the students participated successfully in a field based applied project and reported recommendations for their organization.

Both Brownwood and New Braunfels students met this criteria.

ISLO 4

2. ETS Major Field Test: MBA

The average for all MBA graduates collectively scored at 52% which was slightly higher than the national average of 51.6%. The

Brownwood average was 50% and the New Braunfels average was 56% on the strategic integration criterion. ISLO 1 and 2

47% of the total MBA graduates scored at or above the national average on the MBA MFT exam. 36% of the Brownwood students

met the criteria; whereas, 80% of the New Braunfels students met or exceeded this criteria. ISLO 2


3. MBA Ethics Course: Application Paper

100% of all MBA graduates wrote an acceptable or higher application paper in response to an ethical dilemma in their MBA ethical

issues course. ISLO 3


1. MBA Graduate Survey

94% of the total MBA graduates indicated they were confident in their ability to articulate a sound tactical strategic plan in their

chosen field. 100% of the New Braunfels students reported an acceptable confidence level, whereas 92% of the Brownwood students

reported as such. ISLO 1

89% of the total MBA graduates indicated an acceptable confidence level pertaining to their understanding of marketing, management

and financial principles. 85% from the Brownwood campus and 100% from New Braunfels. ISLO 2

83% of the total MBA students indicated that they were able to articulate their world-view and an accountability plan to manage their

career. 100% of the New Braunfels indicated an acceptable ability level; whereas, 77% of the Brownwood students reported an

acceptable ability level. ISLO 3

100% from both the New Braunfels and Brownwood campus indicated on the survey that they were confident that they will further

their career as a result of the project they completed in the capstone course. ISLO 4

2. MBA Graduate Personal Interview

The interview revealed the same results as stated in the first indirect assessment measure. 94% of the total indicated an acceptable

confidence level; whereas, 100% from New Braunfels students and 92% from Brownwood. ISLO 1

94% of the graduates reported that they were confident in their understanding of basic theories in marketing, management and finance.

92% from Brownwood reported an acceptable confidence level and 100% of the New Braunfels students reported favorably. ISLO 2

In the personal interview, 100% indicated an acceptable confidence level pertaining to ethical challenges, world-life view, and

personal accountability. Students from both campuses were unanimous in reporting favorably. ISLO 3


As in the survey, 100% felt confident that the field based project improved their opportunity to advance in their career. This was true

for both campuses. ISLO 4




Capstone

Applied

Project

Major Field

Test

MBA

Ethics Course

Application

Paper

Direct Measure 4

MBA Graduate

Survey

MBA Graduate

Interview

Indirect Measure 3

Indirect Measure 4









1. Students will be able to articulate a sound tactical-strategic plan for an organization in their chosen field.


2. Students will be able to develop an appropriate understanding of basic theory in marketing, management, and financial areas for organizational enhancement.


3. Students will be able to develop a working understanding of the ethical challenges in their given fields and be able to integrate their personal world-life view and accountability plan to manage these ever-present personal temptations in their careers and with their family lives.

Met N/A Met Not Met Met

4. Students will be able to have had successful experiences working with organizations in various settings by participating in project-internships.

Met N/A N/A Met Met


Proposed Courses of Action for Improvement in Learning Outcomes for which Performance Targets Were Not Met: MBA Program

1. Core ISLO 1

A rubric has been developed to more accurately depict the achievement of this tactical strategic plan. A standard of excellence will be

used in addition to the criteria of “acceptable.” Next year’s target will remain at 100% attaining acceptable, but another measure will

pertain to the “excellent” standard.

The MBA MFT is a clear direct assessment measure that provides data that can be used against a national benchmark. The standard

will remain as an assessment related to strategic planning.

2. Core ISLO 2

An improved rubric based assessment metric will be developed to gain more accurate and reflective data pertaining to student

achievement on their capstone project.

In reviewing the lack of success by several Brownwood students, it was found that several were admitted into the program on a

probationary basis. Their projected ability to be successful in graduate work was in question. More scrutiny will be used in the

admission process to ensure more success for our students in the MBA program.

3. Core ISLO 3

The Brownwood campus includes a majority of traditional students moving from undergraduate to graduate school. The New

Braunfels campus is 100% composed of nontraditional students who have established careers. This appears to be the key difference

when comparing the two campuses. The traditional students may need more academic support (case studies, field based applications)

or real professional experience to take full advantage of this learning objective for the HPU MBA.

outcomes assessment results - hputx.edu · general program islos assessed by this measure: 1,2,4 2....

Documents